无法在Google Cloud Composer上安装气流雪花提供商软件包
我正在尝试在Google Cloud Composer环境上安装Apache-Airflow-Snowflake。
Apache-airFlow-Providers-snowflake具有SQLalchemy＆gt; = 1.4.0的要求
，但是，Apache-airflow 2.2.5+Composer具有SQLalchemy＆lt; 1.4.0，＆gt; = 1.3.18。 特别是Sqlalchemy的作曲家的版本为1.3.24。
我尝试了升级SQLalchemy软件包，但依赖性矛盾。
我已经尝试了作曲家上的其他版本的气流，并且依赖性也相互冲突。
这是否意味着到目前为止，无法在Google Cloud Composer上使用Apache-Airflow-Snowflake？
我收到的错误的屏幕截图 错误屏幕快照
I am trying to install apache-airflow-providers-snowflake on a Google Cloud Composer environment.
apache-airflow-providers-snowflake has a requirement sqlalchemy >= 1.4.0
However,apache-airflow 2.2.5+composer has requirement sqlalchemy <1.4.0,>=1.3.18.
Specifically the version Composer has of sqlalchemy is 1.3.24.
I have tried upgrading sqlalchemy package but got conflicting dependencies.
I have tried the other versions of airflow on composer and had same conflicting dependencies as well.
Does that mean as of now, there is no way to work with apache-airflow-providers-snowflake on Google Cloud Composer ??
Attached screenshot of the error I get
Error Screenshot
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（2）
在Daniel T的答案之后，我手动安装了Snowflake-Sqlalchemy == 1.2.5作为PYPI软件包，然后安装了Apache-AirFlow-Providers-snowflake，
但是，由于“ ModulenotfoundError：no Module：no Modele no Module no Mode no Sqlalchemy，我都损坏了DAG。 SQL.Roles的“”。
这是由已知的问题 空气流动。
另一个问题建议将降级到1.2.4，这有助于解决我的所有错误。
因此，最终解决方案是手动安装snowflake-sqlalchemy == 1.2.4作为PYPI软件包，然后安装Apache-Airflow-Providers-snowflake。
Following the answer by Daniel T , I manually installed snowflake-sqlalchemy==1.2.5 as a PyPi package, and then installed apache-airflow-providers-snowflake
However, I got broken DAGs due to "ModuleNotFoundError: No module named 'sqlalchemy.sql.roles'".
This is caused by a known issue while using sqlalchemy==1.2.5 with airflow.
Another issue suggested downgrading to 1.2.4 which helped resolve all my errors.
So the final solution is to manually install snowflake-sqlalchemy==1.2.4 as a PyPi package, and then install apache-airflow-providers-snowflake.
这是在云作曲家
该线程的建议是：
困难的要求来自
snowflake-sqlalchemy，您可以看到在这里。1.2.5是最后一个版本，没有＆gt; = 1.4.0的最低sqlalchemy，您可以看到在这里这是安全的（如果这是您唯一安装的提供者来依赖snowflake-sqlalchemy）安装
snowflake-sqlalchemy == 1.2.5作为提供商需要＆gt; = 1.1.0This is raised as a bug on Cloud Composer here.
A suggestion on that thread is:
The hard requirement comes from
snowflake-sqlalchemywhich you can see here.1.2.5was the last version to not have a minimum sqlalchemy of>=1.4.0which you can see hereIt's safe (if this is the only provider you have installed to depend on snowflake-sqlalchemy) to install
snowflake-sqlalchemy==1.2.5as the provider requires>=1.1.0