谷歌云作曲家库安装失败

发布于 2025-01-19 02:25:02 字数 2287 浏览 2 评论 0原文

在尝试更新我的 Composer env 上已安装的 pypi 软件包时,我收到以下错误 -

 UPDATE operation on this environment failed 7 minutes ago with the following error message:
Failed to install pypi packages.
Your service account is missing the required permissions to check the build log for errors. You can access them through Cloud Logging, or by running gcloud builds log fe358f33-51ec-4064-9a75-38af2974976f --project ene-playground.

阅读构建日志时,看起来存在依赖关系问题,这显然不是权限问题 -

google-cloud-vision 1.0.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但你有 google-api-core 2.7.1. google-cloud-videointelligence 1.16.1 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但您有 google-api-core 2.7.1. google-cloud-translate 1.7.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但你有 google-api-core 2.7.1. google-cloud-texttospeech 1.0.1 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但你有 google-api-core 2.7.1. google-cloud-speech 1.3.2 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但您有 google-api-core 2.7.1. google-cloud-spanner 1.19.1 有要求 google-api-core[grpc,grpcgcp]<2.0.0dev,>=1.14.0,但是你有 谷歌 API 核心 2.7.1。 google-cloud-secret-manager 1.0.0 有 要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但是你有 谷歌 API 核心 2.7.1。 google-cloud-memcache 1.0.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.22.2,但你有 google-api-core 2.7.1. google-cloud-language 1.3.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但您有 google-api-core 2.7.1. google-cloud-dlp 1.0.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但您有 google-api-core 2.7.1. google-cloud-core 1.7.2 有要求 google-api-core<2.0.0dev,>=1.21.0,但您有 google-api-core 2.7.1。 google-cloud-container 1.0.1 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但你有 google-api-core 2.7.1. google-cloud-bigtable 1.7.0 有要求 google-api-core[grpc]<2.0.0dev,>=1.14.0,但你有 google-api-core 2.7.1. google-api-python-client 1.12.8 要求 google-api-core<2dev,>=1.21.0,但您有 google-api-core 2.7.1。 apache-beam 2.34.0 有要求 avro-python3!=1.9.2,<1.10.0,>=1.8.1,但是您有 avro-python3 1.10.0。 命令'/bin/sh -c bash installer.sh $COMPOSER_PYTHON_VERSION 失败'返回非零代码:1 ERROR

我想了解实际问题是什么,但我对这两个错误感到困惑。

PS:我已经在本地 Airflow 上安装了所有这些库,并且它们可以完美地协同工作。

我的作曲家版本是:1.17.7 我的气流版本是:2.1.4

有什么想法阻止我安装库的实际错误是什么?

while attempting to update the installed pypi packages on my composer env, I'm getting the following error -

 UPDATE operation on this environment failed 7 minutes ago with the following error message:
Failed to install pypi packages.
Your service account is missing the required permissions to check the build log for errors. You can access them through Cloud Logging, or by running gcloud builds log fe358f33-51ec-4064-9a75-38af2974976f --project ene-playground.

when reading the build logs, it looks like there's a dependency issue which is clearly isn't permission issue -

google-cloud-vision 1.0.0 has requirement
google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-videointelligence 1.16.1 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-translate 1.7.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-texttospeech 1.0.1 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-speech 1.3.2 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-spanner 1.19.1 has requirement google-api-core[grpc,grpcgcp]<2.0.0dev,>=1.14.0, but you have
google-api-core 2.7.1. google-cloud-secret-manager 1.0.0 has
requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have
google-api-core 2.7.1. google-cloud-memcache 1.0.0 has requirement
google-api-core[grpc]<2.0.0dev,>=1.22.2, but you have google-api-core
2.7.1. google-cloud-language 1.3.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-dlp 1.0.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-core 1.7.2 has requirement google-api-core<2.0.0dev,>=1.21.0, but you have google-api-core 2.7.1.
google-cloud-container 1.0.1 has requirement
google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-cloud-bigtable 1.7.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you have google-api-core
2.7.1. google-api-python-client 1.12.8 has requirement google-api-core<2dev,>=1.21.0, but you have google-api-core 2.7.1.
apache-beam 2.34.0 has requirement
avro-python3!=1.9.2,<1.10.0,>=1.8.1, but you have avro-python3 1.10.0.
The command '/bin/sh -c bash installer.sh $COMPOSER_PYTHON_VERSION
fail' returned a non-zero code: 1 ERROR

before exporting my code to k8sPodOperator I want to understand what's the actual problem but I'm confused between those 2 errors.

PS: I've installed all those libraries on my local Airflow and they work perfectly fine together.

my composer version is : 1.17.7
my airflow version is: 2.1.4

any ideas what's the actual error preventing me from installing the library?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

九歌凝 2025-01-26 02:25:03

尝试使用最新版本和气流。

Try installing the library using the latest version of composer and airflow.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文