GCP卡在GCP上的示例
我遵循了 httpps://cloud.google.com/dataaflow /doc/quickstarts/create-pipeline-go 对于python和go,但是当我将作业部署到dataflow时,该作业的进展不会超过0%,而GT; gt; 20分钟。
是否有任何已知的数据流问题可以防止完成此工作?
我用来执行工作的选项:
python -m apache_beam.examples.wordcount \
--input gs://dataflow-samples/shakespeare/kinglear.txt \
--output <output_bucket> \
--runner DataflowRunner \
--project <project_id> \
--region us-west1 \
--tmp_location <gcp_tmp_bucket> \
--service_account_email=<service_account> \
--subnetwork=<subnetwork_path>
I followed the examples on https://cloud.google.com/dataflow/docs/quickstarts/create-pipeline-go for both Python as well as Go but when I deploy the job to Dataflow, the job doesn't progress past 0% for >20mins.
Is there any known issues for Dataflow that prevent completion of this job?
The options I used to execute the job:
python -m apache_beam.examples.wordcount \
--input gs://dataflow-samples/shakespeare/kinglear.txt \
--output <output_bucket> \
--runner DataflowRunner \
--project <project_id> \
--region us-west1 \
--tmp_location <gcp_tmp_bucket> \
--service_account_email=<service_account> \
--subnetwork=<subnetwork_path>
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
您的工作停滞不前,因为您尚未填写示例命令中的值
Your job is stagnating because you haven't filled in the values in the example command ????
Cancel the job, the job should timeout if it doesn't detect anything happening but you are billed for the worker that's running while it's stuck.
--output "gs://yourbucket/output"
--project your_project
us-west1
in--region
tmp_location
:--tmp_location "gs://yourbucket/tmp"
Fill these options in the command and re-run.