为什么Apache Beam的火花跑步者给出错误错误:无法加载ORG/APACHE/BEAM/SDK/SDK/options/PipelineOptions?
我尝试使用命令使用Spark-Runner运行一个工作的Apache Beam代码,
spark-submit --class org.apache.beam.examples.WordCount --master spark://localhost:4040 target\word-count-beam-0.1.jar
--runner=SparkRunner
但它
Error: Failed to load org.apache.beam.examples.WordCount: org/apache/beam/sdk/options/PipelineOptions
22/04/29 12:59:54 INFO ShutdownHookManager: Shutdown hook called
22/04/29 12:59:54 INFO ShutdownHookManager: Deleting directory C:\Users\Mohit\AppData\Local\Temp\spark-8f8164aa-816e-4d96-96d0-f1ec7441d4a8
在上述错误中引发了这一行,这是问题。 我只是想运行Apache Beam给出的正常示例。有人有主意吗?
I tried to run a working Apache Beam code with Spark-Runner using command
spark-submit --class org.apache.beam.examples.WordCount --master spark://localhost:4040 target\word-count-beam-0.1.jar
--runner=SparkRunner
but it throws error
Error: Failed to load org.apache.beam.examples.WordCount: org/apache/beam/sdk/options/PipelineOptions
22/04/29 12:59:54 INFO ShutdownHookManager: Shutdown hook called
22/04/29 12:59:54 INFO ShutdownHookManager: Deleting directory C:\Users\Mohit\AppData\Local\Temp\spark-8f8164aa-816e-4d96-96d0-f1ec7441d4a8
This first line in above error this is the problem.
I am just trying to run normal example of WordCount that Apache Beam gives. Do anybody have an idea?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论