在管道部署时,建议在AWS EMR群集上自动化Flink Job的推荐方法
我是Flink和EMR群集部署的新手。目前,我们有一个flink的作业,我们正在通过Flink CLI Stop/Start-Job命令在AWS EMR群集上手动部署它。
我想自动化此过程(自动化通过带有保存点的管道进行的每个部署进行更新的flink job jar),并且需要一些有关可能探索的方法的建议。
I am new to Flink and EMR cluster deployment. Currently we have a Flink job and we are manually deploying it on AWS EMR cluster via Flink CLI stop/start-job commands.
I wanted to automate this process (Automate updating flink job jar on every deployment happening via pipelines with savepoints) and need some recommendations on possible approaches that could be explored.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
我们可以选择通过Flink REST API支持所有Flink作业操作
https://nightlies.apache.org/flink/flink/flink/flink-docs-master/docs/ops/rest_api/
示例项目使用相同的方法: https://github.com/ing-bank/flink-deployer
We got an option to automate this process via Flink Rest API support for all flink job operation
https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/
Sample project which used the same approach : https://github.com/ing-bank/flink-deployer