如何在托管缩放集群中保持在Conf/Masters和Conf/工人的持续师父和工人列表?
我使用的是AWS EMR群集,每个节点都安装了Aluxio。我现在想在高可用性中部署Alluxio。 https://docs.alluxio.io.io/os/oser/stable/en/deploy/running-running-alluxio-aluxio-an-a-ha-cluster.html#start-an-an-an-an-aluxio-cluster-an-aluxio-cluster-cluster-cluster-cluster-cluster-- ha 我正在遵循上述文档,并查看“在所有Alluxio Master节点上,列出conf/workers
文件中的所有Worker HostNames,并列出conf/masters中的所有大师
文件”。
我担心的是,由于我有一个由AWS管理的缩放群集,因此根据群集负载,工人节点保持添加和删除。如何在托管缩放集群中保持在Conf/Masters和Conf/工人的持续师父和工人列表?
I am using an AWS EMR cluster with Alluxio installed n every node. I want to now deploy Alluxio in High Availability.
https://docs.alluxio.io/os/user/stable/en/deploy/Running-Alluxio-On-a-HA-Cluster.html#start-an-alluxio-cluster-with-ha
I am following the above documentation, and see that "On all the Alluxio master nodes, list all the worker hostnames in the conf/workers
file, and list all the masters in the conf/masters
file".
My concern is that since I have an AWS-managed scaling cluster the worker nodes keep added and removed based on cluster loads. How can I maintain a list of constant masters and workers under conf/masters and conf/workers in a managed Scaling cluster?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
此
conf/workers
和conf/masters
conf文件仅用于通过脚本进行直觉设置。群集运行后,您无需更新它们。例如,在Say EMR群集中,您可以添加一个新的从属节点作为Alluxio Worker,并且只要您指定正确的Alluxio主地址,这个新的Alluxio Worker将能够像其他工人一样注册并在车队中服务
this
conf/workers
andconf/masters
conf file is only used for intiial setup through scripts. Once the cluster is running, you don’t need to update them any more.E.g., in an say EMR cluster, you can add a new slave node as Alluxio worker and as long as you specify the correct Alluxio master address, this new Alluxio worker will be able to register itself and serve in the fleet like other workers,