寻求开源Linux工具进行分布式任务管理
我们的架构有几百台服务器，大约有 200 台 流程（全部是内部开发的）分散在他们身上，一些是受控制的 由 crontab 和一些作为守护进程运行的。 一些服务器位于“组”中 其中所有服务器的配置相同，并且其他服务器具有 自定义配置。 我的任务是集中控制 这些任务。
一个用例是通过 ssh 进入任何盒子的用户必须能够控制 网络上的任何进程都以接近实时的方式启动 并停止相关守护进程或重建并重新安装 crontab。 已经创建了各种零碎的东西来驱动 所有这些都来自数据库，但尚未考虑整体架构 通过。
我希望我会编写一个在每个服务器上运行的守护进程 在对等网络、数据库和守护进程之间进行协调 crontab。
我正在调查哪些技术可以帮助和促进这个项目。
我想我正在寻找点对点可靠的通信技术。 虽然我不能百分百确定这就是我所需要的。 我雷达上的事情 包括 Spread、JXTA、Zookeeper 和 JMS。
人们对这些技术的体验如何，还有哪些其他技术 我应该检查哪些技术？ 在我看来，我将会非常 低数据速率（最多每小时几千字节）。 但可靠性 和成熟的API很重要。
We have an architecture with a couple hundred of servers with about 200
processes (all developed in-house) spread over them, some controlled
by crontab and some that run as daemons. Some servers are in 'groups'
where all servers are configured identically, and other servers have
custom configurations. I've been tasked with centralizing the control
of these tasks.
One use case is that a user ssh'ed into any box must be able to control
any process on the network in something close to real time, by starting
and stopping the relevant daemon or rebuilding and reinstalling the
crontab. There are already various bits and pieces created to drive
all of this from a database, but the overall architecture hasn't been thought
through.
I'm expecting I'll write a daemon that will run on each server and
mediate between peer-to-peer networking, the database and the daemons and
crontabs.
I'm surveying what technologies might aid and abet this project.
I think I'm looking for peer-to-peer reliable communication technologies.
Though I'm not 100 percent sure that's what I need. Things on my radar
include Spread, JXTA, Zookeeper and JMS.
What are people's experiences with these technologies, and what other
technologies should I check out? As I see it, I'm going to have very
low data rates (a few thousand bytes per hour at most). But reliability
and a mature API are important.
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
抱歉，这并不是对您的任何问题的真正直接答案，但您所描述的内容听起来很像您最终会做很多重复的工作 - 特别是如果只考虑“用户 ssh 进入一个盒子”部分。 （双关语无意，但现在我注意到了，是的！=）
您是否看过诸如 http://www.cfengine.org 之类的项目？ cfengine.org 或 http://www.theether.org/pssh/ ？
Sorry, this is not a really direct answer to any of your questions but stuff you describe sounds alot like you will end up doing alot of duplicate work - specially if just thinking about the "user ssh's into one box" part. (pun unintentional but now that i noticed it, yey!=)
Have you taken a look in projects like http://www.cfengine.org or http://www.theether.org/pssh/ ?