如何编写自己的 Hadoop 调度程序?
最近在研究hadoop的调度器机制。 使用0.20.2(包括公平和容量) 读过一些论文,LATE\Deadline Scheduler...
有人尝试过吗? 或者有指导吗?
无论如何,谢谢
I've been studying hadoop's scheduler mechanism recently.
Using 0.20.2(fair&capacity included)
Have read some papers, LATE\Deadline Scheduler...
Has anyone tried?
or is there a guide?
thx anyway
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
如果您打算做自己的调度程序,也许您可以考虑作者 Datta Dhok 的文档 - Learning based access control and task assignment in mapreduce。他们在准入控制和基于学习的 hadoop 调度程序方面做了一些工作。源代码可用。您是否找到了有关该主题的其他文档?
If you plan to do your own scheduler maybe you could consider a document from author Datta Dhok - Learning based admission control and task assignment in mapreduce. They did some job on admission control and a learning based hadoop scheduler. Source code is available. Did you find any other documents on these subject?