Zookeeper 客户端是否保持打开大量 TCP 连接?如果是这样,它的可扩展性如何?有什么限制吗?
我们正在使用 Zookeeper 为我们的对象存储设计一个分发配置底层。一旦我们将所有配置迁移到 zk,将会有数百个应用程序将向 zk 注册事件。这会导致大量打开的 TCP 连接吗?有可扩展性问题吗?最佳做法是什么?
We are designing a distribution configuration substrate for our object store with zookeeper. Once we have migrated all the configurations to zk, there will be hundreds of apps that will register for events with zk. Does this result in lots of open tcp connections ? Any scalability issues ? What are the best practices ?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(2)
将会有很多 TCP 连接,但正如 jterrace 所提到的,100 个是一个很小的数字,此电子邮件线程表明 Zookeeper 在连接到 3 节点集合的大约 20K 客户端时开始显示问题(显然取决于服务器的容量) :<一href="http://mail-archives.apache.org/mod_mbox/zookeeper-dev/201105.mbox/%3CE7FE30AF6EB51F4FBB74E39CA896472F94D604@SC-MBX01-5.TheFacebook.com%3E" rel="nofollow">http://mail-archives.apache.org/mod_mbox/zookeeper-dev/201105.mbox/%3CE7FE30AF6EB51F4FBB74E39CA896472F94D604@SC-MBX01-5.TheFacebook.com%3E
There will be a lot of TCP connections, but as mentioned by jterrace, 100's is a small number and this email thread indicates zookeeper begins to show issues at about 20K clients connecting to a 3 node ensemble(obviously depends on the capacity of your servers): http://mail-archives.apache.org/mod_mbox/zookeeper-dev/201105.mbox/%3CE7FE30AF6EB51F4FBB74E39CA896472F94D604@SC-MBX01-5.TheFacebook.com%3E
如果您只有数百个应用程序,zookeeper 将毫无问题地处理该流量。它旨在为每个 Zookeeper 服务器处理潜在的数千个并发客户端。有关更多技术细节,请参阅本文:http://www.usenix.org /event/atc10/tech/full_papers/Hunt.pdf
If you only have hundreds of applications, zookeeper will handle that traffic with no problem. It's designed to handle potentially thousands of simultaneous clients per zookeeper server. See this paper for more technical details: http://www.usenix.org/event/atc10/tech/full_papers/Hunt.pdf