分布式系统中的消息传递和信令
我有一个分布式视频分析系统,其组成为:
1. feature extraction: generated lots of features(20+) from each frame of the video
2. multiple detectors(in different machine):
* Each of them will get a subset of feature
* Each of them needs the features from multiple frames.
* Eg. Detector 1 needs feature 1-5 from 3 frames to start processing; Detector 2 needs feature 2-8 from 8 frames to start processing
我的问题是:如何在特征提取块和多个检测器之间进行通信,最好是实时通信?我一直在研究一种事件总线,但它仅适用于一个进程,Hadoop 中的 ZooKeeper 会是更好的解决方案吗?
我正在使用Java。欢迎任何建议。
I have a distributed video analysis system, which is composed of:
1. feature extraction: generated lots of features(20+) from each frame of the video
2. multiple detectors(in different machine):
* Each of them will get a subset of feature
* Each of them needs the features from multiple frames.
* Eg. Detector 1 needs feature 1-5 from 3 frames to start processing; Detector 2 needs feature 2-8 from 8 frames to start processing
My question is: how to do the communication between feature extraction block and multiple detectors, preferably in real-time? I have been looking at an event bus, but it's only for one process, will ZooKeeper in Hadoop be a better solution?
I am using Java. Any suggestion is welcomed.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
在 Java 中,您可以考虑使用 RabbitMQ 消息总线。有一个带有 Java 绑定 的库。
In Java, you could consider using RabbitMQ message bus. There is a library with Java bindings.