使用 BitTorrent 在多个站点之间进行文件复制/同步
我需要构建一个依赖于站点之间大文件复制的分布式系统。
我想到使用像 BitTorrent 这样的 p2p 技术来节省带宽并提高可靠性。
我是不是大错特错了?
有人设计过这样的解决方案吗?
你推荐哪些图书馆?
I need to build a distributed system which relies on replication of large files between the sites.
I thought of using p2p technology like bittorrent to save on bandwidth, and increase reliability.
Am I terribly wrong?
Have anyone ever architected such a solution?
What libraries do you recommend?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(3)
BitTorrent 开发人员提出了一个新的有前景的解决方案:BitTorrent Sync。
它具有以下特点:
A new promising solution from the developers of BitTorrent: BitTorrent Sync.
It has the following features:
我刚刚从 Twitter 上找到了这个开源项目,它非常完美:
https://github.com/lg/murder
来自文档:
I just found this open-source project from Twitter which hits the nail perfectly:
https://github.com/lg/murder
From the docs:
如果您有超过 2 个站点,那么 p2p 是更好的解决方案恕我直言。
只需安装rtorrent,
为了保护第三方 torrent 客户端的内容,请在生成 .torrent 文件时设置私有标志并使用您自己的跟踪器。 opentracker是一个不错的选择。
还有一个提示:如果您的 torrent 客户端支持超级播种模式(又名BEP-16 或初始播种),启用它。它将有助于在节点之间以最少的重复分发内容。
If you have more than 2 sites, then p2p is better solution IMHO.
Just install rtorrent, deluge or any other high-performance torrent client at every site. Than you can distribute only .torrent files with scp/sftp and enjoy.
In order to secure the content from third party torrent clients, set the private flag when producing the .torrent file and use your own tracker. opentracker is a good choice.
One more hint: if your torrent client supports super seeding mode (aka BEP-16 or initial seeding), enable it. It'll help distribute the content with minimum duplication between nodes.