超大文件分发
我正在寻找基础设施解决方案的想法。
我有一个大约 400Mbs 的文件。我需要它可供大约 2500 台计算机使用。这些计算机大约会在同一天在 8 小时内下载该文件。这意味着他们不会在同一秒全部访问，而是在 8 小时内访问。
S3 是否能够处理该负载，如果不能，您建议分发这些文件的良好配置是什么。
请记住，大多数计算机都位于大致相同的地理位置，因此 CDN 内容，同时外包一些负载，并不能完全解决问题。
谢谢！
I'm looking for ideas for infrastructure solution.
I have a file that is roughly between 400Mbs. I need it to be available to about 2500 computers. Those computer will download that file roughly on the same day over the course of 8 hours. Meaning they will not all access at the same second but rather over a span of 8 hours.
Would S3 be able to handle that load and if not, what would you suggeest a good configuration to distribute these files would be.
Bare in mind that most of the computers are in roughly the same geographical location so CDNing the content, while offshoring some of the load, will not solve the problem completely.
Thanks!
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（2）
为此，我将使用 S3 的 BitTorrent 功能，请参阅 http://aws.amazon.com/ s3/faqs/#What_is_the_BitTorrent_TM_protocol_and_how_do_I_use_it_with_Amazon_S3
I would use the BitTorrent capabilities of S3 for this, see http://aws.amazon.com/s3/faqs/#What_is_the_BitTorrent_TM_protocol_and_how_do_I_use_it_with_Amazon_S3
寻找想法？嗯，这是 1：基础设施的一个
重要且经常被忽视的部分，是连接节点的中间部分一位经验丰富的专业人士曾经对我说过。他还表示，在理论上和实践中，高级 Cat-6 或 Cat-7 UTP 电缆将比 Cat-5e 电缆以更低的延迟输出更多数据。换句话说：不要忘记本质上承载所有东西的硬件。 Ram、Raid、UTP、交换机、路由等。一旦确定了 Mb/s 突发，剩下的时间就可以无忧无虑地等待完整的传输完成。
附言。 “400Mbs”是指 400 MB 还是 400 Mbits/s？
Looking for idea's? Well, here is 1: an
important and often overlooked part of an infrastructure, are the in-between parts that connect the nodessaid an experienced professional once to me.He also said that
high grade Cat-6 or Cat-7 UTP cables will in theory and in practice output more data at lower lags than Cat-5e cables. In other words: dont forget the hardware that is essentially carrying all the stuff. Ram, Raid, UTP, Switches, Routing etc. Once you have your Mb/s burst figured out, the rest should be worry free minutes awaiting the full transmissions completion.PS. by "400Mbs" Do you mean 400 MB or 400 Mbits/s?