将大量文件保存在单个 S3 存储桶中是否存在问题？
我有大量（700,000+）文件（平均约 50kb）将存储在 S3 上。我不确定是否应该将它们全部放在一个桶中（就我而言这很好），或者将它们分成更小的桶。
我只是担心如果文件都在一个存储桶中，S3 可能需要更长的时间来提供这些文件，就像你在 Unix 目录中放置了太多东西一样。这是一个担心吗，我应该将它们分成更多的桶，还是只做最简单的事情并将它们放在一个桶中？
I have a huge amount (700,000+) of files (about 50kb on avg) I am going to store on S3. I am not sure if I should stick them all in one bucket (which is fine as far as I am concerned), or split them into smaller buckets.
I am only worried that it may take longer for S3 to serve the files if they are all in one bucket, something like if you stick too many things in a Unix directory. Is this a worry, should I break them into more buckets, or just do the most straightforward thing and stick them in 1 bucket?
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
我自己并没有存储那么多对象，但大量对象（即使在单个存储桶中）正是 S3 旨在处理的任务类型。检索该存储桶中对象的完整列表显然是一项相当大的任务，但它不应该损害 S3 查找键并返回您放置在那里的对象的能力。
您应该注意，即使 S3 没问题，某些工具（例如用于“浏览”S3 的图形工具，或某些执行删除每个对象后删除存储桶之类操作的工具）也不能很好地处理此问题。这只是需要注意的事情。
I haven't stored that many objects myself, but large numbers of objects (even in a single bucket) is exactly the sort of task that S3 was designed to handle. Retrieving a complete list of the objects in that buckets will obviously be a fairly large task, but it shouldn't impair S3's ability to look up keys and return the objects you've put there.
You should be advised that some tools (e.g. graphical tools for "browsing" S3, or some tools that do things like delete the bucket after removing each object) do not handle this well even though S3 is OK. It's just something to be aware of.