如何从 100 万个文件夹中检查 GCP 云存储中是否存在某个文件夹

发布于 2025-01-14 05:46:51 字数 756 浏览 2 评论 0原文

例如我有这样的结构。

bucketname/checked/folder1/some files
bucketname/checked/folder2/some files
bucketname/checked/folder3/some files
bucketname/checked/folder4/some files
bucketname/checked/folder5/some files
bucketname/checked/folder6/some files
bucketname/checked/folder7/some files
bucketname/checked/folder8/some files
bucketname/checked/folder9/some files
bucketname/checked/folder10/some files
bucketname/checked/folder11/some files
......
......

bucketname/checked/folder-1million/some files

现在,

1。如果我必须检查folder99999是否存在。那么,检查它的最佳方法是什么(我们有文件夹名称信息 -folder99999)?

2。如果我们只是检查路径是否存在,如果不存在则意味着文件夹不存在。如果我们有数百万个文件夹,它可以正常工作吗?

3. gcp 使用哪种数据结构来检索文件夹数据?

For example I have structure like this.

bucketname/checked/folder1/some files
bucketname/checked/folder2/some files
bucketname/checked/folder3/some files
bucketname/checked/folder4/some files
bucketname/checked/folder5/some files
bucketname/checked/folder6/some files
bucketname/checked/folder7/some files
bucketname/checked/folder8/some files
bucketname/checked/folder9/some files
bucketname/checked/folder10/some files
bucketname/checked/folder11/some files
......
......

bucketname/checked/folder-1million/some files

Now,

1. If I have to check whether folder99999 exists or not. So,what would be the best way to check it (we have information of folder name - folder99999) ?

2. If we simply check path that exists or not, and if not then it means, folder don't exists. would it work fine If we have millions of folders?

3. Which data structure gcp uses to retrieve the folder data ?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

静谧 2025-01-21 05:46:51

真正的答案是约翰提供的:文件夹不存在。所有文件都存储在根目录(桶级别),文件名是完整路径。按照人类惯例,/ 是文件夹分隔符,控制台显示假文件夹。

如果“文件夹”中没有文件,则“文件夹”不存在,不会从名称完全限定路径解释/推导它。该文件夹不是云存储资源,

这也是您仅按路径前缀搜索的原因


,但这取决于您要检查的内容。如果您确切知道要检查和验证哪个文件夹,并且其中至少有一个文件,则可以直接 列出以文件夹路径为前缀的文件

The true answer is this one provided by John: folder doesn't exist. All the files are stored at the root directory (bucket level) and the file name is the full path. By human convention, the / is the folder separator and the console display fake folders.

If you haven't files in a "folder", the "folder" doesn't exist, it's not interpreted/deduced from the name fully qualified path. The folder is not a Cloud Storage resource

It's also for that reason that you search only by path prefix


However, it depends what you want to check. If you exactly know which folder you want to check and validate, and if there is at least one file in it, you can directly list the files with the folder path as prefix.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文