如何从 100 万个文件夹中检查 GCP 云存储中是否存在某个文件夹
例如我有这样的结构。
bucketname/checked/folder1/some files
bucketname/checked/folder2/some files
bucketname/checked/folder3/some files
bucketname/checked/folder4/some files
bucketname/checked/folder5/some files
bucketname/checked/folder6/some files
bucketname/checked/folder7/some files
bucketname/checked/folder8/some files
bucketname/checked/folder9/some files
bucketname/checked/folder10/some files
bucketname/checked/folder11/some files
......
......
bucketname/checked/folder-1million/some files
现在,
1。如果我必须检查folder99999是否存在。那么,检查它的最佳方法是什么(我们有文件夹名称信息 -folder99999)?
2。如果我们只是检查路径是否存在,如果不存在则意味着文件夹不存在。如果我们有数百万个文件夹,它可以正常工作吗?
3. gcp 使用哪种数据结构来检索文件夹数据?
For example I have structure like this.
bucketname/checked/folder1/some files
bucketname/checked/folder2/some files
bucketname/checked/folder3/some files
bucketname/checked/folder4/some files
bucketname/checked/folder5/some files
bucketname/checked/folder6/some files
bucketname/checked/folder7/some files
bucketname/checked/folder8/some files
bucketname/checked/folder9/some files
bucketname/checked/folder10/some files
bucketname/checked/folder11/some files
......
......
bucketname/checked/folder-1million/some files
Now,
1. If I have to check whether folder99999 exists or not. So,what would be the best way to check it (we have information of folder name - folder99999) ?
2. If we simply check path that exists or not, and if not then it means, folder don't exists. would it work fine If we have millions of folders?
3. Which data structure gcp uses to retrieve the folder data ?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
真正的答案是约翰提供的:文件夹不存在。所有文件都存储在根目录(桶级别),文件名是完整路径。按照人类惯例,
/
是文件夹分隔符,控制台显示假文件夹。如果“文件夹”中没有文件,则“文件夹”不存在,不会从名称完全限定路径解释/推导它。该文件夹不是云存储资源,
这也是您仅按路径前缀搜索的原因
,但这取决于您要检查的内容。如果您确切知道要检查和验证哪个文件夹,并且其中至少有一个文件,则可以直接 列出以文件夹路径为前缀的文件。
The true answer is this one provided by John: folder doesn't exist. All the files are stored at the root directory (bucket level) and the file name is the full path. By human convention, the
/
is the folder separator and the console display fake folders.If you haven't files in a "folder", the "folder" doesn't exist, it's not interpreted/deduced from the name fully qualified path. The folder is not a Cloud Storage resource
It's also for that reason that you search only by path prefix
However, it depends what you want to check. If you exactly know which folder you want to check and validate, and if there is at least one file in it, you can directly list the files with the folder path as prefix.