任何支持恒定时间克隆的分布式文件系统
- lustre，或谷歌文件系统（GFS）将文件分割成某种块，并将它们保存到各个节点。因此他们可以实现可扩展性、分布式流量。
- ZFS、btrfs、wafl 支持恒定时间克隆。通过这种方式，他们可以实现克隆速度快、快照可写、节省存储空间。
我一直在创建支持上述两个功能的任何文件系统。
尽管有很多文件系统支持恒定时间克隆。但我找不到任何可以支持恒定时间克隆的分布式文件系统。 Lustre团队看起来正在开发支持zfs的lustre（也支持克隆）。但还没有透露（而且不包括2.0 beta，可能短时间内不会透露）。 Nexenta 存储似乎通过“命名空间 nfs”来支持这些功能。但事实并非如此。它只是通过文件级分发来分发文件。这意味着，如果某个文件超过一个节点的卷大小，它将无法处理它。如果大量克隆文件增长为大文件，它们将无法处理（至少，它们必须将原始文件真正复制（而不是影子节点）到其他节点。也许我可以将 SAN 磁盘附加到 ZFS 节点的 zvolume。但我非常担心 ZFS 节点的集中流量，
因此我正在寻找可以处理上述两个问题的文件系统或解决方案。
- lustre, or google file system(GFS) split a file into some kinds of block, and save them to various nodes. So they can acheive scalability, distributed traffic.
- ZFS, btrfs, wafl support constant time cloning. By this, they can achieve cloning speed, writable snapshot, saving storage size.
I have been founding any file system which support above two feature.
Though there are a lot file system which support constant time cloning. but I can't find any distributed file system which can support constant time cloning. Lustre team look like developing lustre supporting zfs(and also support cloning). but it revealed yet(moreover it doesn't include 2.0 beta, maybe it will not be revealed in short time).
Nexenta storage seemed like supporting these feature by "namespace nfs". but it wasn't. it just distribute file by file-level distribution. It means, if some file exceed size of volume of one node, it will not able to handle it. If a lot of cloned files grow to big file, they can't handle that(at least, they have to really copy(not shadowing nodes) original file to other node. maybe i can attach SAN disks to zvolume of a ZFS node. but I'm very worry about concentrated traffic of ZFS node.
so I'm looking for a file system or a solution which can handle above two issue.
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
一种可行的解决方案是将 Lustre 文件系统与备份模式下的 Robinhood 策略引擎结合起来，不断备份您的文件系统文件。此模式可以将 Lustre v2.x 文件系统备份到外部存储。它借助 Lustre 2+ 变更日志功能（FS 事件）跟踪文件系统中的修改，并根据管理员定义的迁移策略将修改后的文件复制到后端存储。您可以在 Robinhood 中配置自己的上行命令，例如提供一种可扩展的方式来克隆文件系统并在多个节点上安排同步任务。
通过 ZFS 上的 Lustre，应该可以使用 ZFS 快照功能，但即使是 ZFS 堆栈也尚未准备好用于生产（目前在 LLNL 的顶级 1 超级计算机 Sequoia 上进行测试）。
One working solution is to combine the Lustre filesystem with Robinhood Policy Engine in backup mode to constantly backup your filesystem files. This mode makes it possible to backup a Lustre v2.x filesystem to an external storage. It tracks modifications in the filesystem thanks to Lustre 2+ changelogs feature (FS events), and copy modified files to the backend storage, according to admin-defined migration policies. You can configure your own upcall commands in Robinhood, for example to provide a scalable way to clone your filesystem and schedule sync tasks on several nodes.
With Lustre on ZFS, it should be possible to use ZFS snapshot feature, but even the ZFS stack is not yet ready for production (currently tested on top 1 supercomputer Sequoia at LLNL).