如何处理 TB 级数据的异地备份?
我有数 TB 的文件和数据库转储,需要进行异地备份。
实现这一目标的最佳方法是什么?
我目前正在权衡 rsyinc 到 Amazon EBS 或获取设备(例如 barracuda)。
我打电话给我的一个朋友,他说他使用 backula 将所有文件保存在一个磁盘上,然后将该磁盘备份到磁带上,然后将磁带发送到 Iron Mountain。
仍在等待我联系过的其他系统管理员的回复。 将在这里发布结果。
I have terabytes of files and database dumps that I need to backup off-site.
What's the best way to accomplish this?
I'm currently weighing rsyinc to Amazon EBS or getting an appliance (eg barracuda).
I called a buddy of mine, and he said he uses backula to get all the files on a single disk, then backs that disk up to tape, then sends the tapes off to iron mountain.
Still waiting to hear back from other sysadmins I've contacted. Will post results here.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(8)
值得考虑的一种常见异地备份解决方案是在现场执行备份,然后通过安全的普通邮件或为此目的设计的服务将备份物理传输到其他地方。 如果带宽是一个问题,这可能更实用。
One common solution to offsite backups that is worth considering is performing the backup onsite and then physically transporting the backup elsewhere, either via secure snail mail or with a service designed for that purpose. If bandwidth is an issue, this may be more practical.
我不使用磁带,而是使用硬盘驱动器,每周都会更换硬盘驱动器。 它比磁带设备便宜,并且在必要时更容易插入另一个系统。
Instead of tapes, I use hard drives that I physically swap out every week. It is less expensive than tape equipment, and easier to plug into another system when necessary.
早在 80 年代末,我工作的地方每周一都会收到一盒各种类型的磁带 - 我们会每周对该盒上的磁带进行一组备份,然后将它们发送到异地。 显然他们有两个这样的盒子,一个在我们办公室,另一个他们锁在某个地方。 然后我们得到了一个 Exabyte 驱动器,它的单盘磁带容量比整盒 TK-50、QIC-40 和磁带还要大,每周与一位经理一起寄一盘磁带回家就更简单了。
我确信仍然存在这样的异地备份系统,但我发现将几个 500Gb 驱动器从我的家庭系统循环到我的工作办公桌更容易。
Back in the late 80s I worked at a place where every week we received a box of tapes of various sorts every monday - we would do one set of weekly backups on the tapes on that box and send them off-site. Evidently they had two of these boxes, one that was in our office and the other they kept locked up somewhere. Then we got an Exabyte drive which had a single tape capacity greater than that whole box of TK-50s, QIC-40s and mag tapes, and it was just simpler to send a single tape home with one of the manager every week.
I'm sure there are still off-site backup systems like that, but I find it easier to keep cycling a couple of 500Gb drives from my home system to my desk at work.
为什么不加密它并实际上传到第三方供应商?
我正在考虑在家中对我的数据执行此操作,但还没有找到一个供应商可以让我进行转储...他们都想安装客户端应用程序...
不可否认,我并没有那么努力...
Why not encrpyt it and actually upload to a third party vendor?
I am thinking of doing this with my data at home but have not found a vendor that will just let me do a dump...They all want to install client side apps...
Admittedly, I have not looked that hard...
我们使用几种解决方案。 我们与另一家公司有异地备份。 我们还使用多个便携式硬盘并每天更换它们。 这两种解决方案都无法真正处理数 TB 的数据。 更像是千兆字节。
然而,在未来,我们可能会考虑使用磁带路由器,或者其他类似的永久性和可存储的东西。 数 TB 的数据对于通过网络传输来说太大了。 当蓝光光盘的价格变得合理并具有商业可行性时,研究一下不久前吹捧的 400GB 光盘可能是个好主意。 这些将非常适合存储(无论是在物理意义上还是在文件大小意义上),并且根据寿命统计数据,可能会保留一段时间,类似于磁带。
We use a couple of solutions. We have an offsite backup with another company that we do. We also use several portable hard drives and swap them out each day. Neither solution really handles multiple terabytes of data. More like gigabytes.
In the future, however, we will probably be looking at going the tape router, or something else that is similarly permanent and storable. Terabytes of data is too much to transfer over the wire. When bluray discs become reasonably priced and commercially viable, it may be a good idea to look into the 400GB discs that were touted not long ago. Those would be extremely storage friendly (both in the physical sense and the file size sense), and depending on the longevity stats, may keep for a while, similar to tapes.
我建议使用 EMC 等公司的本地 SAN,该公司提供基于压缩快照的复制到远程设施。 这是一个昂贵的解决方案,但它确实有效。
http://www.emc.com/products/family/emc- centera-family.htm
I would recommend using a local san from a company like EMC that provides compressed snapshot based replication to remote facilities. It's an expensive solution, but it works.
http://www.emc.com/products/family/emc-centera-family.htm
周末,我收到了几个系统管理员朋友的回复。
看来最好的做法是将所有机器备份到一个中央大磁盘,然后将该磁盘备份到磁带,然后将磁带发送到异地(所有机器都使用了 Iron Mountain)。
磁带容量为 400-800G,每盘成本为 30-80 美元。
磁带更换器的价格似乎高达 1 万美元。
不知道异地运输费用是多少。
Over the weekend, I've heard back from a couple of my sysadmin buddies.
It seems the best practice is to backup all machines to a central large disk, then back that disk up to tape, then send the tapes off site (all have used Iron Mountain).
Tapes hold 400-800G and cost $30-$80 per tape.
A tape changer seems to go for $10k on up.
Not sure how much the off-site shipping costs.
我害怕磁带。 我认为这给人一种数据安全的错误感觉。 根据我自己在数百个磁带上备份数十 TB 的经验,我们发现几年后数据恢复率下降到 70% 左右。
公平地说,这是使用现已停产的技术 (AIT),但它几乎让我终生不再使用磁带,除非它位于 1 英寸线轴上并且价格令人放心。
如今,多个硬盘驱动器、多个位置,是的,回退到 Amazon S3 或其他云提供商并没有什么坏处(除了有点贵)。
I'm scared of tape. I think it gives a false sense of data security. In my own experience from backing up dozens of terrabytes across hundreds of tapes, we discovered that the data recovery rate after a few years fell to about 70%.
To be fair, that was with a now discontinued technology (AIT), but it pretty much put me off tape for life unless it sits on a 1" spool and is reassuringly expensive.
These days, multiple hard drives, multiple locations, and yes, a fall back into Amazon S3 or other cloud provider does no harm (apart from being a tad expensive).