有集群可供出租吗?
我想知道是否有集群可供出租。
场景:
我们有一个程序,预计需要一周时间才能对给定文件运行(优化后)。 很有可能,更长。 不幸的是,我们还需要处理大约 300 多个不同的文件,导致大约 300
周的计算时间(可舍入到连续运行作业的 6 个挂钟年)。 对于最晚应该在 12 月之前完成的研究工作来说,这是完全不可接受的。 在我们探索其他选择的同时,我正在研究简单租用 Beowulf 集群的选择。 这项工作是学术性的,将有助于完成博士学位。
理想的情况是,我们将源文件和作业文件发送给该公司,然后在一两周后收到结果文件。 瞧!
快速谷歌搜索并没有发现任何非常有希望的东西。
建议的解决方案?
I am wondering if there are clusters available to rent.
Scenario:
We have a program that will take what we estimate a week to run(after optimization) on a given file. Quite possibly, longer. Unfortunately, we also need to do approximately 300+ different files, resulting in approximately 300
weeks of compute time(roundable to 6 wallclock years of continuously running job). For a research job that should be done - at the latest - by December, that's simply unacceptable. While we are exploring other options, I am investigating the option of simply renting a Beowulf cluster. The job is academic and will lead towards the completion of a PhD.
What would be ideal would be a company that we send the source and the job files to the company and then receive a week or two later the result files. Voila!
Quick googling doesn't turn up anything terribly promising.
Suggested Solutions?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(10)
云计算听起来正是您所需要的。 亚马逊、微软和谷歌以按使用量付费的方式租用计算机资源。
亚马逊的服务是最成熟的,关于亚马逊的服务已经有几个问题,EG 此处和此处。
Cloud computing sounds like what you need. Amazon, Microsoft and Google rent computer resources on a pay for what you use basis.
Amazon's service is the most mature, and there are several questions already about Amazon's service, EG here and here.
Amazon EC2(弹性计算云)听起来正是您正在寻找的东西。 您可以注册一台或多台虚拟机(最多自动注册 20 台,如果您 则可以注册更多虚拟机)请求权限),每台虚拟机每小时 0.10 美元起,另加带宽费用(EC 2 计算机和 Amazon 的 之间免费)其他网络服务)。 您可以在多种操作系统(各种 Linux 发行版、OpenSolaris、Windows(如果您额外付费)之间进行选择),并且可以使用预先存在的计算机映像或创建自己的计算机映像。 如果您使用所有开源软件并且没有太多带宽成本,那么听起来运行您的作业将花费大约 5000 美元(假设您 6 年的计算时间与它们的小型实例相当,使用单个虚拟 CPU)。
一旦您注册该服务并设置他们的工具,一切就非常简单启动新的虚拟机。 我什至花了 0.10 美元启动一台机器几分钟,只是为了验证我在 StackOverflow 上给某人的答案; 我想检查 Solaris 上的某些内容,因此我只需启动一个实例,并在 5 分钟内就拥有了一个可供我使用的 Solaris 虚拟机。
Amazon EC2 (Elastic Compute Cloud) sounds like exactly what you're looking for. You can sign up for one or more virtual machines (up to 20 automatically, more if you request permission), starting at $0.10 an hour per VM, plus bandwidth costs (free between EC 2 machines and Amazon's other web services). You can choose between several operating systems (various Linux distributions, OpenSolaris, Windows if you pay extra), and you can use pre-existing machine images or create your own. If you're using all open-source software and don't have much bandwidth costs, it sounds like it would cost you around $5000 to run your job (assuming that your 6 years of compute time was for something comparable to their small instances, with a single virtual CPU).
Once you sign up for the service and get their tools set up, it's pretty easy to get new virtual machines launched. I've even spent the $0.10 to launch a machine for a few minutes just to verify an answer I was giving someone here on StackOverflow; I wanted to check something on Solaris, so I just booted up an instance and had a Solaris VM at my disposal within 5 minutes.
我不知道你在哪里读博士……大多数亚洲、欧洲和北美的大学都有一些集群。 您可以
另外,经典的技巧是利用实验室/大学计算机的未使用时间......基本上,每台计算机都运行一个客户端应用程序,在计算机不使用时处理数字。 请参阅http://boinc.berkeley.edu/
I don't know where are you doing your PhD... Most of the Asian, European, and North American universities have some clusters. You can
Also, the classical trick is to use the unused time of the computers of your lab/university... Basically, each computer run a client application that crunch numbers when the computer is not used. See http://boinc.berkeley.edu/
这个线索可能会有所帮助:
http://lcic.org/vendors.html
这是一个很棒的有关此事的资源网站:
http://www.hpcwire.com
This lead may prove helpful:
http://lcic.org/vendors.html
And this is a fantastic resource site on the matter:
http://www.hpcwire.com
该线程充满了指向 Amazon EC2 的指针 - 确实如此。 他们是这个领域最成熟的。 最近,他们发布了弹性映射缩减平台,听起来与您想要做的类似(尽管不完全一样)。 Google 不适合您,因为他们的计算模型不支持您需要的通用计算模型。
The thread has been replete with pointers to Amazon's EC2 - and correctly so. They are the most mature in this area. Recently, they've released their elastic map-reduce platform which sound similar (although not exactly) like what you are trying to do. Google is not an option for you as their compute model doesn't support the generic compute model you need.
对于学术/科学用途,有几个公共中心提供 HPC 功能。 在欧洲,有DEISA。 http://www.deisa.eu/ 和 DEISA 成员。 美国肯定也有类似的可能性,可能是通过 NSF。
对于商业用途,请查看 IBM DeepComputing On Demand 产品。
http://www-03.ibm.com/systems/deepcomputing/cod/< /a>
For academic/scientific use, there are several public centers offering HPC capability. In Europe, there is DEISA. http://www.deisa.eu/ and DEISA members. There must be similar possibilities in the US, probably thru the NSF.
For commercial use, check IBM Deep Computing On Demand offerings.
http://www-03.ibm.com/systems/deepcomputing/cod/
有多种方法可以获取集群时间。
There are several ways to get time on clusters.
或者您可以从私人提供商处租用 CPU 时间。
我来自斯洛文尼亚,例如,我们这里有一家很棒的私人提供商,名为 Arctur。 当我联系他们时,他们非常乐于助人并且反应灵敏。
您可以在这里找到它们:hpc.arctur.net
Or you could rent CPU time from a private provider.
I'm from Slovenia and, for example, here we have a great private provider called Arctur. The guys were helpful and and responsive when I contacted them.
You can find them here: hpc.arctur.net
一种选择是租用与您需要的任意数量的 PC 相当的虚拟资源,并使用 亚马逊弹性计算云。
建立一个贝奥武夫集群是完全可能的。
请查看此链接,其中提供了实现此目的的资源和软件。
One option is to rent the virtual resources equivalent of whatever number of PCs you need, and set them up as a cluster, using the Amazon Elastic Compute Cloud.
Setting up a beowulf cluster of those is entirely possible.
Check out this link which provides resources and software to do exactly that.
转到:http://www.extremefactory.com/index.php
真正的 HPC 集群,高达 200 TFlops。
Go to : http://www.extremefactory.com/index.php
True HPC cluster, up to 200 TFlops.