有集群可供出租吗?

发布于 2024-07-17 15:27:25 字数 373 浏览 7 评论 0原文

我想知道是否有集群可供出租。

场景:

我们有一个程序,预计需要一周时间才能对给定文件运行(优化后)。 很有可能,更长。 不幸的是,我们还需要处理大约 300 多个不同的文件,导致大约 300 周的计算时间(可舍入到连续运行作业的 6 个挂钟年)。 对于最晚应该在 12 月之前完成的研究工作来说,这是完全不可接受的。 在我们探索其他选择的同时,我正在研究简单租用 Beowulf 集群的选择。 这项工作是学术性的,将有助于完成博士学位。

理想的情况是,我们将源文件和作业文件发送给该公司,然后在一两周后收到结果文件。 瞧!

快速谷歌搜索并没有发现任何非常有希望的东西。

建议的解决方案?

I am wondering if there are clusters available to rent.

Scenario:

We have a program that will take what we estimate a week to run(after optimization) on a given file. Quite possibly, longer. Unfortunately, we also need to do approximately 300+ different files, resulting in approximately 300 weeks of compute time(roundable to 6 wallclock years of continuously running job). For a research job that should be done - at the latest - by December, that's simply unacceptable. While we are exploring other options, I am investigating the option of simply renting a Beowulf cluster. The job is academic and will lead towards the completion of a PhD.

What would be ideal would be a company that we send the source and the job files to the company and then receive a week or two later the result files. Voila!

Quick googling doesn't turn up anything terribly promising.

Suggested Solutions?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(10

黄昏下泛黄的笔记 2024-07-24 15:27:25

云计算听起来正是您所需要的。 亚马逊、微软和谷歌以按使用量付费的方式租用计算机资源。

亚马逊的服务是最成熟的,关于亚马逊的服务已经有几个问题,EG 此处此处

Cloud computing sounds like what you need. Amazon, Microsoft and Google rent computer resources on a pay for what you use basis.

Amazon's service is the most mature, and there are several questions already about Amazon's service, EG here and here.

隔岸观火 2024-07-24 15:27:25

Amazon EC2(弹性计算云)听起来正是您正在寻找的东西。 您可以注册一台或多台虚拟机(最多自动注册 20 台,如果您 则可以注册更多虚拟机)请求权限),每台虚拟机每小时 0.10 美元起,另加带宽费用(EC 2 计算机和 Amazon 的 之间免费)其他网络服务)。 您可以在多种操作系统(各种 Linux 发行版、OpenSolaris、Windows(如果您额外付费)之间进行选择),并且可以使用预先存在的计算机映像或创建自己的计算机映像。 如果您使用所有开源软件并且没有太多带宽成本,那么听起来运行您的作业将花费大约 5000 美元(假设您 6 年的计算时间与它们的小型实例相当,使用单个虚拟 CPU)。

一旦您注册该服务并设置他们的工具,一切就非常简单启动新的虚拟机。 我什至花了 0.10 美元启动一台机器几分钟,只是为了验证我在 StackOverflow 上给某人的答案; 我想检查 Solaris 上的某些内容,因此我只需启动一个实例,并在 5 分钟内就拥有了一个可供我使用的 Solaris 虚拟机。

Amazon EC2 (Elastic Compute Cloud) sounds like exactly what you're looking for. You can sign up for one or more virtual machines (up to 20 automatically, more if you request permission), starting at $0.10 an hour per VM, plus bandwidth costs (free between EC 2 machines and Amazon's other web services). You can choose between several operating systems (various Linux distributions, OpenSolaris, Windows if you pay extra), and you can use pre-existing machine images or create your own. If you're using all open-source software and don't have much bandwidth costs, it sounds like it would cost you around $5000 to run your job (assuming that your 6 years of compute time was for something comparable to their small instances, with a single virtual CPU).

Once you sign up for the service and get their tools set up, it's pretty easy to get new virtual machines launched. I've even spent the $0.10 to launch a machine for a few minutes just to verify an answer I was giving someone here on StackOverflow; I wanted to check something on Solaris, so I just booted up an instance and had a Solaris VM at my disposal within 5 minutes.

醉城メ夜风 2024-07-24 15:27:25

我不知道你在哪里读博士……大多数亚洲、欧洲和北美的大学都有一些集群。 您可以

  • 直接与实验室负责集群的人员见面。
  • 请你的博士生导师来安排。 也许他/她有一些朋友可以处理这个问题。

另外,经典的技巧是利用实验室/大学计算机的未使用时间......基本上,每台计算机都运行一个客户端应用程序,在计算机不使用时处理数字。 请参阅http://boinc.berkeley.edu/

I don't know where are you doing your PhD... Most of the Asian, European, and North American universities have some clusters. You can

  • meet directly the people at the lab which is in charge of the cluster.
  • ask your PhD director to arrange that. Maybe he/she have some friends that can handle that.

Also, the classical trick is to use the unused time of the computers of your lab/university... Basically, each computer run a client application that crunch numbers when the computer is not used. See http://boinc.berkeley.edu/

风轻花落早 2024-07-24 15:27:25

这个线索可能会有所帮助:

http://lcic.org/vendors.html

这是一个很棒的有关此事的资源网站:

http://www.hpcwire.com

This lead may prove helpful:

http://lcic.org/vendors.html

And this is a fantastic resource site on the matter:

http://www.hpcwire.com

浅笑轻吟梦一曲 2024-07-24 15:27:25

该线程充满了指向 Amazon EC2 的指针 - 确实如此。 他们是这个领域最成熟的。 最近,他们发布了弹性映射缩减平台,听起来与您想要做的类似(尽管不完全一样)。 Google 不适合您,因为他们的计算模型不支持您需要的通用计算模型。

The thread has been replete with pointers to Amazon's EC2 - and correctly so. They are the most mature in this area. Recently, they've released their elastic map-reduce platform which sound similar (although not exactly) like what you are trying to do. Google is not an option for you as their compute model doesn't support the generic compute model you need.

£噩梦荏苒 2024-07-24 15:27:25
堇年纸鸢 2024-07-24 15:27:25

有多种方法可以获取集群时间。

  1. 在亚马逊弹性云上购买的时间。 根据您对他们的服务的熟悉程度,可能需要一些时间才能按照您想要的方式配置它。
  2. 联系一所大学,看看他们是否有商业项目可以将时间出租给公司。 我知道有几个这样做。 我特别了解的一个项目是伊利诺伊大学香槟分校 (UIUC) NCSA 的私营部门项目。 根据机构的不同,他们还为您的代码提供移植和优化服务。

There are several ways to get time on clusters.

  1. Purchase time on Amazon elastic cloud. Depending on how familiar you are with their service, it may take time to get it configured the way you want it.
  2. Approach a university and see if they have a commercial program to rent out the time to companies. I know several do. One that I know of specifically is private sector program at NCSA at UIUC. Depending on the institution, they also offer porting and optimization service for your code.
凶凌 2024-07-24 15:27:25

或者您可以从私人提供商处租用 CPU 时间。
我来自斯洛文尼亚,例如,我们这里有一家很棒的私人提供商,名为 Arctur。 当我联系他们时,他们非常乐于助人并且反应灵敏。

您可以在这里找到它们:hpc.arctur.net

Or you could rent CPU time from a private provider.
I'm from Slovenia and, for example, here we have a great private provider called Arctur. The guys were helpful and and responsive when I contacted them.

You can find them here: hpc.arctur.net

我偏爱纯白色 2024-07-24 15:27:25

一种选择是租用与您需要的任意数量的 PC 相当的虚拟资源,并使用 亚马逊弹性计算云

建立一个贝奥武夫集群是完全可能的。

请查看此链接,其中提供了实现此目的的资源和软件。

One option is to rent the virtual resources equivalent of whatever number of PCs you need, and set them up as a cluster, using the Amazon Elastic Compute Cloud.

Setting up a beowulf cluster of those is entirely possible.

Check out this link which provides resources and software to do exactly that.

知你几分 2024-07-24 15:27:25

转到:http://www.extremefactory.com/index.php
真正的 HPC 集群,高达 200 TFlops。

Go to : http://www.extremefactory.com/index.php
True HPC cluster, up to 200 TFlops.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文