“初学者” 分布式处理项目
很长一段时间以来,我一直对构建异构节点集群感兴趣,试图拥有一台家用超级计算机,因为我对人工智能研究非常感兴趣。
然而,问题是,即使我有无数的硬件(2x 双四机架安装服务器、8 285GTX Gpus、6x PS3、2x Hacked 360(它们可以运行 Linux),可以访问大量普通 PC 以及一些工作站)我没有需要处理的大型数据集,甚至没有任何可以分布式运行的软件。 我搞乱了分布式代码编译,但充其量它使我的内核构建时间从 10 分钟(最坏的情况)缩短到 30 秒(我认为其中 20 秒只是设置)。
那么我应该从哪里开始呢? 我对 Obj-C/C/C++ 有相当的了解,所以写一些东西应该不会太难,但是我应该写什么呢?
For the longest time I've been interested in building a cluster of heterogeneous nodes in an attempt to have a home supercomputer since I am very interested in doing AI research.
However, the issue is even though I have a myriad of hardware, (2x dual quad rack mount servers, 8 285GTX Gpus, 6x PS3s 2x Hacked 360s (they can run linux) access to tonnes of common PCs as well as a few workstations) I have no large data set that needs to be crunched, or even any software that I can run distributed. I have messed with distributed code compiling but at best its made my kernel builds go from 10 minutes (at worst) to 30 seconds (and I think 20 of those seconds are just setup).
So where should I start? I have a decent understating of Obj-C/C/C++ so it shouldn't be too hard to write something, but what should I write?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(3)
如果您想要处理数据,这里有很多数据:
至于“我应该构建什么”,真正的问题是,您对什么感兴趣?
If you want data to crunch, there's plenty out there:
As for "what should I build", the real question is, what interests you?
嗯,我认为最好确定您将为其开发应用程序的可用硬件子集。 PS3 的软件需要特别注意,并且需要与在典型 Linux 服务器上运行的软件分开开发。
您可能还需要研究如何为 360 开发应用程序; 老实说,我不确定它是否真的能给您带来您想要的东西。
一旦您决定了需要开发的硬件子集,最好从一些基本开发开始,以确保您可以构建一个能够实现通信的基础。 有了坚实的基础,您将能够扩展代码以支持各种分布式项目。
我希望我正确理解你的问题!
干杯
Well I think it's best to determine which subset of the hardware you have available you'll be developing your application for. Software for the PS3 needs special attention and will require separate development from something built to run on typical linux servers.
You may also need to do some research on how you could develop an application for the 360; I'm not sure if it'd really give you what you're looking for to be honest.
Once you've decided on the subset of hardware you need to develop for it would be good to start with some basic development to ensure you can a foundation put together which enables communication. With a solid foundation you'll be able to expand your code to support a variety of distributed projects.
I hope I'm understanding your question correctly!
Cheers
如果你真的很喜欢冒险,你可以尝试移植其中一个/两者 Sprite (Unix-y) 或/和
If you are really adventurous you could try porting either/both Sprite (Unix-y) or/and Plan 9 (just plain weird) to each of the flavours of hardware you have (Plan 9 already runs on PCs).