如何使用“岩石”簇
我刚刚加入大学的一个研究实验室,并获得了访问集群的权限来编译和运行我编写的 C++ 代码。我使用 SSH 来访问它,并像 Linux 终端一样使用集群。
当我的代码运行时,我经常需要等待相对较长的时间。我正在尝试找出是否有更有效的方法来使用集群。例如,集群中有不同的CPU/节点,其中一些使用较多,另一些则使用较少。如何访问特定的CPU?我可以访问“Ganglia”概述页面,其中提供有关不同节点的信息。
另外,如果我在不同的 SSH 窗口中运行 2 个进程,它会自动使用不同的处理器或节点,还是必须手动指定。
我找不到任何文档来帮助我解决这些问题,所以我希望得到一些帮助。
谢谢
I've just joined a research lab at my University and been given access to a Cluster to compile and run the c++ code that I write. I use SSH to access it and simply use the cluster like a Linux terminal.
I often have to wait a relatively long time while my code runs. I'm trying to figure out if there's a more efficient way use the Cluster. For example, there are different CPUs/Nodes in the cluster, some of which are more in use and others less in use. How do I access a specific CPU? I have access to the "Ganglia" overview page which gives information about the different Nodes.
Also, if I run 2 processes in a different SSH windows will it automatically use different processors or nodes, or do I have to manually specify that.
I couldn't find any documentation to help me with these issues, so I'd appreciate a little help.
Thanks
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
仅仅在集群上运行某些东西并不意味着它根本就利用了集群。默认情况下,它可能只在头节点上运行。需要专门为集群编写软件。
您可能需要与之交互的某种调度程序正在运行。也许您还可以查看是否为您的特定集群安装并配置了 distcc(用于跨多台机器进行编译)。还可能有一种特殊风格的 MPI 运行,以允许不同节点上的进程进行通信。
集群软件设置往往非常专门针对硬件和计算环境。确实,我建议您在此类问题之前询问使用过该机器的人,因为您在这里收到的任何建议对于您的特定集群来说不太可能完全准确。
Simply running something on a cluster does not mean it is taking advantage of the cluster at all. By default, it will probably just run on the head node. Software needs to be written specifically for a cluster.
There is likely to be some kind of scheduler running that you need to interface with. Perhaps you could also see if distcc is installed and configured for your particular cluster (for doing the compilation across multiple machines). There may also be a particular flavour of MPI running to allow processes on different nodes to communicate.
Clusters software setups tend to be very specialised to the hardware and computing environment. Really, I would recommend that you ask someone who has used the machine before these kinds of questions, because any advice you receive here is unlikely to be completely accurate for your particular cluster.