网格中计算节点上的虚拟内存
当我使用 PBS 在节点上运行作业时,我最终得到作业报告:
resources_used.mem=1616024kb
resources_used.vmem=2350176kb
resources_used.walltime=00:06:32
虚拟内存的真正含义是什么?我不认为每个节点都连接有硬盘。
当我尝试增加问题的大小时,我应该考虑哪种内存,以免达到节点内存的 16GB 容量、普通内存 (mem) 或虚拟内存 (vmem)? 谢谢
When I run a job on a node, using PBS, and I get finally in the job report:
resources_used.mem=1616024kb
resources_used.vmem=2350176kb
resources_used.walltime=00:06:32
What does the virtual memory really means? I don't think there is a hard drive connected to each node.
Which kind of memory should I take into account when I try to increase the size of the problem, such that I don't hit the 16GB capacity of the node memory, the normal memory (mem) or the virtual memory (vmem) ?
Thanks
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
vmem 指示您的作业总共使用了多少内存。它使用了所有可用的物理内存(请参阅 mem 值),等等。操作系统允许程序分配比可用物理内存更多的内存。
如果您主动使用的内存多于可用的物理内存,您将开始看到交换活动(换出到磁盘的数据被带回内存,其他内容被放入磁盘)。这很糟糕,如果这种情况发生很多次,它基本上会影响你的表现。
因此,只要您使用的内存不超过 16GB,就没有问题。但 mem 或 vmem 值不会告诉您这一点,这取决于应用程序实际在做什么。
The vmem indicates how much memory your job was using in total. It used all of the available physical memory (see the mem value), and more. An operating system allows programs to allocate more memory than there is physical memory available.
If you're actively using more memory than there is physical memory available, you'll start seeing swap activity (data that was swapped out to disk being brought back into memory, and other stuff being put to disk). That's bad, it will basically kill your performance if it happens a lot.
So, as long as you're not actively using more than 16GB, you're fine. But the mem or vmem values won't tell you this, it depends on what the application is actually doing.