单slurm数组与多个sbatch调用
我可以通过使用slurm数组来运行n令人尴尬地并行作业，例如：
#SBATCH --array=1-N
或通过手动启动8个工作。例如，使用带有循环的简单bash脚本。
由于后者更加灵活，因此我看不到使用slurm内置的阵列选项的实用程序。
我想念什么吗？
I can run N embarrassingly parallel jobs by using a slurm array like:
#SBATCH --array=1-N
Alternately I think I can achieve the same from a scheduling perspective (i.e. scheduled independently and as soon as resources become available) by manually launching 8 job. For example with a simply bash script with a loop.
Since the latter is far more flexible, I don't see the utility I using the --array option built into slurm.
Am I missing something?
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
数组提供了一种创建参数化作业的简单方法，而无需编写Bash循环。它
squequeue的输出更加杂乱，从整体上管理数组中的作业，
>squeue，scancel等。命令可以在整个数组上使用，而不是编写另一个循环以取消它们。在您同时运行多个阵列的情况下，这更有趣。您不需要自己管理每个工作的跟踪。最后，尤其是对于大型数组，它使调度程序变得更加容易，并且可以增加作业吞吐量。
如果您需要灵活性，则作业阵列不是解决方案，而是 workflow Manager < /a>可以帮助您。
Arrays offer a simple way to create parametrised jobs without writing the Bash loop. It
squeueless clutteredFurthermore, the jobs in an array can be managed as a whole, the
squeue,scancel, etc. command can work on the whole array as opposed to writing another loop to cancel them for instance. This is even more interesting in the case you have multiple arrays running at the same time ; you do not need to manage the tracking of each individual job by yourself.Finally, especially for large arrays, it makes the scheduler easier and can increase the job throughput.
If you need flexibility, then job arrays are not the solution, but maybe a workflow manager could help you.