Have a Question?
Job Scheduler (SLURM)
Job Scheduler (SLURM)
How to Use Slurm to Submit and Manage Jobs on the Advanced Research Computing Cluster (ARCC)
The ARC Cluster uses the Slurm Workload Manager to coordinate resource management and job scheduling. This ensures that the resources are allocated to all the user requests in an optimized manner. This guide is for the users of the arcc cluster, which runs the job scheduler Slurm. Slurm is an advanced open-source scheduler used on many of the most powerful computers in the world. It features good support for cluster resources with a large number of CPUs.
The slurm scheduler allows the user to request a computer node (or nodes with the respective resources) to run their jobs. The scheduler also provides a framework which can be used to start, cancel, monitor or edit their submitted jobs. The scheduler keeps track of everyone and all the jobs to ensure that everyone can use all the requested resources without stepping on someone’s toe.
The scheduler works by first running jobs which require less resources. This means, the more resources (nodes, cores, memory, wall time) you request, the chances are the more time the scheduler is going to queue your job. The scheduler makes the allocation based on what you request, not by what you need. Requesting the right resources will help you avoid unnecessary queue time.
Fairshare is an algorithm which prioritizes the jobs from certain users. If A has a higher fairshare factor than B, all children of A will have higher fairshare factors than all children of B. Some benifits of fairshare are as follows
- All users from a higher priority account receive a higher fair share factor than all users from a lower priority account.
- Users are sorted and ranked to prevent errors due to precision loss.
- Account coordinators cannot accidentally harm the priority of their users relative to users in other accounts.
- Users are extremely unlikely to have exactly the same fairshare factor as another user due to loss of precision in calculations.
- New jobs are immediately assigned a priority.