Changes between Version 12 and Version 13 of Workshops/JobCheckpointing
- Timestamp:
- 09/03/2026 11:35:20 AM (2 days ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Workshops/JobCheckpointing
v12 v13 17 17 == Pro's of job checkpointing == 18 18 19 * '''Checkpointed computations can run ''longer than cluster walltime limits''.''' See '''--qos=long''' in [wiki:cypress/about#SLURMresourcemanager SLURM (resource manager)]. 20 19 21 * '''Checkpointed jobs can get started sooner''' out of the job queue pending state with a reduced requested run time. (See "backfill scheduling" in [https://slurm.schedmd.com/sched_config.html|SLURM Scheduling Configuration Guide]. 20 22 * '''More checkpointed jobs can run simultaneously''' due to strict limits enforced by Cypress, LONI, and most other production clusters. 21 * See see'''--qos=normal''' in [wiki:cypress/about#SLURMresourcemanager SLURM (resource manager)].23 * See '''--qos=normal''' in [wiki:cypress/about#SLURMresourcemanager SLURM (resource manager)]. 22 24 * See also the command 23 25 * '''sacctmgr show qos format=Name,!MaxWall,!MaxNodesPerUser | grep -E "normal|long"''' 24 26 * '''Checkpointing mitigates the loss of resources and data due to either hardware failures or infinite looping jobs ''' - especially for otherwise long running parallel MPI jobs. 25 27 * '''Checkpointed jobs can handle frequent job pre-emption''' - especially for certain cloud-based job queues with high availability. 26 * '''Easier maintenance for HPC cluster managers''' - shorter maintenance periods waiting for nodes to become idle for servicing and reduced risk from less need for postponement ofupdates for security, hardware, and software.28 * '''Easier maintenance for HPC cluster managers''' - shorter maintenance periods waiting for nodes to become idle for servicing and reduced risk with quicker updates for security, hardware, and software. 27 29 28 30
