Changes between Version 53 and Version 54 of cypress/using

Timestamp:

08/21/18 12:20:08 (6 years ago)

Author:

fuji

Comment:

—

cypress/using

@@ -303 +303 @@
 With ALL, you will get emails at any state change.
 
+== Running Manny Serial Jobs ==
+
+If you are running a large number of serial jobs, it is recommended to submit them as a '''job array''' to make the best use of your allocated resources.  For example, suppose you are running 100 serial jobs using scripts located in a "scripts" folder, each of which does a serial calculation:  scripts/run1.sh, scripts/run2.sh, ..., scripts/run100.sh.  You would create an sbatch script named "run100scripts.srun" with contents:
+
+{{{
+#!/bin/bash 
+#SBATCH -J array_example
+#SBATCH --array=0-4
+#SBATCH -N 1
+#SBATCH -n 20
+#SBATCH --time=01:00:00
+
+srun ./runscript.sh
+}}}
+
+The contents of the script "runscript.sh" would be:
+
+{{{
+#!/bin/bash
+
+RUNNUMBER=$((SLURM_ARRAY_TASK_ID*SLURM_NTASKS + SLURM_PROCID + 1))
+./scripts/run$RUNNUMBER.sh
+}}}
+
+Make sure your scripts have executable permissions.  Then, submitting with:
+
+{{{
+sbatch run100scripts.srun
+}}}
+
+will run the 100 scripts as a 5 job array, with 20 tasks each.
+
+
 == Submitting Interactive Jobs ==