Changes between Version 6 and Version 7 of Workshops/JobCheckpointing/Examples/BASH

Timestamp:

04/02/2026 08:19:31 PM (4 months ago)

Author:

Carl Baribault

Comment:

Added post-workflow analysis plots and explanationg

Workshops/JobCheckpointing/Examples/BASH

@@ -239 +239 @@
 ==== Anomaly stats, compute time and memory usage ====
 
-Here is the plot, anomaoly_stats_table.png, showing the table of anomalies in the use of compute time and memory.
+Here is the plot, '''anomaly_stats_table.png''', showing the table of anomalies, according to | Z | > 3.5 for execution time and modZ > 3.5 for '''MaxRSS''' (SLURM max job memory usage), where Z and modZ are as follows.
+
+{{{
+Z = (value - mean) / (standard deviation)
+modZ = 0.6745 * | x - median | / (Median Absolute Deviation)
+}}}
+
 
 [[Image(anomaly_stats_table.png)]]
@@ -245 +251 @@
 ==== Compute progress ====
 
-Here is the plot, anomaoly_stats_table.png, showing '''Checkpoint Progress''' and SLURM memory usage, '''MaxRSS'''.
+Here is the plot, '''progress_with_anomalies.png''', showing '''Checkpoint Progress''' and '''MaxRSS''' (SLURM max job memory usage) vs '''Wall Time'''. Anomalies, if any, would be overplotted in red.
+
+[[Image(progress_with_anomalies.png, width=800px)]]
 
 ==== Resource trend ====
 
-Here is the plot, resource_trend.png, showing '''Elapsed (time)''' and SLURM memory usage, '''MaxRSS'''.
+Here is the plot, '''resource_trend.png''', showing '''Elapsed (time)''' and '''MaxRSS''' vs. '''Worker job index'''.
+
+[[Image(resource_trend.png, width=800px)]]