Changeset 1d9998c in sasmodels for example/slurm_batch.py

Timestamp:

Jul 19, 2018 12:41:44 PM (6 years ago)

Author:

Paul Kienzle <pkienzle@…>

Branches:

master, core_shell_microgels, magnetic_model, ticket-1257-vesicle-product, ticket_1156, ticket_1265_superball, ticket_822_more_unit_tests

Children:

f64b154, 012cd34, 63602b1, 1a8b91c

Parents:

58a34f1

Message:

update docs for the slurm batch program

File:

• example/slurm_batch.py (modified) (4 diffs)

example/slurm_batch.py

@@ -6 +6 @@
 file, with the data file specified as a command line argument, run the
 bumps fit as a batch over a set of different datafiles independently.
-An example model is given in example/model_ellipsoid_hayter_msa.py,
-which fits the data in example/09319*.dat.
-
-To run the fit, use:
+An example model is given in model_ellipsoid_hayter_msa.py, which fits 
+the data in 09319*.dat.
+
+To run the fit, use::
 
     slurm_batch.py [--slurm_opts] model.py *.dat --store=T1 [--bumps_opt ...]
+
+For example::
+
+    slurm_batch.py model_ellipsoid_hayter_msa.py 09319*.dat --store=T1
 
 This creates the T1 subdirectory to hold the fit results and 
@@ -20 +24 @@
 in T1/##/*.  The file T1/files.dat contains the list 
 of "subdirectory filename" pairs indicating which ## directory 
-contains the resuls for which file.  Check for errors using
+contains the resuls for which file.  Check for errors using::
 
     cat T1/slurm*_1.out
 
-Bumps options are described at bumps.readthedocs.org, with
-running time (--time=T) defaulting to 2 hours maximum.  The
-following slurm options are used::
+The following slurm options are used::
 
     --array=1-#files     batch size comes from the file list
@@ -33 +35 @@
     --output=...         log into T1/slurm-job_##.out
     --chdir=...          run fit from store directory
+    --time=2             time as number of hours (can override)
 
 To receive an email on job completion or failure, add the following
@@ -38 +41 @@
 
     --mail-type=END,FAIL --mail-user=user@mail.domain
+
+Bumps options are described at bumps.readthedocs.org, with the
+following set automatically::
+
+    --batch              run in batch mode, without output to .mon
+    --view=log           SAS fits want log plots
+    --time=2-0.1         slurm time minus 6 minutes for cleanup
+
+The --store and --resume options indicate the parent directory for
+the output.  These are modified to store the results in a separate
+subdirectory for each file.  Keep in mind that the fit is run from
+the store directory, so any files or modules referenced from the
+model file will need to use a full path to the original location.
 
 After submitting the job a job id will be printed to the console.