Changes between Version 6 and Version 7 of cypress/GlobusInBarchJob


Ignore:
Timestamp:
09/21/2026 09:10:03 AM (4 hours ago)
Author:
fuji
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • cypress/GlobusInBarchJob

    v6 v7  
    11= Example Pipeline for Data Transfer Using Globus and Computation in Batch Jobs =
    2 Here we consider a pipeline to do the following processes.
     2Here we consider a pipeline to perform the following processes.
    331. Transfer data files from Box to the Cypress Lustre directory.
    442. Perform computation using the data.
     
    4444For each transfer, the user must set whether to keep or delete the source directory. (see below)
    4545
    46 Note that the directory on Cypress must be set with write-access by '''~/.globusonline/lta/config-paths'''.
     46Note that the directory on Cypress must be set with write access by '''~/.globusonline/lta/config-paths'''.
    4747
    4848=== Data Transfer Script ===
     
    9999else
    100100    SOURCE_EP=$MY_UUID:$CYPRESS_WORK_DIR
    101     DEST_EP=$TULANE_BOX:$BOX_DATA_DIR   
     101    DEST_EP=$TULANE_BOX:$BOX_RESULT_DIR   
    102102fi
    103103
    104 # Check logged in to Globus
     104# Check if logged in to Globus
    105105output=$(globus whoami >/dev/null 2>&1)
    106106output_code=$?
     
    114114output_code=$?
    115115if [ $output_code -ne 0 ]; then
    116     echo "ERROR!  The transfer of data in could not be started."
     116    echo "ERROR!  The transfer of data could not be started."
    117117    globusconnect -stop
    118118    exit 1
    119119fi
    120120
    121 # wait util the task done.
     121# wait until the task is done.
    122122output=$(globus task wait $task_id)
    123123output_code=$?
    124124if [ $output_code -ne 0 ]; then
    125     echo "ERROR!  The transfer of data was failed."
     125    echo "ERROR!  The transfer of data failed."
    126126    globus task cancel $task_id
    127127    globusconnect -stop
     
    171171exit 0
    172172}}}
    173 This is the main computing script, which the user has to edit. It doesn't have to use CentOS7 nodes.
     173This is the main computing script the user must edit. It doesn't have to use CentOS7 nodes.
    174174
    175175
    176176== How to submit a job ==
    177 On login node, '''submitJob.sh''', '''transferData.sh''', and '''computing.sh''' must be in the same directory.
     177On the login node, '''submitJob.sh''', '''transferData.sh''', and '''computing.sh''' must be in the same directory.
    178178{{{
    179179sh ./submitJob.sh