Usage: Job output retrieval

Introduction

Output retrieval deals with the different output handling methods of CRAB. To be able to retrieve the output of a job, a job has to be in status Done. The output retrieval procedure is described in the following.

Job output retrieval

The following command retrieves the output of all jobs of a CRAB project which are Done:

crab -getoutput all -c

where all specifies to try to retrieve the output of all jobs of the latest project. You can specify a specifc directory to use a different CRAB project than the last:

crab -getoutput all -c <directory>

You can also specify every combination of job number and job range instead of all.

An example standard output would look like:

crab. crab (version 1.4.2) running on Mon Mar 19 14:18:50 2007

crab. Working options:
  scheduler           edg
  job type            CMSSW
  working directory   /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/

crab. Output for job 2 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 2 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Output for job 3 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 3 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Output for job 5 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 5 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Output for job 6 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 6 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Output for job 7 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 7 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Output for job 9 retrieved in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/
crab. Results of Job # 9 are in /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/res/

crab. Log-file is /uscms/home/gutsche/work/software/CRAB/test/CMSSW_1_2_0/src/crab_0_070319_131654/log/crab.log

The output of the jobs can be found in the given directory which contains following files:

BossChainer.log
BossProgram_1.log
CMSSW_000002.stderr
CMSSW_000002.stdout
CMSSW_000003.stderr
CMSSW_000003.stdout
CMSSW_000005.stderr
CMSSW_000005.stdout
CMSSW_000006.stderr
CMSSW_000006.stdout
CMSSW_000007.stderr
CMSSW_000007.stdout
CMSSW_000009.stderr
CMSSW_000009.stdout
crab_0_070319_131654_1_2.log
crab_0_070319_131654_1_3.log
crab_0_070319_131654_1_5.log
crab_0_070319_131654_1_6.log
crab_0_070319_131654_1_7.log
crab_0_070319_131654_1_9.log
crab_fjr_2.xml
crab_fjr_3.xml
crab_fjr_5.xml
crab_fjr_6.xml
crab_fjr_7.xml
crab_fjr_9.xml
edg_getoutput.log
FrameworkJobReport_2.xml
FrameworkJobReport_3.xml
FrameworkJobReport_5.xml
FrameworkJobReport_6.xml
FrameworkJobReport_7.xml
FrameworkJobReport_9.xml
output_000002.root
output_000003.root
output_000005.root
output_000006.root
output_000007.root
output_000009.root

Amongst the files are the standard output and error of the jobs (CMSSW_*.stdout and CMSSW_*.stderr) and the output root files (output_*,root).

Output retrieval in storage element mode

When storing the output on a storage element, the standard output and error log files still have to be retrieved traditionally as described above.

The following command checks the status of the files on your storage element (exemplary for the FNAL storage element):

srm-get-metadata srm://cmssrm.fnal.gov:8443/srm/managerv1?SFN=/resilient/username/subdir/file

where file has to be replaced with a single output file (Example: output_000001.root, etc.), username with the username and subdir with the selected path on the storage element.

The following command copies a file from the storage element into the current directory on a local disk:

srmcp srm://cmssrm.fnal.gov:8443/srm/managerv1?SFN=/resilient/username/subdir/file file:////`pwd`/file

where again file has to be replaced with a single output file (Example: output_000001.root, etc.), username with the username and subdir with the selected path on the storage element.

If local access to the mass storage system behind the storage element is available, following commands can be used to check the status and copy a file on Castor. For the status check:

rfdir /castor/cern.ch/user/u/username/subdir

and the copy:

rfcp /castor/cern.ch/user/u/username/subdir/file .

where u/username/subdir/file has to be replaced with the appropriate values.

On dCache, the same can be achieved using the following commands for the status check:

ls /pnfs/cms/WAX/resilient/username/subdir

and the copy:

dccp /pnfs/cms/WAX/resilient/username/subdir/file .

where u/username/subdir/file has to be replaced with the appropriate values.