Grid Job Submit

Mar 18 2011
Topic: commands used in grid job submit
Comments: there are a few popular commends to submit jobs to grid system

*dls: shows where files I am looking for are saved
*dget: allows users to save files in grid system to a local machine where users are working
example commands
*show mc10 108497 level0 ntuples
$ dls mc10_7TeV.108497.PythiaB_cbmsel1_ChHadr.merge.AOD.e574_s933_s946_r1655_r1700

Apr 29 2011
topic: finding WW and WZ dibozon mc in grid comments: we need to find WW and WZ dibozon mc in grid to study higgs going to ccbar in whiggs events
commends we used
* dls mc10\*105985.WW_Herwig\*
* dls mc10\*105987.WZ_Herwig\*

directories with AOD in it
* dls mc10\*105985.WW_Herwig\*AOD\*

to see files in the directory
* dls -f mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r1659_r1700/

directory name with 'sub' means that the job is sumbitted and is running (i.e mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2215_r2260_tid299407_00_sub018826305)

command to submit a grid job for DmesonAnalysis.cxx is saved at
/susyraid1/home/jkim/atlasdev/16.3.0.7/CharmAnalysis/gridjobs.txt
pathena share/HiggsAnalysisJobOptions.py -c "ReadMC=True" --inDS mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2215_r2260/ --outDS user.jakim.mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2215_r2260.HiggsAna.Apr292011 --maxCpuCount 900000 --nFilesPerJob 1 --extOutFile HiggsAnalysisTest.root --supStream GLOBAL --excludedSite=ANALY_TAIWAN,ANALY_LAPP,ANALY_SARA-MATRIX,ANALY_GRIF-IRFU,ANALY_GRIF-LPNHE,ANALY_GRIF-LAL,ANALY_SCINET,ANALY_WEIZMANN,ANALY_ALBERTA-WG1,ANALY_BEIJING,ANALY_TECHNION-HEP,ANALY_CERN_XROOTD,ANALY_LYON-T2,ANALY_LIP-Lisbon,ANALY_LANCS,ANALY_NIKHEF-ELPROD,ANALY_HU_ATLAS_Tier2

to submit a grid job from susy
$ setup16
$ grid
$ panda
$ cd /susyraid1/home/jkim/atlasdev/16.3.0.7/CharmAnalysis
$ pathena share/HiggsAnalysisJobOptions.py -c "ReadMC=True" --inDS mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2215_r2260/ --outDS user.jakim.mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2215_r2260.HiggsAna.Apr292011 --maxCpuCount 900000 --nFilesPerJob 1 --extOutFile HiggsAnalysisTest.root --supStream GLOBAL --excludedSite=ANALY_TAIWAN,ANALY_LAPP,ANALY_SARA-MATRIX,ANALY_GRIF-IRFU,ANALY_GRIF-LPNHE,ANALY_GRIF-LAL,ANALY_SCINET,ANALY_WEIZMANN,ANALY_ALBERTA-WG1,ANALY_BEIJING,ANALY_TECHNION-HEP,ANALY_CERN_XROOTD,ANALY_LYON-T2,ANALY_LIP-Lisbon,ANALY_LANCS,ANALY_NIKHEF-ELPROD,ANALY_HU_ATLAS_Tier2

a script to submit a grid job is saved at
/susyraid1/home/jkim/atlasdev/16.3.0.7/CharmAnalysis/bin/gsub

a trial command can be shown when the following command is given
$ cd /susyraid1/home/jkim/atlasdev/16.3.0.7/CharmAnalysis $ bin/gsub MC 0 105001 -d

May 02 2011
topic: dget files from grid comments: dget command has options

dget one file from grid
$ dget -f filename datasetname

see which version of event generator, simulation, digitization and reconstruction software was used for a specific aod ntuple file, then type its suffix on
http://ami.in2p3.fr:8080/AMI/servlet/net.hep.atlas.Database.Bookkeeping.AMI.Servlet.Command?linkId=512 on Browse/Search all configuration tags
i.e. e598_s933_s946_r2302_r2300 for mc10_7TeV.105985.WW_Herwig.merge.AOD.e598_s933_s946_r2302_r2300_tid323800_00

May 03 2011
topic: grub in grid
comments: sending grid jobs require to follow a few rules

sending jobs to grid
$ cd atlasdev/16.3.0.7/
$ setup
$ grid
$ panda
$ [pathena command]

get outputs from grid
$ grid
$ panda
$ dget -f filename datasetname
* no atlas setup needed -- JaeKim - 17-Mar-2011