Notes on grid stuff

• example grid commands:
  • lcg-ls command for a file at Caltech:

    lcg-ls -l -b -D srmv2 'srm://cit-se.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/mc/Summer09/MinBias/GEN-SIM-RAW/MC_31X_V3-v1/0002/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root'

• lcg-cp command example for this file at Caltech:

  lcg-cp  -b -D srmv2 'srm://cit-se.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/mc/Summer09/MinBias/GEN-SIM-RAW/MC_31X_V3-v1/0002/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root' file:///tmp/ah/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root

  • see also this link, this link and this link for information which helped putting together these commands.

Examples of LFN to PFN mappings:

LFN is the logical file name (of an official CMS production file) starting with /store/... in the following table.

2010-08-24

• listing files in CERN CASTOR from UAF:

 lcg-ls  -b -D srmv2 "srm://srm-cms.cern.ch:8443//srm/managerv2?SFN=/castor/cern.ch/user/a/aholz/2010-ecal-spikes-simu-4/"

• copying from CERN castor to uaf:

 lcg-cp --verbose -b -D srmv2 "srm://srm-cms.cern.ch:8443//srm/managerv2?SFN=/castor/cern.ch/user/a/aholz/2010-ecal-spikes-simu-4/simevent_99.root" file:/tmp/simevent_99.root

see also http://www.uscms.org/uscms_at_work/physics/lpc/support/lpc_computing/LPC_FAQs.shtml for some examples

• Chris Palmer suggested the use of srmcp.

• how to get the PFN for an LFN at a given site ?
  • go to http://cvs.web.cern.ch/cvs/cgi-bin/viewcvs.cgi/COMP/SITECONF/ and get the storage.xml file for the site you're interested in. E.g. for CIEMAT, this is T2_ES_CIEMAT/PhEDEx/storage.xml (note that there is another directory containing CIEMAT which is empty).
  • this file contains a mapping of regexps to physical file names. Not clear to me whether the first matching or any of the matching can be taken. I have somehow the impression that one after another is applied to produce transformations...

• • (See also http://www.pd.infn.it/~lacaprar/Computing/tipsAndTricks.html, look for storage.xml).

• see also https://twiki.cern.ch/twiki/bin/view/Main/TomWhyntieGMSBNotes for examples of physical file names for different sites

Misc.

How can I translate a logical filename (LFN) to a physical one (PFN) ?

See the wget command example at this link in the section 'How can the data be accessed? What is the local path?'

-- AndreHolzner - 16-Apr-2010