LHCbImperialGroupBatch

This is the LHCb-Imperial tWiki page about running jobs on the Imperial HEP batch system through Ganga

Imperial College HEP batch system:

Imperial College HEP group uses the SGE batch queuing system to manage the submission of jobs to the computing resources. Jobs can be submitted using the qsub command and monitored using qstat. More information on SGE and how to use it can be found here.

The batch computers have access to data on the vols filesystem, but do not have access to the user home directories so any data files needed for your job must be on the vols system, and mustn't have references to the home diretories.

Using the batch system through Ganga:

To run jobs on the batch system in Ganga either use the backend SGE() or set the line Batch=SGE in your .gangarc file and use the backend Batch(). As the batch computers cannot access the default user area your Ganga job repository must be on the vols system. To create a repository on the vols system set the gangadir line in .gangarc to point to a directory on one of the vols disks. For example:

[Configuration]
...
gangadir = /vols/lhcbdisk00/cee01/gangadir

To ensure any executables can be found, and that the job is run in a temporary directory, some variables are added to SGE.preexecute by the central ini file. Additionally your SGE environment is artificially cleaned of all references to /home/hep, added by configuring ganga utilities.

Check everything is working

Use ganga utilites to submit a testjob (see LHCbEdinburghGroupGangaUtils):

gu.testjob()

See details of the testjob command to submit different kinds of jobs. By default the latest version of DaVinci will be tested.

Queues:

There are a couple of different queues it is possible to send your jobs to:

• hepshort.q: 1 hour time limit
• hepmedium.q: 8 hour time limit
• heplong.q: 72 hour time limit

The default is hepshort.q

To switch between these in Ganga use j.backend.queue

Accessing dCache:

To access the dCache data, follow the instructions on LHCbImperialGroupDCache

-- ChrisEames - 06 Mar 2009