pathena usage

'pathena --help' prints a summary of the options

options:

pathena flow

• import libs
• import Client
  • get SiteSpecs
• set defaults
• parse options
• sanity check options:
  • require outDS, split>=0, nEventsPerJob not used when nFilesPerJob
  • set site=AUTO if cloud specified
  • start preparing file list: filelist, inputFileList, removeFileList
  • check grid proxy
    • get DN
  • verify outDS matches DN and format
  • check if outDS is unique (and check shadowDS also)
• parse cmt environment: cmt show projects
  • gets athenaVer, groupArea, cacheVer, nightVer
• get run directory
• get job options file
• use runBrokerage to choose site (if site==AUTO and inDS not specified)
• correct site (add ANALY_) and destSE (destSE=site if destSE=='')
• extract run configuration
  • uses ConfigExtractor to determine output files
  • verify that there are output files.
• archive sources, InstallArea
  • send to panda
• get outDS location if it already exists
• handle input files:
  • get list of files: fileList
    • if inDS: runBrokerage against list of sites holding the inDS
    • if pfnlist: add the pfns
    • if shipFiles: fileList=shipFiles
    • do splitting of input
  • handle other types: cavernList, minbiasList, eamHaloAList, beamHaloCList, beamGasHList, beamGasCList, beamGasOList
• get DB datasets
• index the output files
• submit the job
  • build job and subjobs if splitting
  • attach input and output file descriptions
  • create outDS and libDS
  • submit the job to panda
• log job in local record db for pathena_util

Panda Client functions

    def _x509():
        def __init__(self):
        def get(self,url,data):
        def post(self,url,data):
        def put(self,url,data):
        def convRet(self,ret):
    def getSiteSpecs():
    def getLRC(site):
    def getLFC(site):
    def getSE(site):
    def submitJobs(jobs,verbose=False):
    def getJobStatus(ids):
    def killJobs(ids):
    def reassignJobs(ids):
    def queryPandaIDs(ids):
    def queryLastFilesInDataset(datasets,verbose=False):
    def putFile(file,verbose=False):
    def deleteFile(file):
    def queryFilesInDataset(name,verbose=False,v_vuids=None):
    def getDatasets(name,verbose=False):
    def addDataset(name,verbose=False):
    def getElementsFromContainer(name,verbose=False):
    def convSrmV2ID(tmpSite):
    def getLocations(name,fileList,cloud,woFileCheck,verbose=False,useAMGA=False):
    def eraseDataset(name,gridSrc,verbose=False):
    def nEvents(name, verbose=False, askServer=True, fileList = {}, scanDir = '.'):
    def _getPFNsLRC(lfns,dq2url,verbose):
    def getMissLFNsFromLRC(files,url,verbose=False):
    def _getPFNsLFC(fileMap,site,explicitSE,verbose=False):
    def getMissLFNsFromLFC(fileMap,site,explicitSE,verbose=False):
    def _getGridSrc():
    def getDN(origString):
        def __init__(self):
        def getMap(self):
        def handle_data(self, data):
        def handle_starttag(self, tag, attrs):
        def handle_endtag(self, tag):
    def getJobStatusFromMon(id,verbose=False):
    def runBrokerage(sites,atlasRelease,cmtConfig=None,verbose=False):
    def isExcudedSite(tmpID):

-- DanielVanDerSter - 30 Jul 2008