UPennTier3

Introduction

This page collects useful commands for Penn Tier3 system

Log-in and setup

Connect to Tier3 (account separate from the CERN account):

ssh at3i00.hep.upenn.edu

Setup:

source /etc/bashrc
if [ `hostname` == "at3f*" ]; then
        echo "on worker node. Manually setting setupATLAS alias"
        alias setupATLAS='source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh'
fi
setupATLAS
localSetupPython --pythonVersion=2.6.5-i686-slc5-gcc43
localSetupROOT --rootVersion=5.28.00g-slc5-gcc4.3 --skipConfirm --quiet

To see all installed versions of root / python

showVersions --show root
showVersions --show python

Accessing data

prun "--destSE="UPENN_LOCALGROUPDISK"" option dumps the output to

 /srm/atlaslocalgroupdisk/user/username

Command to "ls" on the xrootd space:

xrd hn.at3f dirlist /srm/atlaslocalgroupdisk/user/bjackson/data11_7TeV

Copy (inefficient):

cp /xrootd/srm/... .

Deleting data

It is important to do this correctly, otherwise the grid links to data are only deleted and lost, while the disk space is not freed...

python deleteDatasetSite.py -d $data_set -s UPENN_LOCALGROUPDISK -l out.log

Getting the list of your datasets

dq2-list-dataset-site2 -eH0 -o "/DC=org/DC=doegrids/OU=People/CN=Ryan
D. Reece 697351" UPENN_LOCALGROUPDISK > file_list.txt

Finding individual users usage and generating a script to delete old datasets

These scripts will check each users usage and create a file of datasets to remove.

svn co svn+ssh://svn.cern.ch/reps/penn/PhysicsNtuple/PhysicsBatch/trunk PhysicsNtuple/PhysicsBatch
cd PhysicsNtuple/PhysicsBatch/pennt3
source PENNT3Usage.sh &> RESULTS.txt

All users usage is output into this file:

RESULTS.txt

This will create a file with datasets older than 6 months for all users. PLEASE GREP this file for your username before deleting any files.

FILES_TO_REMOVE.sh

Super-sweet bash functions for condor

• UPennTier3BashHelpers

-- RyanReece - 18-Jul-2012