-- KendallReeves - 28-Sep-2010 You can get the program to cleanup T3 storage by

svn checkout http://www.usatlas.bnl.gov/ddmrepo/svn/repos/t3ddm

David say the code had typo. I don't remember what it was (if it was fixed or not). If you have problem running, just show me the output, I can easily fix it.

Now, how to use it.

1. Get the dump from your storage to somewhere local where you're allowed to modify the file. You'll find several directories containing the daily dump in the directory:

/net/yy/srmcache/atlaslocalgroupdisk/user/HironoriIto/T3Dump

You'll want the most recent one.

2. Get the cleanupcode (svn checkout http://www.usatlas.bnl.gov/ddmrepo/svn/repos/t3ddm)

3. Make sure that you have DQ2 client as well as srm clients (srmrm). On fester you'll want to source the a setup file, so execute:

source /mix/ap/atlas_app/atlaswn/setup.sh

(Make sure that you have atlas voms -- see ~kxr091000/bin/proxy for an example of how to generate one.)

4. scan local SE and update the dump database; to do so, execute the following on fester:

python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --scanSePath --sePath=/net/yy/srmcache/atlasproddisk

5. If you want to look at files which will be deleted for proddisk cleanup by

python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --showProdDiskDeleteFiles --sePath=/net/yy/srmcache/atlasproddisk

6. do the cleanup of Proddisk area by logging into the BNL cluser and executing the following command.

python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --deleteProdDisk --sePath=/net/yy/srmcache/atlasproddisk/ --site=UTD_PRODDISK

Additional info.

* The default log is storageManager.log in your current directory. You can adjust to wherever you want. But, keeping it the same for all operation will write all logging in the one place. The log itself will auto-rotate when it grows. * The default cutoff day of proddisk cleanup is 21 days. If you want to delete more/less, you can adjust by --cutOffDay=NN

For example, you might want to test it by setting larger cutOffDay (eg 90 days). Then, if you do #5, it should show smaller number of files.

export LFC_HOST=t3lfcv01.usatlas.bnl.gov

DQ2_LOCAL_SITE_ID=ROAMING

Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r3 - 2011-04-14 - KendallReeves
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback