--
KendallReeves - 28-Sep-2010
You can get the program to cleanup T3 storage by
svn checkout http://www.usatlas.bnl.gov/ddmrepo/svn/repos/t3ddm
David say the code had typo. I don't remember what it was (if it was fixed or not). If you have problem running, just show me the output, I can easily fix it.
Now, how to use it.
1. Get the dump from your storage to somewhere local where you're allowed to modify the file. You'll find several directories containing the daily dump in the directory:
/net/yy/srmcache/atlaslocalgroupdisk/user/HironoriIto/T3Dump
You'll want the most recent one.
2. Get the cleanupcode (svn checkout
http://www.usatlas.bnl.gov/ddmrepo/svn/repos/t3ddm)
3. Make sure that you have DQ2 client as well as srm clients (srmrm). On fester you'll want to source the a setup file, so execute:
source /mix/ap/atlas_app/atlaswn/setup.sh
(Make sure that you have atlas voms -- see ~kxr091000/bin/proxy for an example of how to generate one.)
4. scan local SE and update the dump database; to do so, execute the following on fester:
python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --scanSePath --sePath=/net/yy/srmcache/atlasproddisk
5. If you want to look at files which will be deleted for proddisk cleanup by
python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --showProdDiskDeleteFiles --sePath=/net/yy/srmcache/atlasproddisk
6. do the cleanup of Proddisk area by logging into the BNL cluser and executing the following command.
python storageManager.py --sqliteFile=/PATH/YOURSQLITEFILE --deleteProdDisk --sePath=/net/yy/srmcache/atlasproddisk/ --site=UTD_PRODDISK
Additional info.
* The default log is storageManager.log in your current directory. You
can adjust to wherever you want. But, keeping it the same for all
operation will write all logging in the one place. The log itself will auto-rotate when it grows.
* The default cutoff day of proddisk cleanup is 21 days. If you want to delete more/less, you can adjust by --cutOffDay=NN
For example, you might want to test it by setting larger cutOffDay (eg 90 days). Then, if you do #5, it should show smaller number of files.
export LFC_HOST=t3lfcv01.usatlas.bnl.gov
DQ2_LOCAL_SITE_ID=ROAMING