Installation
on a SLC5 64 vm (
VirtualBox SUN)
std workstation installation with:
- no Gnome
- Applications: only Editor and graphical internet
Comment: it has anyway installed what it wanted...
Rebooted, updated.
SELinux: permissive
remember to use ntp!
installed SLC4 compatibility and more:
https://twiki.cern.ch/twiki/bin/view/LCG/SL5DependencyRPM but with gpgcheck=0
glite 3.1 installation:
https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310
put in glite repo i386 repos
used jdk 5.2v15, amd64, installed throught jpackage
TEST FAILED, TOO MANY LIB DEPENDECIES MISSING!
PSI test
using a gLite3.1 UI_TAR installed locally on a SL4 node:
- install CMSSW_3_4_0
- Install CRAB 2_6_6 and send jobs to the grid
UI installation
TAR installation to be done in a clean shell ON A slc4 node (--noprofile needed as a UI is already installed
):
ssh HOST /bin/bash --noprofile
test 1: voms-proxy-init -voms cms = OK
test 2: glite-wms-job-submit -a
GridTests/hostname.jdl
second try
glite-wms-job-submit: error while loading shared libraries: libxml2.so.2: cannot open shared object file: No such file or directory
solution: Installing the missing library:
yum install libxml2
third try
glite-wms-job-submit: error while loading shared libraries: libcurl.so.3: cannot open shared object file: No such file or directory
solution: Installing the missing libraries:
# yum install curl.i386
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package curl.i386 0:7.15.5-2.1.el5_3.5 set to be updated
--> Processing Dependency: libidn.so.11 for package: curl
--> Running transaction check
---> Package libidn.i386 0:0.6.5-1.1 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin
Dependencies Resolved
============================================================================================================================================================================
Package Arch Version Repository Size
============================================================================================================================================================================
Installing:
curl i386 7.15.5-2.1.el5_3.5 sl53update 232 k
Installing for dependencies:
libidn i386 0.6.5-1.1 sl53base 194 k
Transaction Summary
============================================================================================================================================================================
Install 2 Package(s)
Update 0 Package(s)
Remove 0 Package(s)
[...]
Complete!
fourth try
glite-wms-job-submit -a
GridTests/hostname.jdl
Error - Wrong Value
Unable to resolve the hostname: my-wms.psi.ch
solution: put desy wms
fifth try
glite-wms-job-submit -a GridTests/hostname.jdl
Connecting to the service https://grid-wms10.desy.de:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://grid-lb2.desy.de:9000/8LevBGKTKbhGkrpNoki9JQ
==========================================================================
OK
test 3: glite-wms-job-status
https://grid-lb2.desy.de:9000/8LevBGKTKbhGkrpNoki9JQ
Traceback (most recent call last):
File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/bin/glite-wms-job-status", line 31, in ?
import UIutils
File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/UIutils.py", line 23, in ?
from glite_wmsui_UcWrapper import UCredential
File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/glite_wmsui_UcWrapper.py", line 5, in ?
import _glite_wmsui_UcWrapper
ImportError: /shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/_glite_wmsui_UcWrapper.so: wrong ELF class: ELFCLASS32
Sounds like a 32/64 issue.
Solution: None. Maybe using
CRAB can be a workaround
CRAB installation on t3wn08 (SLC5)
installing CRAB_2_6_6 on t3wn08 (SLC5):
https://twiki.cern.ch/twiki/bin/view/CMS/SWGuideCrab
After downloading and untarring:
#./configure
Configuring CRAB.....
Done
CMSSW installation on t3wn08 (SLC5)
Reference:
https://twiki.cern.ch/twiki/bin/viewauth/CMS/CMSSW_aptinstaller
unset VO_CMS_SW_DIR
export VO_CMS_SW_DIR=/shome/leo/SL5Test/cmssw
export SCRAM_ARCH=slc5_ia32_gcc434
export LANG=C
Installing:
source $VO_CMS_SW_DIR/$SCRAM_ARCH/external/apt/0.5.15lorg3.2-cms2//etc/profile.d/init.sh
apt-get install cms+cmssw+CMSSW_3_4_1
No errors, OK.
Installing a local CMSSW_3_4_1 scram area:
# source SL5Test/cms/cmsset_default.sh
# cd SL5Test
# mkdir TestCMSSW
# cd TestCMSSW
# scramv1 p CMSSW CMSSW_3_4_1
No problems, testing a simple cfg (only reads files from a local root file):
# eval `scramv1 ru -sh`
# cmsRun read_files_cfg.py
Test OK.
Testing CRAB on t3wn08 (SLC5)
Sourcing the proper env froma clean shell:
# source gLite/glite-UI-3.1.43-0/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# cmsenv
/bin/bash: line 8: cmsenv: command not found
# eval `scramv1 ru -sh`
uhm, cmsenv does not work... the good ol' fashioned eval does the job.
Creating crab jobs (using the read_files_cfg_py config file):
# crab -create
crab: Version 2.6.6 running on Thu Jan 14 09:54:24 2010 CET (08:54:24 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/
crab: Downloading config files for WMS: https://cmsweb.cern.ch/crabconf/glite_wms_CERN.conf
[...]
crab: Contacting Data Discovery Services ...
crab: Requested dataset: /MinimumBias/BeamCommissioning09-CSCSkim_BeamHalo_MinBias-Dec19thSkim_341_v2/RAW-RECO has 6403 events in 1 blocks.
crab: May not create the exact number_of_jobs requested.
crab: 5 job(s) can run on 10 events.
crab: List of jobs and available destination sites:
Block 1: jobs 1-5: sites: T2_US_Purdue, T2_US_UCSD, T2_US_Florida, T2_DE_RWTH, T2_IT_Pisa, T2_US_Nebraska
crab: Creating 5 jobs, please wait...
crab: Total of 5 jobs created.
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/log/crab.log
Sounds good.
Checking job status:
# crab -status
crab: Version 2.6.6 running on Thu Jan 14 09:57:35 2010 CET (08:57:35 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/
crab: Checking the status of all jobs: please wait
Traceback (most recent call last):
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 878, in ?
crab.run()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 816, in run
if act in self.actions.keys(): self.actions[act].run()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Status.py", line 25, in run
self.query()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Status.py", line 41, in query
upTask = common.scheduler.queryEverything(task['id'])
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Scheduler.py", line 321, in queryEverything
return self.boss().queryEverything(taskid)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Boss.py", line 159, in queryEverything
statusRes = self.schedSession().query( str(taskid))
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 222, in query
self.scheduler.query( task, queryType )
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 150, in query
self.schedObj.query( obj, self.parameters['service'], objType )
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 1165, in query
from ProdCommon.BossLite.Scheduler.GLiteLBQuery import GLiteLBQuery
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/GLiteLBQuery.py", line 11, in ?
from glite_wmsui_LbWrapper import Status
File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/glite_wmsui_LbWrapper.py", line 5, in ?
import _glite_wmsui_LbWrapper
ImportError: No module named _glite_wmsui_LbWrapper
from Zhiling page:
https://twiki.cscs.ch/twiki/bin/view/CmsTier3/CrabSgeToubleshooting
export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib
Trying again:
# crab -status
crab: Version 2.6.6 running on Thu Jan 14 09:59:14 2010 CET (08:59:14 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/
crab: Checking the status of all jobs: please wait
crab:
ID STATUS E_HOST EXE_EXIT_CODE JOB_EXIT_STATUS
--------------------------------------------------------------------------------------------
1 Created
2 Created
3 Created
4 Created
5 Created
crab: 5 Total Jobs
>>>>>>>>> 5 Jobs Created
List of jobs Created: 1-5
crab: You can also follow the status of this task on :
CMS Dashboard: http://dashb-cms-job-task.cern.ch/taskmon.html#task=leo_crab_0_100114_095422_a72t3v
Your task name is: leo_crab_0_100114_095422_a72t3v
Nice. Trying to submit jobs:
# crab -submit
crab: Version 2.6.6 running on Thu Jan 14 09:59:51 2010 CET (08:59:51 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/
crab: Checking available resources...
crab: Found compatible site(s) for job 1
crab: 1 blocks of jobs will be submitted
crab: failed to delegate proxy to https://wms011.cnaf.infn.it:7443/glite_wms_wmproxy_server : Unable to delegate proxy
glite-proxy-cert: error while loading shared libraries: libssl.so.4: cannot open shared object file: No such file or directory
from here:
https://hypernews.cern.ch/HyperNews/CMS/get/crabFeedback/2756/1/1.html
# yum install openssl097a
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package openssl097a.x86_64 0:0.9.7a-9.el5_2.1 set to be updated
---> Package openssl097a.i386 0:0.9.7a-9.el5_2.1 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin
Dependencies Resolved
===========================================================================================================================================================================
Package Arch Version Repository Size
===========================================================================================================================================================================
Installing:
openssl097a i386 0.9.7a-9.el5_2.1 sl53update 825 k
openssl097a x86_64 0.9.7a-9.el5_2.1 sl53base 824 k
[..]
Complete!
Trying again:
#crab -submit
crab: Version 2.6.6 running on Thu Jan 14 10:09:11 2010 CET (09:09:11 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_100849/
crab: Checking available resources...
crab: Found compatible site(s) for job 1
crab: 1 blocks of jobs will be submitted
Traceback (most recent call last):
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 878, in ?
crab.run()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 812, in run
if act in self.actions.keys(): self.actions[act].run()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Submitter.py", line 111, in run
njs = self.perfromSubmission(list_matched, task)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Submitter.py", line 200, in perfromSubmission
common.scheduler.submit(self.sub_jobs[ii],task)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Scheduler.py", line 311, in submit
self.boss().submit(task['id'],sub_list,req)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/Boss.py", line 131, in submit
task_sub = self.schedSession().submit( taskId, jobsList,req )
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 129, in submit
self.scheduler.submit( task, requirements )
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 62, in submit
self.parameters['config'], self.parameters['service']\
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 548, in submit
endpoints = self.wmsResolve( endpoints )
File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 333, in wmsResolve
wmsList.append(pre + socket.gethostbyaddr( wms )[0] + post)
socket.herror: (2, 'Host name lookup failure')
???
Testing with crab server:
# crab -submit
crab: Version 2.6.6 running on Thu Jan 14 10:13:01 2010 CET (09:13:01 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server ON
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_101228/
Traceback (most recent call last):
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 877, in ?
crab.initialize_(options)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 166, in initialize_
self.initializeActions_(opts)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 543, in initializeActions_
self.actions[opt] = SubmitterServer(self.cfg_params, self.parseRange_(val), val)
File "/shome/leo/SL5Test/CRAB_2_6_6/python/SubmitterServer.py", line 24, in __init__
self.copyTout= setLcgTimeout()
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab_util.py", line 692, in setLcgTimeout
if checkLcgUtils() >= 17: opt=' --connect-timeout 600 '
File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab_util.py", line 684, in checkLcgUtils
num_ver = int(temp[0])*10
ValueError: invalid literal for int(): cp: error while loading shared libraries: libldap
Damn, I forgot the magic dependency package!
https://twiki.cern.ch/twiki/bin/view/LCG/SL5DependencyRPM
https://hypernews.cern.ch/HyperNews/CMS/get/crabFeedback/2757.html
So:
# yum install HEP_OSlibs_SL5
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package HEP_OSlibs_SL5.x86_64 0:1.0.1-0 set to be updated
filelists.xml.gz | 3.9 MB 00:00
filelists.xml.gz | 344 B 00:00
[..]
Dependencies Resolved
===========================================================================================================================================================================
Package Arch Version Repository Size
===========================================================================================================================================================================
Installing:
HEP_OSlibs_SL5 x86_64 1.0.1-0 HEP_OSlibs 8.0 k
Installing for dependencies:
alsa-lib i386 1.0.17-1.el5 sl53base 412 k
bzip2-libs i386 1.0.3-4.el5_2 sl53base 37 k
compat-db i386 4.2.52-5.1 sl53base 1.7 M
compat-glibc x86_64 1:2.3.4-2.26 sl53base 1.5 M
compat-glibc i386 1:2.3.4-2.26 sl53base 1.0 M
compat-glibc-headers x86_64 1:2.3.4-2.26 sl53base 481 k
compat-libf2c-34 i386 3.4.6-4 sl53base 52 k
compat-libf2c-34 x86_64 3.4.6-4 sl53base 56 k
compat-libstdc++-33 i386 3.2.3-61 sl53base 232 k
compat-openldap i386 2.3.43_2.2.29-3.el5 sl53base 257 k
compat-openldap x86_64 2.3.43_2.2.29-3.el5 sl53base 263 k
compat-readline43 i386 4.3-3 sl53update 102 k
compat-readline43 x86_64 4.3-3 sl53base 106 k
fontconfig i386 2.4.1-7.el5 sl53base 174 k
freetype i386 2.2.1-21.el5_3 sl53update 310 k
giflib i386 4.1.3-7.1.el5_3.1 sl53update 39 k
gmp i386 4.1.4-10.el5 sl53base 664 k
libXcursor i386 1.1.7-1.1 sl53base 32 k
libXfixes i386 4.0.1-2.1 sl53base 14 k
libXft i386 2.1.10-1.1 sl53base 44 k
libXinerama i386 1.0.1-2.1 sl53base 9.7 k
libXmu i386 1.0.2-5 sl53base 62 k
libXp i386 1.0.0-8.1.el5 sl53base 22 k
libXpm i386 3.5.5-3 sl53base 45 k
libXrandr i386 1.1.1-3.1 sl53base 15 k
libXrender i386 0.9.1-3.1 sl53base 27 k
libXtst i386 1.0.1-3.1 sl53base 15 k
libgfortran i386 4.1.2-44.el5 sl53base 231 k
libjpeg i386 6b-37 sl53base 139 k
libpng i386 2:1.2.10-7.1.el5_3.2 sl53base 244 k
libtiff i386 3.8.2-7.el5_3.4 sl53update 306 k
libxml2-devel i386 2.6.26-2.1.2.8 sl53update 2.1 M
openmotif i386 2.3.1-2.el5 sl53base 1.5 M
openmotif22 i386 2.2.3-18 sl53base 1.3 M
openmotif22 x86_64 2.2.3-18 sl53base 1.3 M
sqlite i386 3.3.6-2 sl53base 213 k
Transaction Summary
===========================================================================================================================================================================
Install 37 Package(s)
Update 0 Package(s)
Remove 0 Package(s)
[...]
Complete!
Trying again with
CRAB server:
# crab -submit
crab: Version 2.6.6 running on Thu Jan 14 10:23:49 2010 CET (09:23:49 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server ON
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102300/
crab: Registering credential to the server : crab1.ba.infn.it
crab: Credential successfully delegated to the server.
crab: Starting sending the project to the storage dot1-prod-2.ba.infn.it...
crab: ERROR : Unable to create SE destination interface
Project leo_crab_0_100114_102300_87dsg5 not Submitted
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102300/log/crab.log
Can be a SE misconfiguration, checking later
Trying with Stand Alone submission:
# crab -create -submit
crab: Version 2.6.6 running on Thu Jan 14 10:26:00 2010 CET (09:26:00 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/
crab: Contacting Data Discovery Services ...
crab: Requested dataset: /MinimumBias/BeamCommissioning09-CSCSkim_BeamHalo_MinBias-Dec19thSkim_341_v2/RAW-RECO has 6403 events in 1 blocks.
crab: May not create the exact number_of_jobs requested.
crab: 5 job(s) can run on 10 events.
crab: List of jobs and available destination sites:
Block 1: jobs 1-5: sites: T2_US_Purdue, T2_US_UCSD, T2_US_Florida, T2_DE_RWTH, T2_IT_Pisa, T2_US_Nebraska
crab: Creating 5 jobs, please wait...
crab: Total of 5 jobs created.
crab: Checking available resources...
crab: Found compatible site(s) for job 1
crab: 1 blocks of jobs will be submitted
crab: Total of 5 jobs submitted.
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log
sounds good.
Checking job status:
crab -status
crab: Version 2.6.6 running on Thu Jan 14 11:01:57 2010 CET (10:01:57 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/
crab: Checking the status of all jobs: please wait
crab:
ID STATUS E_HOST EXE_EXIT_CODE JOB_EXIT_STATUS
--------------------------------------------------------------------------------------------
1 Ready grid-ce.physik.rwth-aachen.de
2 Ready grid-ce.physik.rwth-aachen.de
3 Ready grid-ce.physik.rwth-aachen.de
4 Ready grid-ce.physik.rwth-aachen.de
5 Ready grid-ce.physik.rwth-aachen.de
crab: 5 Total Jobs
>>>>>>>>> 5 Jobs Ready
List of jobs Ready: 1-5
crab: You can also follow the status of this task on :
CMS Dashboard: http://dashb-cms-job-task.cern.ch/taskmon.html#task=leo_crab_0_100114_102558_08nq4p
Your task name is: leo_crab_0_100114_102558_08nq4p
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log
OK. Getting back the jobs:
# crab -getoutput
crab: Version 2.6.6 running on Thu Jan 14 11:19:11 2010 CET (10:19:11 UTC)
crab. Working options:
scheduler glite
job type CMSSW
server OFF
working directory /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/
crab: Results of Jobs # 1 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab: Results of Jobs # 2 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab: Results of Jobs # 3 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab: Results of Jobs # 4 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab: Results of Jobs # 5 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log
Ok, it does work!
UI 3.1 installation on t3wn08 (SL5)
In the system with the packages installed above.
# ssh t3wn08 /bin/bash --noprofile
# cd /shome/leo/gLite/glite-UI-3.1.43-0-SL5
# tar xvzf glite-UI-3.1.43-0.tar.gz
# tar xvzf glite-UI-3.1.43-0-external.tar.gz
# glite/yaim/bin/yaim -v -s site-info.def -n UI_TAR
WARNING:
WARNING: *****************************************************************************
WARNING: Your siteinfo directory is world readable. This is generally a bad idea
WARNING: as configuration files may contain passwords and other sensitive information.
WARNING: *****************************************************************************
WARNING:
INFO: Using site configuration file: site-info.def
INFO:
###################################################################
. /'.-. ')
. yA,-"-,( ,m,:/ ) .oo. oo o ooo o. .oo
. / .-Y a a Y-. 8. .8' 8'8. 8 8b d'8
. / ~ ~ / 8' .8oo88. 8 8 8' 8
. (_/ '====' 8 .8' 8. 8 8 Y 8
. Y,-''-,Yy,-.,/ o8o o8o o88o o8o o8o o8o
. I_))_) I_))_)
current working directory: /shome/leo/gLite/glite-UI-3.1.43-0-SL5
site-info.def date: Jan 14 11:03 site-info.def
yaim command: -v -s site-info.def -n UI_TAR
log file: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/bin/../log/yaimlog
Thu Jan 14 11:08:53 CET 2010 : glite/yaim/bin/yaim
Installed YAIM versions:
glite-yaim-clients 4.0.8-7
glite-yaim-core 4.0.8-7
####################################################################
INFO: The default location of the grid-env.(c)sh files will be: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/external/etc/profile.d
INFO: Sourcing the utilities in /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/functions/utils
INFO: Detecting environment
INFO: Executing function: config_certs_userland_check
INFO: Executing function: config_sysconfig_lcg_check
INFO: Executing function: config_globus_clients_check
INFO: Executing function: config_lcgenv_check
INFO: Executing function: config_rgma_client_check
INFO: Executing function: config_workload_manager_client_check
INFO: Executing function: config_amga_client_check
INFO: Executing function: config_gsissh_check
INFO: Executing function: config_glite_ui_check
INFO: Executing function: config_ui_tar_check
INFO: Executing function: config_vomses_check
INFO: Executing function: config_vomsdir_check
INFO: Executing function: config_globus_devel_check
INFO: Checking is done.
INFO: All the necessary variables to configure UI_TAR are defined in your configuration files.
INFO: Please, bear in mind that YAIM only guarantees the definition of variables
INFO: controlled in the _check functions.
INFO: YAIM terminated succesfully.
# glite/yaim/bin/yaim -c -s site-info.def -n UI_TAR
WARNING:
WARNING: *****************************************************************************
WARNING: Your siteinfo directory is world readable. This is generally a bad idea
WARNING: as configuration files may contain passwords and other sensitive information.
WARNING: *****************************************************************************
WARNING:
INFO: Using site configuration file: site-info.def
INFO:
###################################################################
. /'.-. ')
. yA,-"-,( ,m,:/ ) .oo. oo o ooo o. .oo
. / .-Y a a Y-. 8. .8' 8'8. 8 8b d'8
. / ~ ~ / 8' .8oo88. 8 8 8' 8
. (_/ '====' 8 .8' 8. 8 8 Y 8
. Y,-''-,Yy,-.,/ o8o o8o o88o o8o o8o o8o
. I_))_) I_))_)
current working directory: /shome/leo/gLite/glite-UI-3.1.43-0-SL5
site-info.def date: Jan 14 11:03 site-info.def
yaim command: -c -s site-info.def -n UI_TAR
log file: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/bin/../log/yaimlog
Thu Jan 14 11:09:50 CET 2010 : glite/yaim/bin/yaim
Installed YAIM versions:
glite-yaim-clients 4.0.8-7
glite-yaim-core 4.0.8-7
####################################################################
INFO: The default location of the grid-env.(c)sh files will be: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/external/etc/profile.d
INFO: Sourcing the utilities in /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/functions/utils
INFO: Detecting environment
INFO: Executing function: config_certs_userland_check
INFO: Executing function: config_sysconfig_lcg_check
INFO: Executing function: config_globus_clients_check
INFO: Executing function: config_lcgenv_check
INFO: Executing function: config_rgma_client_check
INFO: Executing function: config_workload_manager_client_check
INFO: Executing function: config_amga_client_check
INFO: Executing function: config_gsissh_check
INFO: Executing function: config_glite_ui_check
INFO: Executing function: config_ui_tar_check
INFO: Executing function: config_vomses_check
INFO: Executing function: config_vomsdir_check
INFO: Executing function: config_globus_devel_check
INFO: Executing function: config_certs_userland_setenv
INFO: Executing function: config_certs_userland
INFO: Certificates found in /etc/grid-security/certificates or in $X509_CERT_DIR. Not installing relocated version.
INFO: Executing function: config_crl
INFO: Executing function: config_sysconfig_edg
INFO: Executing function: config_sysconfig_globus
INFO: Executing function: config_sysconfig_lcg
INFO: Executing function: config_globus_clients_setenv
INFO: Executing function: config_globus_clients
INFO: Configure the globus service
setup-tmpdirs: creating ./config.status
config.status: creating globus-script-initializer
config.status: creating Paths.pm
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
creating globus-sh-tools-vars.sh
creating globus-script-initializer
creating Globus::Core::Paths
checking globus-hostname
Done
INFO: Executing function: config_lcgenv
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
INFO: Executing function: config_rgma_client_setenv
INFO: Executing function: config_rgma_client
INFO: YAIM has detected the OS is SL5. The rgma client is no longer configured in SL5.
INFO: Executing function: config_workload_manager_client_setenv
INFO: Executing function: config_workload_manager_client
INFO: Executing function: config_fts_client
INFO: Executing function: config_amga_client_setenv
INFO: Executing function: config_amga_client
INFO: Executing function: config_gsissh_setenv
INFO: Executing function: config_gsissh
Configuring gsi_openssh
------------------------------------------------------------
Executing...
chmod: changing permissions of `/tmp/glite/glite-ui': Operation not permitted
chmod: changing permissions of `/tmp/jobOutput': Operation not permitted
Notes:
o Privilege separation is on.
o GSI-OpenSSH website is <http://grid.ncsa.uiuc.edu/ssh/>.
------------------------------------------------------------
Finished configuring gsi_openssh.
INFO: Executing function: config_glite_ui_setenv
INFO: Executing function: config_glite_ui
WARNING: The file /tmp/jobOutput specified in the variable OUTPUT_STORAGE doesn't exist
WARNING: The user is responsible for creating this file !
INFO: Executing function: config_ui_tar_setenv
INFO: Executing function: config_ui_tar
INFO: Executing function: config_vomses
INFO: Executing function: config_vomsdir_setenv
INFO: Executing function: config_vomsdir
INFO: Executing function: config_globus_devel_setenv
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
INFO: Executing function: config_globus_devel
gzdopen_ is not a valid Zlib macro at /shome/leo/gLite/glite-UI-3.1.43-0-SL5/gpt/lib/perl/Archive/Tar.pm line 250
INFO: Configuration Complete. [ OK ]
INFO: YAIM terminated succesfully.
Usual tests:
source /shome/leo/gLite/glite-UI-3.1.43-0-SL5/etc/profile.d/grid-env.sh
voms-proxy-init -voms cms : OK
voms-proxy-info -all : OK
glite-wms-job-submit -a
GridTests/hostname.jdl
Connecting to the service https://grid-wms11.desy.de:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://grid-lb1.desy.de:9000/I6oZ4p5FoKfDCoHUSHFnVQ
==========================================================================
glite-wms-job-status https://grid-lb1.desy.de:9000/I6oZ4p5FoKfDCoHUSHFnVQ
Traceback (most recent call last):
File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/bin/glite-wms-job-status", line 31, in ?
import UIutils
File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/python/UIutils.py", line 23, in ?
from glite_wmsui_UcWrapper import UCredential
File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/python/glite_wmsui_UcWrapper.py", line 5, in ?
import _glite_wmsui_UcWrapper
ImportError: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/_glite_wmsui_UcWrapper.so: wrong ELF class: ELFCLASS32
sigh...
Testing CRAB+CMSSW, again on t3wn08
Using gLite 3.1 TAR_UI installed on SLC5
# source gLite/glite-UI-3.1.43-0-SL5/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# eval `scramv1 ru -sh`
# export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib
crab -create
: OK
crab -submit
: OK
crab -status
: OK
crab -getoutput
: OK
SE tests
srmls
srmls srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root
WARNING: SRM_PATH is defined, which might cause a wrong version of srm client to be executed
WARNING: SRM_PATH=/shome/leo/gLite/glite-UI-3.1.43-0-SL5/d-cache/srm
987438028 /pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root
srmcp
srmcp -2 srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root file:///`pwd`/test.root
WARNING: SRM_PATH is defined, which might cause a wrong version of srm client to be executed
WARNING: SRM_PATH=/shome/leo/gLite/glite-UI-3.1.43-0-SL5/d-cache/srm
cmsRun
using as input file
dcap://t3se01.psi.ch:22125/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root
: OK
CMSSW 32 bit on SLC5
On t3wn08,
export SCRAM_ARCH=slc4_ia32_gcc345
and then source the normal CMSSW env.
Test with
cmsRun PAT1.py
CMSSW_3_3_2: OK
Summarizing
Packages to be installed on t3wn08 (SLC5):
To have CRAB_2_6_6 working on t3wn08 do:
# source gLite/glite-UI-3.1.43-0/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# eval `scramv1 ru -sh`
# export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib
Here:
- ~/gLite/glite-UI-3.1.43-0 is the dir where I've installed the TAR_UI
- ~/SL5Test/cms is the dir where I've installed the CMS SW
- ~/SL5Test/TestCMSSW/CMSSW_3_4_1 is where I've installed my scram local working area
--
LeonardoSala - 13-Jan-2010