Installation

on a SLC5 64 vm (VirtualBox SUN)

std workstation installation with:

  • no Gnome
  • Applications: only Editor and graphical internet

Comment: it has anyway installed what it wanted...

Rebooted, updated.

SELinux: permissive

remember to use ntp!

installed SLC4 compatibility and more: https://twiki.cern.ch/twiki/bin/view/LCG/SL5DependencyRPM but with gpgcheck=0

glite 3.1 installation: https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310

put in glite repo i386 repos

used jdk 5.2v15, amd64, installed throught jpackage

TEST FAILED, TOO MANY LIB DEPENDECIES MISSING!

PSI test

using a gLite3.1 UI_TAR installed locally on a SL4 node:

  • install CMSSW_3_4_0
  • Install CRAB 2_6_6 and send jobs to the grid

UI installation

TAR installation to be done in a clean shell ON A slc4 node (--noprofile needed as a UI is already installed ):

ssh HOST /bin/bash --noprofile

test 1: voms-proxy-init -voms cms = OK

test 2: glite-wms-job-submit -a GridTests/hostname.jdl

second try

glite-wms-job-submit: error while loading shared libraries: libxml2.so.2: cannot open shared object file: No such file or directory

solution: Installing the missing library:

 
yum install libxml2  

third try

glite-wms-job-submit: error while loading shared libraries: libcurl.so.3: cannot open shared object file: No such file or directory

solution: Installing the missing libraries:

# yum install curl.i386
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package curl.i386 0:7.15.5-2.1.el5_3.5 set to be updated
--> Processing Dependency: libidn.so.11 for package: curl
--> Running transaction check
---> Package libidn.i386 0:0.6.5-1.1 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin

Dependencies Resolved

============================================================================================================================================================================
 Package                              Arch                               Version                                             Repository                                Size
============================================================================================================================================================================
Installing:
 curl                                 i386                               7.15.5-2.1.el5_3.5                                  sl53update                               232 k
Installing for dependencies:
 libidn                               i386                               0.6.5-1.1                                           sl53base                                 194 k

Transaction Summary
============================================================================================================================================================================
Install      2 Package(s)
Update       0 Package(s)
Remove       0 Package(s)
[...]
Complete!

fourth try

glite-wms-job-submit -a GridTests/hostname.jdl

Error - Wrong Value
Unable to resolve the hostname: my-wms.psi.ch

solution: put desy wms

fifth try

glite-wms-job-submit -a GridTests/hostname.jdl

Connecting to the service https://grid-wms10.desy.de:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://grid-lb2.desy.de:9000/8LevBGKTKbhGkrpNoki9JQ

==========================================================================

OK

test 3: glite-wms-job-status https://grid-lb2.desy.de:9000/8LevBGKTKbhGkrpNoki9JQ

Traceback (most recent call last):
  File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/bin/glite-wms-job-status", line 31, in ?
    import UIutils
  File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/UIutils.py", line 23, in ?
    from glite_wmsui_UcWrapper import UCredential
  File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/glite_wmsui_UcWrapper.py", line 5, in ?
    import _glite_wmsui_UcWrapper
ImportError: /shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/_glite_wmsui_UcWrapper.so: wrong ELF class: ELFCLASS32

Sounds like a 32/64 issue.

Solution: None. Maybe using CRAB can be a workaround

CRAB installation on t3wn08 (SLC5)

installing CRAB_2_6_6 on t3wn08 (SLC5):

https://twiki.cern.ch/twiki/bin/view/CMS/SWGuideCrab

After downloading and untarring:

#./configure
Configuring CRAB.....
Done

CMSSW installation on t3wn08 (SLC5)

Reference: https://twiki.cern.ch/twiki/bin/viewauth/CMS/CMSSW_aptinstaller

unset VO_CMS_SW_DIR
export VO_CMS_SW_DIR=/shome/leo/SL5Test/cmssw
export SCRAM_ARCH=slc5_ia32_gcc434
export LANG=C

Installing:

source $VO_CMS_SW_DIR/$SCRAM_ARCH/external/apt/0.5.15lorg3.2-cms2//etc/profile.d/init.sh

apt-get install cms+cmssw+CMSSW_3_4_1

No errors, OK.

Installing a local CMSSW_3_4_1 scram area:

# source SL5Test/cms/cmsset_default.sh
# cd SL5Test
# mkdir TestCMSSW
# cd TestCMSSW
# scramv1 p CMSSW CMSSW_3_4_1

No problems, testing a simple cfg (only reads files from a local root file):

# eval `scramv1 ru -sh`
# cmsRun read_files_cfg.py 

Test OK.

Testing CRAB on t3wn08 (SLC5)

Sourcing the proper env froma clean shell:

# source gLite/glite-UI-3.1.43-0/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# cmsenv
   /bin/bash: line 8: cmsenv: command not found
# eval `scramv1 ru -sh`

uhm, cmsenv does not work... the good ol' fashioned eval does the job.

Creating crab jobs (using the read_files_cfg_py config file):

# crab -create

crab:  Version 2.6.6 running on Thu Jan 14 09:54:24 2010 CET (08:54:24 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/

crab:  Downloading config files for WMS: https://cmsweb.cern.ch/crabconf/glite_wms_CERN.conf
[...]
crab:  Contacting Data Discovery Services ...
crab:  Requested dataset: /MinimumBias/BeamCommissioning09-CSCSkim_BeamHalo_MinBias-Dec19thSkim_341_v2/RAW-RECO has 6403 events in 1 blocks.

crab:  May not create the exact number_of_jobs requested.
crab:  5 job(s) can run on 10 events.

crab:  List of jobs and available destination sites:

Block     1: jobs                  1-5: sites: T2_US_Purdue, T2_US_UCSD, T2_US_Florida, T2_DE_RWTH, T2_IT_Pisa, T2_US_Nebraska

crab:  Creating 5 jobs, please wait...
crab:  Total of 5 jobs created.

Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/log/crab.log

Sounds good.

Checking job status:

# crab -status

crab:  Version 2.6.6 running on Thu Jan 14 09:57:35 2010 CET (08:57:35 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/

crab:  Checking the status of all jobs: please wait
Traceback (most recent call last):
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 878, in ?
    crab.run()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 816, in run
    if act in self.actions.keys(): self.actions[act].run()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Status.py", line 25, in run
    self.query()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Status.py", line 41, in query
    upTask = common.scheduler.queryEverything(task['id'])
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Scheduler.py", line 321, in queryEverything
    return self.boss().queryEverything(taskid)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Boss.py", line 159, in queryEverything
    statusRes =  self.schedSession().query( str(taskid))
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 222, in query
    self.scheduler.query( task, queryType )
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 150, in query
    self.schedObj.query( obj, self.parameters['service'], objType )
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 1165, in query
    from ProdCommon.BossLite.Scheduler.GLiteLBQuery import GLiteLBQuery
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/GLiteLBQuery.py", line 11, in ?
    from glite_wmsui_LbWrapper import Status
  File "/shome/leo/gLite/glite-UI-3.1.43-0/glite/lib/python/glite_wmsui_LbWrapper.py", line 5, in ?
    import _glite_wmsui_LbWrapper
ImportError: No module named _glite_wmsui_LbWrapper

from Zhiling page: https://twiki.cscs.ch/twiki/bin/view/CmsTier3/CrabSgeToubleshooting

export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib

Trying again:

# crab -status
crab:  Version 2.6.6 running on Thu Jan 14 09:59:14 2010 CET (08:59:14 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/

crab:  Checking the status of all jobs: please wait
crab:
ID     STATUS             E_HOST                               EXE_EXIT_CODE JOB_EXIT_STATUS
--------------------------------------------------------------------------------------------
1      Created
2      Created
3      Created
4      Created
5      Created

crab:   5 Total Jobs
>>>>>>>>> 5 Jobs Created
        List of jobs Created: 1-5

crab:  You can also follow the status of this task on :
        CMS Dashboard: http://dashb-cms-job-task.cern.ch/taskmon.html#task=leo_crab_0_100114_095422_a72t3v
        Your task name is: leo_crab_0_100114_095422_a72t3v

Nice. Trying to submit jobs:

# crab -submit
crab:  Version 2.6.6 running on Thu Jan 14 09:59:51 2010 CET (08:59:51 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_095422/

crab:  Checking available resources...
crab:  Found  compatible site(s) for job 1
crab:  1 blocks of jobs will be submitted
crab:  failed to delegate proxy to https://wms011.cnaf.infn.it:7443/glite_wms_wmproxy_server : Unable to delegate proxy
glite-proxy-cert: error while loading shared libraries: libssl.so.4: cannot open shared object file: No such file or directory

from here: https://hypernews.cern.ch/HyperNews/CMS/get/crabFeedback/2756/1/1.html

# yum install openssl097a
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package openssl097a.x86_64 0:0.9.7a-9.el5_2.1 set to be updated
---> Package openssl097a.i386 0:0.9.7a-9.el5_2.1 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin

Dependencies Resolved

===========================================================================================================================================================================
 Package                                  Arch                                Version                                        Repository                               Size
===========================================================================================================================================================================
Installing:
 openssl097a                              i386                                0.9.7a-9.el5_2.1                               sl53update                              825 k
 openssl097a                              x86_64                              0.9.7a-9.el5_2.1                               sl53base                                824 k

[..]
Complete!

Trying again:

#crab -submit
crab:  Version 2.6.6 running on Thu Jan 14 10:09:11 2010 CET (09:09:11 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_100849/

crab:  Checking available resources...
crab:  Found  compatible site(s) for job 1
crab:  1 blocks of jobs will be submitted
Traceback (most recent call last):
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 878, in ?
    crab.run()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 812, in run
    if act in self.actions.keys(): self.actions[act].run()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Submitter.py", line 111, in run
    njs = self.perfromSubmission(list_matched, task)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Submitter.py", line 200, in perfromSubmission
    common.scheduler.submit(self.sub_jobs[ii],task)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Scheduler.py", line 311, in submit
    self.boss().submit(task['id'],sub_list,req)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/Boss.py", line 131, in submit
    task_sub =  self.schedSession().submit( taskId, jobsList,req )
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/API/BossLiteAPISched.py", line 129, in submit
    self.scheduler.submit( task, requirements )
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/Scheduler.py", line 62, in submit
    self.parameters['config'], self.parameters['service']\
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 548, in submit
    endpoints = self.wmsResolve( endpoints )
  File "/shome/leo/SL5Test/CRAB_2_6_6/external/ProdCommon/BossLite/Scheduler/SchedulerGLiteAPI.py", line 333, in wmsResolve
    wmsList.append(pre + socket.gethostbyaddr( wms )[0] + post)
socket.herror: (2, 'Host name lookup failure')

???

Testing with crab server:

# crab -submit
crab:  Version 2.6.6 running on Thu Jan 14 10:13:01 2010 CET (09:13:01 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              ON
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_101228/

Traceback (most recent call last):
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 877, in ?
    crab.initialize_(options)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 166, in initialize_
    self.initializeActions_(opts)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab.py", line 543, in initializeActions_
    self.actions[opt] = SubmitterServer(self.cfg_params, self.parseRange_(val), val)
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/SubmitterServer.py", line 24, in __init__
    self.copyTout= setLcgTimeout()
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab_util.py", line 692, in setLcgTimeout
    if checkLcgUtils() >= 17: opt=' --connect-timeout 600 '
  File "/shome/leo/SL5Test/CRAB_2_6_6/python/crab_util.py", line 684, in checkLcgUtils
    num_ver = int(temp[0])*10
ValueError: invalid literal for int(): cp: error while loading shared libraries: libldap

Damn, I forgot the magic dependency package!

https://twiki.cern.ch/twiki/bin/view/LCG/SL5DependencyRPM

https://hypernews.cern.ch/HyperNews/CMS/get/crabFeedback/2757.html

So:

# yum install HEP_OSlibs_SL5
Loaded plugins: kernel-module
Setting up Install Process
Parsing package install arguments
Resolving Dependencies
--> Running transaction check
---> Package HEP_OSlibs_SL5.x86_64 0:1.0.1-0 set to be updated
filelists.xml.gz                                                                                                                                    | 3.9 MB     00:00
filelists.xml.gz                                                                                                                                    |  344 B     00:00
[..]
Dependencies Resolved

===========================================================================================================================================================================
 Package                                        Arch                             Version                                        Repository                            Size
===========================================================================================================================================================================
Installing:
 HEP_OSlibs_SL5                                 x86_64                           1.0.1-0                                        HEP_OSlibs                           8.0 k
Installing for dependencies:
 alsa-lib                                       i386                             1.0.17-1.el5                                   sl53base                             412 k
 bzip2-libs                                     i386                             1.0.3-4.el5_2                                  sl53base                              37 k
 compat-db                                      i386                             4.2.52-5.1                                     sl53base                             1.7 M
 compat-glibc                                   x86_64                           1:2.3.4-2.26                                   sl53base                             1.5 M
 compat-glibc                                   i386                             1:2.3.4-2.26                                   sl53base                             1.0 M
 compat-glibc-headers                           x86_64                           1:2.3.4-2.26                                   sl53base                             481 k
 compat-libf2c-34                               i386                             3.4.6-4                                        sl53base                              52 k
 compat-libf2c-34                               x86_64                           3.4.6-4                                        sl53base                              56 k
 compat-libstdc++-33                            i386                             3.2.3-61                                       sl53base                             232 k
 compat-openldap                                i386                             2.3.43_2.2.29-3.el5                            sl53base                             257 k
 compat-openldap                                x86_64                           2.3.43_2.2.29-3.el5                            sl53base                             263 k
 compat-readline43                              i386                             4.3-3                                          sl53update                           102 k
 compat-readline43                              x86_64                           4.3-3                                          sl53base                             106 k
 fontconfig                                     i386                             2.4.1-7.el5                                    sl53base                             174 k
 freetype                                       i386                             2.2.1-21.el5_3                                 sl53update                           310 k
 giflib                                         i386                             4.1.3-7.1.el5_3.1                              sl53update                            39 k
 gmp                                            i386                             4.1.4-10.el5                                   sl53base                             664 k
 libXcursor                                     i386                             1.1.7-1.1                                      sl53base                              32 k
 libXfixes                                      i386                             4.0.1-2.1                                      sl53base                              14 k
 libXft                                         i386                             2.1.10-1.1                                     sl53base                              44 k
 libXinerama                                    i386                             1.0.1-2.1                                      sl53base                             9.7 k
 libXmu                                         i386                             1.0.2-5                                        sl53base                              62 k
 libXp                                          i386                             1.0.0-8.1.el5                                  sl53base                              22 k
 libXpm                                         i386                             3.5.5-3                                        sl53base                              45 k
 libXrandr                                      i386                             1.1.1-3.1                                      sl53base                              15 k
 libXrender                                     i386                             0.9.1-3.1                                      sl53base                              27 k
 libXtst                                        i386                             1.0.1-3.1                                      sl53base                              15 k
 libgfortran                                    i386                             4.1.2-44.el5                                   sl53base                             231 k
 libjpeg                                        i386                             6b-37                                          sl53base                             139 k
 libpng                                         i386                             2:1.2.10-7.1.el5_3.2                           sl53base                             244 k
 libtiff                                        i386                             3.8.2-7.el5_3.4                                sl53update                           306 k
 libxml2-devel                                  i386                             2.6.26-2.1.2.8                                 sl53update                           2.1 M
 openmotif                                      i386                             2.3.1-2.el5                                    sl53base                             1.5 M
 openmotif22                                    i386                             2.2.3-18                                       sl53base                             1.3 M
 openmotif22                                    x86_64                           2.2.3-18                                       sl53base                             1.3 M
 sqlite                                         i386                             3.3.6-2                                        sl53base                             213 k

Transaction Summary
===========================================================================================================================================================================
Install     37 Package(s)
Update       0 Package(s)
Remove       0 Package(s)

[...]
Complete!

Trying again with CRAB server:

# crab -submit
crab:  Version 2.6.6 running on Thu Jan 14 10:23:49 2010 CET (09:23:49 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              ON
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102300/

crab:  Registering credential to the server : crab1.ba.infn.it
crab:  Credential successfully delegated to the server.

crab:  Starting sending the project to the storage dot1-prod-2.ba.infn.it...

crab: ERROR : Unable to create SE destination interface
Project leo_crab_0_100114_102300_87dsg5 not Submitted

Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102300/log/crab.log

Can be a SE misconfiguration, checking later

Trying with Stand Alone submission:

# crab -create -submit
crab:  Version 2.6.6 running on Thu Jan 14 10:26:00 2010 CET (09:26:00 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/

crab:  Contacting Data Discovery Services ...
crab:  Requested dataset: /MinimumBias/BeamCommissioning09-CSCSkim_BeamHalo_MinBias-Dec19thSkim_341_v2/RAW-RECO has 6403 events in 1 blocks.

crab:  May not create the exact number_of_jobs requested.
crab:  5 job(s) can run on 10 events.

crab:  List of jobs and available destination sites:

Block     1: jobs                  1-5: sites: T2_US_Purdue, T2_US_UCSD, T2_US_Florida, T2_DE_RWTH, T2_IT_Pisa, T2_US_Nebraska

crab:  Creating 5 jobs, please wait...
crab:  Total of 5 jobs created.

crab:  Checking available resources...
crab:  Found  compatible site(s) for job 1
crab:  1 blocks of jobs will be submitted
crab:  Total of 5 jobs submitted.
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log

sounds good.

Checking job status:

crab -status
crab:  Version 2.6.6 running on Thu Jan 14 11:01:57 2010 CET (10:01:57 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/

crab:  Checking the status of all jobs: please wait
crab:
ID     STATUS             E_HOST                               EXE_EXIT_CODE JOB_EXIT_STATUS
--------------------------------------------------------------------------------------------
1      Ready              grid-ce.physik.rwth-aachen.de
2      Ready              grid-ce.physik.rwth-aachen.de
3      Ready              grid-ce.physik.rwth-aachen.de
4      Ready              grid-ce.physik.rwth-aachen.de
5      Ready              grid-ce.physik.rwth-aachen.de

crab:   5 Total Jobs
>>>>>>>>> 5 Jobs Ready
        List of jobs Ready: 1-5

crab:  You can also follow the status of this task on :
        CMS Dashboard: http://dashb-cms-job-task.cern.ch/taskmon.html#task=leo_crab_0_100114_102558_08nq4p
        Your task name is: leo_crab_0_100114_102558_08nq4p

Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log

OK. Getting back the jobs:

# crab -getoutput
crab:  Version 2.6.6 running on Thu Jan 14 11:19:11 2010 CET (10:19:11 UTC)

crab. Working options:
        scheduler           glite
        job type            CMSSW
        server              OFF
        working directory   /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/

crab:  Results of Jobs # 1 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab:  Results of Jobs # 2 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab:  Results of Jobs # 3 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab:  Results of Jobs # 4 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
crab:  Results of Jobs # 5 are in /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/res/
Log file is /shome/leo/SL5Test/TestCMSSW/CMSSW_3_4_1/src/crab_0_100114_102558/log/crab.log

Ok, it does work!

UI 3.1 installation on t3wn08 (SL5)

In the system with the packages installed above.

# ssh t3wn08 /bin/bash --noprofile
# cd /shome/leo/gLite/glite-UI-3.1.43-0-SL5
# tar xvzf glite-UI-3.1.43-0.tar.gz
# tar xvzf glite-UI-3.1.43-0-external.tar.gz
# glite/yaim/bin/yaim -v -s site-info.def -n UI_TAR
   WARNING:
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING:
   INFO: Using site configuration file: site-info.def
   INFO:
         ###################################################################

         .             /'.-. ')
         .     yA,-"-,( ,m,:/ )   .oo.     oo    o      ooo  o.     .oo
         .    /      .-Y a  a Y-.     8. .8'    8'8.     8    8b   d'8
         .   /           ~ ~ /         8'    .8oo88.     8    8  8'  8
         . (_/         '===='          8    .8'     8.   8    8  Y   8
         .   Y,-''-,Yy,-.,/           o8o  o8o    o88o  o8o  o8o    o8o
         .    I_))_) I_))_)


         current working directory: /shome/leo/gLite/glite-UI-3.1.43-0-SL5
         site-info.def date: Jan 14 11:03 site-info.def
         yaim command: -v -s site-info.def -n UI_TAR
         log file: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/bin/../log/yaimlog
         Thu Jan 14 11:08:53 CET 2010 : glite/yaim/bin/yaim

         Installed YAIM versions:
         glite-yaim-clients 4.0.8-7
         glite-yaim-core 4.0.8-7

         ####################################################################
   INFO: The default location of the grid-env.(c)sh files will be: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/external/etc/profile.d
   INFO: Sourcing the utilities in /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/functions/utils
   INFO: Detecting environment
   INFO: Executing function: config_certs_userland_check
   INFO: Executing function: config_sysconfig_lcg_check
   INFO: Executing function: config_globus_clients_check
   INFO: Executing function: config_lcgenv_check
   INFO: Executing function: config_rgma_client_check
   INFO: Executing function: config_workload_manager_client_check
   INFO: Executing function: config_amga_client_check
   INFO: Executing function: config_gsissh_check
   INFO: Executing function: config_glite_ui_check
   INFO: Executing function: config_ui_tar_check
   INFO: Executing function: config_vomses_check
   INFO: Executing function: config_vomsdir_check
   INFO: Executing function: config_globus_devel_check
   INFO: Checking is done.
   INFO: All the necessary variables to configure UI_TAR are defined in your configuration files.
   INFO: Please, bear in mind that YAIM only guarantees the definition of variables
   INFO: controlled in the _check functions.
   INFO: YAIM terminated succesfully.


# glite/yaim/bin/yaim -c -s site-info.def -n UI_TAR
   WARNING:
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING:
   INFO: Using site configuration file: site-info.def
   INFO:
         ###################################################################

         .             /'.-. ')
         .     yA,-"-,( ,m,:/ )   .oo.     oo    o      ooo  o.     .oo
         .    /      .-Y a  a Y-.     8. .8'    8'8.     8    8b   d'8
         .   /           ~ ~ /         8'    .8oo88.     8    8  8'  8
         . (_/         '===='          8    .8'     8.   8    8  Y   8
         .   Y,-''-,Yy,-.,/           o8o  o8o    o88o  o8o  o8o    o8o
         .    I_))_) I_))_)


         current working directory: /shome/leo/gLite/glite-UI-3.1.43-0-SL5
         site-info.def date: Jan 14 11:03 site-info.def
         yaim command: -c -s site-info.def -n UI_TAR
         log file: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/bin/../log/yaimlog
         Thu Jan 14 11:09:50 CET 2010 : glite/yaim/bin/yaim

         Installed YAIM versions:
         glite-yaim-clients 4.0.8-7
         glite-yaim-core 4.0.8-7

         ####################################################################
   INFO: The default location of the grid-env.(c)sh files will be: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/external/etc/profile.d
   INFO: Sourcing the utilities in /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/yaim/functions/utils
   INFO: Detecting environment
   INFO: Executing function: config_certs_userland_check
   INFO: Executing function: config_sysconfig_lcg_check
   INFO: Executing function: config_globus_clients_check
   INFO: Executing function: config_lcgenv_check
   INFO: Executing function: config_rgma_client_check
   INFO: Executing function: config_workload_manager_client_check
   INFO: Executing function: config_amga_client_check
   INFO: Executing function: config_gsissh_check
   INFO: Executing function: config_glite_ui_check
   INFO: Executing function: config_ui_tar_check
   INFO: Executing function: config_vomses_check
   INFO: Executing function: config_vomsdir_check
   INFO: Executing function: config_globus_devel_check
   INFO: Executing function: config_certs_userland_setenv
   INFO: Executing function: config_certs_userland
   INFO: Certificates found in /etc/grid-security/certificates or in $X509_CERT_DIR. Not installing relocated version.
   INFO: Executing function: config_crl
   INFO: Executing function: config_sysconfig_edg
   INFO: Executing function: config_sysconfig_globus
   INFO: Executing function: config_sysconfig_lcg
   INFO: Executing function: config_globus_clients_setenv
   INFO: Executing function: config_globus_clients
   INFO: Configure the globus service
setup-tmpdirs: creating ./config.status
config.status: creating globus-script-initializer
config.status: creating Paths.pm
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
creating globus-sh-tools-vars.sh
creating globus-script-initializer
creating Globus::Core::Paths
checking globus-hostname
Done
   INFO: Executing function: config_lcgenv
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
   INFO: Executing function: config_rgma_client_setenv
   INFO: Executing function: config_rgma_client
   INFO: YAIM has detected the OS is SL5. The rgma client is no longer configured in SL5.
   INFO: Executing function: config_workload_manager_client_setenv
   INFO: Executing function: config_workload_manager_client
   INFO: Executing function: config_fts_client
   INFO: Executing function: config_amga_client_setenv
   INFO: Executing function: config_amga_client
   INFO: Executing function: config_gsissh_setenv
   INFO: Executing function: config_gsissh
Configuring gsi_openssh
------------------------------------------------------------
Executing...
chmod: changing permissions of `/tmp/glite/glite-ui': Operation not permitted
chmod: changing permissions of `/tmp/jobOutput': Operation not permitted

Notes:

  o Privilege separation is on.
  o GSI-OpenSSH website is <http://grid.ncsa.uiuc.edu/ssh/>.
------------------------------------------------------------
Finished configuring gsi_openssh.
   INFO: Executing function: config_glite_ui_setenv
   INFO: Executing function: config_glite_ui
   WARNING: The file /tmp/jobOutput specified in the variable OUTPUT_STORAGE doesn't exist
   WARNING: The user is responsible for creating this file !
   INFO: Executing function: config_ui_tar_setenv
   INFO: Executing function: config_ui_tar
   INFO: Executing function: config_vomses
   INFO: Executing function: config_vomsdir_setenv
   INFO: Executing function: config_vomsdir
   INFO: Executing function: config_globus_devel_setenv
Subroutine Compress::Zlib::gzFile::gzseek redefined at /usr/lib/perl5/vendor_perl/5.8.8/Compress/Zlib.pm line 219.
   INFO: Executing function: config_globus_devel
gzdopen_ is not a valid Zlib macro at /shome/leo/gLite/glite-UI-3.1.43-0-SL5/gpt/lib/perl/Archive/Tar.pm line 250
   INFO: Configuration Complete.                                               [  OK  ]
   INFO: YAIM terminated succesfully.

Usual tests:

source /shome/leo/gLite/glite-UI-3.1.43-0-SL5/etc/profile.d/grid-env.sh

voms-proxy-init -voms cms : OK

voms-proxy-info -all : OK

glite-wms-job-submit -a GridTests/hostname.jdl

Connecting to the service https://grid-wms11.desy.de:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://grid-lb1.desy.de:9000/I6oZ4p5FoKfDCoHUSHFnVQ

==========================================================================

glite-wms-job-status https://grid-lb1.desy.de:9000/I6oZ4p5FoKfDCoHUSHFnVQ
Traceback (most recent call last):
  File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/bin/glite-wms-job-status", line 31, in ?
    import UIutils
  File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/python/UIutils.py", line 23, in ?
    from glite_wmsui_UcWrapper import UCredential
  File "/shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/python/glite_wmsui_UcWrapper.py", line 5, in ?
    import _glite_wmsui_UcWrapper
ImportError: /shome/leo/gLite/glite-UI-3.1.43-0-SL5/glite/lib/_glite_wmsui_UcWrapper.so: wrong ELF class: ELFCLASS32

sigh...

Testing CRAB+CMSSW, again on t3wn08

Using gLite 3.1 TAR_UI installed on SLC5

# source gLite/glite-UI-3.1.43-0-SL5/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# eval `scramv1 ru -sh`
# export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib

crab -create: OK

crab -submit: OK

crab -status: OK

crab -getoutput: OK

SE tests

srmls

srmls srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root
WARNING: SRM_PATH is defined, which might cause a wrong version of srm client to be executed
WARNING: SRM_PATH=/shome/leo/gLite/glite-UI-3.1.43-0-SL5/d-cache/srm
  987438028 /pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root

srmcp

srmcp -2 srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root file:///`pwd`/test.root
WARNING: SRM_PATH is defined, which might cause a wrong version of srm client to be executed
WARNING: SRM_PATH=/shome/leo/gLite/glite-UI-3.1.43-0-SL5/d-cache/srm

cmsRun

using as input file dcap://t3se01.psi.ch:22125/pnfs/psi.ch/cms/trivcat//store/mc/Summer09/Zee/AODSIM/MC_31X_V3_AODSIM-v1/0021/949FFA36-6F87-DE11-A51E-00304820A72D.root : OK

CMSSW 32 bit on SLC5

On t3wn08, export SCRAM_ARCH=slc4_ia32_gcc345 and then source the normal CMSSW env.

Test with cmsRun PAT1.py CMSSW_3_3_2: OK

Summarizing

Packages to be installed on t3wn08 (SLC5):

  • the magic one, HEP_OSlibs_SL5
  • If not installed by the magic one, install
    libxml2  curl.i386 openssl097a 

To have CRAB_2_6_6 working on t3wn08 do:

# source gLite/glite-UI-3.1.43-0/etc/profile.d/grid-env.sh
# source ~/SL5Test/CRAB_2_6_6/crab.sh
# source SL5Test/cms/cmsset_default.sh
# cd ~/SL5Test/TestCMSSW/CMSSW_3_4_1/src
# eval `scramv1 ru -sh`
# export PYTHONPATH=${PYTHONPATH}:${GLITE_LOCATION}/lib

Here:

  • ~/gLite/glite-UI-3.1.43-0 is the dir where I've installed the TAR_UI
  • ~/SL5Test/cms is the dir where I've installed the CMS SW
  • ~/SL5Test/TestCMSSW/CMSSW_3_4_1 is where I've installed my scram local working area

-- LeonardoSala - 13-Jan-2010

Edit | Attach | Watch | Print version | History: r8 < r7 < r6 < r5 < r4 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r8 - 2010-07-15 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback