TWiki> Main Web>TWikiUsers>KrzysztofCiba>DiracRequestDBContent (2011-03-22, KrzysztofCiba) EditAttachPDF

Location

RequestDB is hosted on volhcb23.cern.ch.

Database diagram

requestDB.png

All tables 

mysql> use RequestDB;
Database changed
mysql> show tables;
Tables_in_RequestDB
Channel
Channels
Datasets
FTSReq
FTSReqLogging
FileToCat
FileToFTS
Files
ReplicationTree
Requests
SubRequests

Channel (ca. 120k records)

Table description 

mysql> describe Channel;
Field Type Null Key Default Extra
ChannelID int(11) NO PRI NULL  
FileID int(11) NO PRI NULL  
Status varchar(32) NO MUL NULL  
SourceSE varchar(256) NO MUL NULL  
SourceSURL varchar(256) NO   NULL  
TargetSE varchar(256) NO MUL NULL  
TargetSURL varchar(256) NO   NULL  
FileSize bigint(20) NO   NULL  
Retries int(11) YES   0  
SchedulingTime datetime NO   NULL  
SchedulingTimeOrder double(11,3) NO   NULL  
LastUpdate datetime NO   NULL  
LastUpdateTimeOrder double(11,3) NO   NULL  
CompletionTime datetime YES   NULL   

mysql> select distinct Status from Channel;
Status
Done
Executing
Failed
Waiting
Waiting13
Waiting18
Waiting2
Waiting20
Waiting27
Waiting28
Waiting38
Waiting5
Waiting6

Indexes 

mysql> show index from Channel;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
Channel 0 PRIMARY 1 ChannelID A 19 NULL NULL   BTREE  
Channel 0 PRIMARY 2 FileID A 117929 NULL NULL   BTREE  
Channel 1 ChannelID 1 ChannelID A 144 NULL NULL   BTREE  
Channel 1 Status 1 Status A 8 NULL NULL   BTREE  
Channel 1 SourceSE 1 SourceSE A 10 NULL NULL   BTREE  
Channel 1 TargetSE 1 TargetSE A 8 NULL NULL   BTREE  

Typical record 

mysql> select * from Channel limit 1;
ChannelID FileID Status SourceSE SourceSURL TargetSE TargetSURL FileSize Retries SchedulingTime SchedulingTimeOrder LastUpdate LastUpdateTimeOrder CompletionTime
1 1397195 Done CERN-FAILOVER srm://srm-lhcb.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/lhcb/failover/lhcb/data/2010/DST/00008375/0005/00008375_00053810_2.EW.dst CERN-DST srm://srm-lhcb.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/lhcb/data/2010/DST/00008375/0005/00008375_00053810_2.EW.dst 49134737 36 2010-12-07 21:53:38 21758818.739 2010-12-07 23:27:04 21764424.717 2010-12-07 23:27:04

Channels (49 records)

Table desciption 

mysql> describe Channels;
Field Type Null Key Default Extra
ChannelID int(11) NO PRI NULL auto_increment
SourceSite varchar(32) NO PRI NULL  
DestinationSite varchar(32) NO PRI NULL  
Status varchar(32) NO   NULL  
FTSServer varchar(128) NO   NULL  
Files int(8) YES   50  
ChannelName varchar(32) YES   NULL   

mysql> select distinct Status from Channels;
Status
Active

The valid Status value could be also InActive.

Indexes 

mysql> show index from Channels;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
Channels 0 PRIMARY 1 ChannelID A 49 NULL NULL   BTREE  
Channels 0 PRIMARY 2 SourceSite A 49 NULL NULL   BTREE  
Channels 0 PRIMARY 3 DestinationSite A 49 NULL NULL   BTREE  

All records 

mysql> select * from Channels;
ChannelID SourceSite DestinationSite Status FTSServer Files ChannelName
1 CERN CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-CERN
2 CERN CNAF Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-CNAF
3 CERN GRIDKA Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-GRIDKA
4 CERN IN2P3 Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-IN2P3
5 CERN NIKHEF Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-NIKHEF
6 CERN PIC Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-PIC
7 CERN RAL Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CERN-RAL
8 CNAF CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-CERN
9 CNAF CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-CNAF
10 CNAF GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-GRIDKA
11 CNAF IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-IN2P3
12 CNAF NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-NIKHEF
13 CNAF PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-PIC
14 CNAF RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 CNAF-RAL
15 GRIDKA CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-CERN
16 GRIDKA CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-CNAF
17 GRIDKA GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-GRIDKA
18 GRIDKA IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-IN2P3
19 GRIDKA NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-NIKHEF
20 GRIDKA PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-PIC
21 GRIDKA RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 GRIDKA-RAL
22 IN2P3 CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-CERN
23 IN2P3 CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-CNAF
24 IN2P3 GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-GRIDKA
25 IN2P3 IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-IN2P3
26 IN2P3 NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-NIKHEF
27 IN2P3 PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-PIC
28 IN2P3 RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 IN2P3-RAL
29 NIKHEF CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-CERN
30 NIKHEF CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-CNAF
31 NIKHEF GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-GRIDKA
32 NIKHEF IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-IN2P3
33 NIKHEF NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-NIKHEF
34 NIKHEF PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-PIC
35 NIKHEF RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 NIKHEF-RAL
36 PIC CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-CERN
37 PIC CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-CNAF
38 PIC GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-GRIDKA
39 PIC IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-IN2P3
40 PIC NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-NIKHEF
41 PIC PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-PIC
42 PIC RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 PIC-RAL
43 RAL CERN Active https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-CERN
44 RAL CNAF Active https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-CNAF
45 RAL GRIDKA Active https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-GRIDKA
46 RAL IN2P3 Active https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-IN2P3
47 RAL NIKHEF Active https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-NIKHEF
48 RAL PIC Active https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-PIC
49 RAL RAL Active https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer 50 RAL-RAL

Datasets (empty!)

Table desciption 

mysql> describe Datasets;
Field Type Null Key Default Extra
SubRequestID int(11) NO   NULL  
Dataset varchar(255) NO PRI NULL  
Status varchar(32) NO PRI NEW  

FTSReq (ca. 100k records)

Table description 

mysql> describe FTSReq;
Field Type Null Key Default Extra
FTSReqID int(11) NO PRI NULL auto_increment
ChannelID int(11) NO PRI NULL  
Status varchar(32) YES MUL Submitted  
FTSGUID varchar(64) NO   NULL  
FTSServer varchar(255) NO   NULL  
SourceSE varchar(256) YES      
TargetSE varchar(256) YES      
NumberOfFiles int(11) YES   0  
TotalSize bigint(20) YES   0  
SubmitTime datetime NO   NULL  
LastMonitor datetime YES   NULL  
PercentageComplete float YES   0   

mysql> select distinct Status from FTSReq;
Status
Finished
Submitted

Indexes 

mysql> show index from FTSReq;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
FTSReq 0 PRIMARY 1 FTSReqID A 123745 NULL NULL   BTREE  
FTSReq 0 PRIMARY 2 ChannelID A 123745 NULL NULL   BTREE  
FTSReq 1 ChannelID 1 ChannelID A 285 NULL NULL   BTREE  
FTSReq 1 Status 1 Status A 11 NULL NULL YES BTREE  

Typical record 

mysql> select * from FTSReq limit 1;
FTSReqID ChannelID Status FTSGUID FTSServer SourceSE TargetSE NumberOfFiles TotalSize SubmitTime LastMonitor PercentageComplete
1 7 Finished 041ddd19-0250-11e0-ae99-fb422e02068f https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer CERN-FAILOVER RAL-DST 1 99237019 2010-12-07 22:19:11 2010-12-07 23:26:50 100

FTSReqLogging (ca. 1M records)

Table description 

mysql> describe FTSReqLogging;
Field Type Null Key Default Extra
FTSReqID int(11) NO   NULL  
Event varchar(100) YES   NULL  
EventDateTime datetime YES   NULL  

Indexes

Not present.

Typical record 

mysql> select * from FTSReqLogging limit 10000, 1;
FTSReqID Event EventDateTime
1084 0.0 2010-12-18 19:03:40

FileToCat (ca. 120k records)

Table description 

mysql> describe FileToCat;
Field Type Null Key Default Extra
FileID int(11) NO PRI NULL  
ChannelID int(11) NO PRI NULL  
LFN varchar(255) NO   NULL  
PFN varchar(255) NO   NULL  
SE varchar(255) NO   NULL  
Status varchar(255) NO PRI Executing  
SubmitTime datetime NO   NULL  
CompleteTime datetime YES   NULL   

mysql> select distinct Status from FileToCat;
Status
Executing
Waiting

Indexes 

mysql> show index from FileToCat;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
FileToCat 0 PRIMARY 1 FileID A 105849 NULL NULL   BTREE  
FileToCat 0 PRIMARY 2 ChannelID A 105849 NULL NULL   BTREE  
FileToCat 0 PRIMARY 3 Status A 105849 NULL NULL   BTREE  
FileToCat 1 ChannelID 1 ChannelID A 64 NULL NULL   BTREE  
FileToCat 1 Status 1 Status A 8 NULL NULL   BTREE  

Typical record 

mysql> select * from FileToCat limit 10, 1;
FileID ChannelID LFN PFN SE Status SubmitTime CompleteTime
1396855 43 /lhcb/data/2010/CHARMCONTROL.DST/00008384/0000/00008384_00000284_1.charmcontrol.dst srm://srm-lhcb.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/lhcb/data/2010/CHARMCONTROL.DST/00008384/0000/00008384_00000284_1.charmcontrol.dst CERN_M-DST Waiting 2010-12-07 21:54:22 NULL

FileToFTS (ca. 1.5M records)

Table description 

mysql> describe FileToFTS;
Field Type Null Key Default Extra
FileID int(11) NO PRI NULL  
FTSReqID varchar(64) NO PRI NULL  
ChannelID int(11) NO MUL NULL  
Status varchar(32) YES MUL Submitted  
Duration int(8) YES   0  
Reason varchar(511) YES   NULL  
Retries int(8) YES   0  
FileSize int(11) YES   0  
SubmissionTime datetime YES   NULL  
TerminalTime datetime YES   NULL   

mysql> select distinct Status from FileToFTS;
Status
Completed
Failed
Submitted

Indexes 

mysql> show index from FileToFTS;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
FileToFTS 0 PRIMARY 1 FileID A 27 NULL NULL   BTREE  
FileToFTS 0 PRIMARY 2 FTSReqID A 1567602 NULL NULL   BTREE  
FileToFTS 1 ChannelID 1 ChannelID A 27 NULL NULL   BTREE  
FileToFTS 1 Status 1 Status A 27 NULL NULL YES BTREE  

Typical record 

mysql> select * from FileToFTS limit 10, 1;
FileID FTSReqID ChannelID Status Duration Reason Retries FileSize SubmissionTime TerminalTime
1396847 10113 36 Failed 0 DESTINATION error during TRANSFER_PREPARATION phase: [NO_SPACE_LEFT] No space found with at least 44198739 bytes of unusedSize 0 43150163 2010-12-19 02:51:16 2010-12-19 02:51:51

Files (ca. 50k records)

Table description 

mysql> describe Files;
Field Type Null Key Default Extra
SubRequestID int(11) NO   NULL  
FileID int(11) NO PRI NULL auto_increment
Status varchar(32) NO PRI New  
LFN varchar(255) YES   NULL  
Size bigint(20) YES   NULL  
PFN varchar(255) YES   NULL  
GUID varchar(64) YES   NULL  
Md5 varchar(32) YES   NULL  
Addler varchar(32) YES   NULL  
Attempt varchar(32) YES   NULL  
Error varchar(255) YES   NULL   

mysql> select distinct Status from Files;
Status
Done
Failed
Scheduled
Waiting

Indexes 

mysql> show index from Files;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
Files 0 PRIMARY 1 FileID A 40902 NULL NULL   BTREE  
Files 0 PRIMARY 2 Status A 40902 NULL NULL   BTREE  
Files 1 Status 1 Status A 17 NULL NULL   BTREE  

Typical record 

mysql> select * from Files limit 40000, 1;
SubRequestID FileID Status LFN Size PFN GUID Md5 Addler Attempt Error
2249344 1598703 Waiting /lhcb/MC/MC10/LOG/00009454/0001/00009454_00012262.tar.gz NULL NULL NULL NULL NULL 1 NULL

ReplicationTree (ca. 3M records)

Table description 

mysql> describe ReplicationTree;
Field Type Null Key Default Extra
FileID int(11) NO   NULL  
ChannelID int(11) NO   NULL  
AncestorChannel varchar(8) NO   NULL  
Strategy varchar(32) YES   NULL  
CreationTime datetime NO   NULL   

mysql> select distinct Strategy from ReplicationTree;
Strategy
MinimiseTotalWait

Indexes

Not present.

Typical record 

mysql> select * from  ReplicationTree limit 100, 1;
FileID ChannelID AncestorChannel Strategy CreationTime
67 2 - MinimiseTotalWait 2010-02-17 21:26:10

Requests (ca. 40k records)

Table description 

mysql> describe Requests;
Field Type Null Key Default Extra
RequestID int(11) NO PRI NULL auto_increment
Status varchar(32) NO PRI Receiving  
RequestName varchar(128) NO PRI NULL  
JobID int(11) YES   NULL  
OwnerDN varchar(255) YES   NULL  
OwnerGroup varchar(32) YES   NULL  
DIRACSetup varchar(32) YES   NULL  
SourceComponent varchar(32) YES   NULL  
CreationTime datetime YES   NULL  
SubmissionTime datetime YES   NULL  
LastUpdate datetime YES   NULL   

mysql> select distinct Status from Requests;
Status
Done
Receiving
Waiting

Indexes 

mysql> show index from Requests;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
Requests 0 PRIMARY 1 RequestID A 45117 NULL NULL   BTREE  
Requests 0 PRIMARY 2 RequestName A 45117 NULL NULL   BTREE  
Requests 0 PRIMARY 3 Status A 45117 NULL NULL   BTREE  
Requests 1 Status 1 Status A 4 NULL NULL   BTREE  

Typical record 

mysql> select * from Requests limit 40000, 1;
RequestID Status RequestName JobID OwnerDN OwnerGroup DIRACSetup SourceComponent CreationTime SubmissionTime LastUpdate
1359568 Waiting 00009367_00047355_16178993.xml 16178993 /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=romanov/CN=427293/CN=Vladimir Romanovskiy lhcb_prod LHCb-Production NULL 2011-02-14 10:10:52 2011-02-14 10:11:01 2011-02-14 10:11:01

SubRequests (ca. 50k records)

Table description 

mysql> describe SubRequests;
Field Type Null Key Default Extra
RequestID int(11) NO MUL NULL  
SubRequestID int(11) NO PRI NULL auto_increment
Status varchar(32) NO PRI Receiving  
RequestType varchar(32) NO PRI NULL  
Operation varchar(32) YES   NULL  
Arguments blob YES   NULL  
ExecutionOrder int(11) NO   0  
SourceSE varchar(32) YES   NULL  
TargetSE varchar(255) YES   NULL  
Catalogue varchar(32) YES   NULL  
Error varchar(255) YES   NULL  
CreationTime datetime YES   NULL  
SubmissionTime datetime YES   NULL  
LastUpdate datetime YES MUL NULL   

mysql> select distinct Status from SubRequests;
Status
Assigned
Done
Waiting

Indexes 

mysql> show index from SubRequests;
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment
SubRequests 0 PRIMARY 1 SubRequestID A 20694 NULL NULL   BTREE  
SubRequests 0 PRIMARY 2 Status A 20694 NULL NULL   BTREE  
SubRequests 0 PRIMARY 3 RequestType A 20694 NULL NULL   BTREE  
SubRequests 1 Status 1 Status A 3 NULL NULL   BTREE  
SubRequests 1 RequestType 1 RequestType A 3 NULL NULL   BTREE  
SubRequests 1 RequestID 1 RequestID A 20694 NULL NULL   BTREE  
SubRequests 1 LastUpdate 1 LastUpdate A 20694 NULL NULL YES BTREE  

Typical record 

mysql> select * from SubRequests limit 40000, 1;
RequestID SubRequestID Status RequestType Operation Arguments ExecutionOrder SourceSE TargetSE Catalogue Error CreationTime SubmissionTime LastUpdate
1354168 2241732 Waiting logupload uploadLogFiles NULL 0 NULL LogSE NULL NULL 2011-02-13 11:52:55 2011-02-13 11:53:09 2011-02-13 11:53:09

-- KrzysztofCiba - 15-Feb-2011

Attachments Attachments
Topic attachments
I Attachment History Action Size Date Who Comment
JPEGjpeg requestDB.jpeg r4 r3 r2 r1 manage 197.8 K 2011-03-17 - 17:42 KrzysztofCiba  
PNGpng requestDB.png r6 r5 r4 r3 r2 manage 214.9 K 2011-03-22 - 11:38 KrzysztofCiba  
SVG (Scalable Vector Graphics)svg requestDB.svg r1 manage 64.8 K 2011-03-17 - 17:43 KrzysztofCiba  
Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2011-03-22 - KrzysztofCiba
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback