CosmicSimValidation < Main

Main Web>TWikiUsers>JamieBoyd>JamiesWiki>HowToSimulateCosmics>HowToSimulateCosmicIn1250>CosmicSimulationSamples>CosmicSimulationSamplesRel14>CosmicSimHowTo>CosmicSimValidation (2009-06-02, AndreasKorn) (raw view)
EditAttachPDF
-- Main.AndreasKorn - 16 Apr 2009
 
---+ Validation Samples

A small 10k cosmic sample has been simulated and digitized with release AtlasProduction 14.5.1.4 and reconstructed with 14.5.2.Y_rel_5
plus fixes.
The samples make use of the new TRT selection volume that includes the endcap region. Geometry tag ATLAS-GEO-07-00-00 with field on was used.
The produced RDO  & ESD files are available here: <verbatim>
/castor/cern.ch/grid/atlas/atlasgroupdisk/proj-simcos/rel14/ATLAS-GEO-07-00-00</verbatim>
Commissioning ntuples are also availble: <verbatim>/afs/cern.ch/user/g/gencomm/w0/korn/ESD2/[1-9]*/myCommission*root</verbatim>
---+++++ List of Fixes (Recipe)
See [[CosmicSimHowTo][Jamies Page here]]:
<verbatim>
cmt co -r TRT_DriftFunctionTool-00-01-27-01 InnerDetector/InDetRecTools/TRT_DriftFunctionTool
cmt co -r SiLorentzAngleSvc-00-00-07-02 InnerDetector/InDetConditions/SiLorentzAngleSvc  
cmt co -r RecExCommission-00-04-00-02  Reconstruction/RecExample/RecExCommission
cmt co -r TrackIsolationTools-00-05-05-01  Reconstruction/RecoTools/TrackIsolationTools 
cmt co -r MuonIsolationTools-00-07-15-01 Reconstruction/MuonIdentification/MuonIsolationTools
cmt co -r InDetRecExample-01-16-07-15 InnerDetector/InDetExample/InDetRecExample  
cmt co -r TrigT1CaloMonitoring-00-04-10-01 /Trigger/TrigT1/TrigT1CaloMonitoring
cmt co -r TrigT1Monitoring-00-00-22-01 /Trigger/TrigT1/TrigT1Monitoring  
cmt co -r TileEvent-00-08-12 /TileCalorimeter/TileEvent
cmt co -r TileEventAthenaPool-00-04-07 /TileCalorimeter/TileSvc/TileEventAthenaPool
</verbatim>

---+ Validation Monitoring Plots
DQMF monitoring plots have been produced:

   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/330/IDCosmic/run_9/run/][new MC with standard reference]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/][new MC with old MC reference]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/330/IDCosmic/run_1/run/][old MC with standard reference]]

a good data run using the new reprocessing for comparison can be found 
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run/][here]]

The reconstruction has been retested with 14.5.2.10 plus fixes (to become 14.5.2.11):
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/339/IDCosmic/run_9/][new MC with new MC older reco as reference]]
The first produced digits (no field, Pixel volume: ) have been reconstructed with 14.5.2.10:
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/300/IDCosmic/run_108864/run/index.html][official MC digits, bad reference]]
a possible nofield data run  using the new reprocessing for comparison can be found [[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_96732/][here]] 

---+++ Official Production Samples
Monitoring is available for the [[https://twiki.cern.ch/twiki/bin/view/Main/CosmicSimFirstProduction][official production samples]].
As reference the old official MC and the validation MC have been used. Data reference are from runs 91890 and 96903.
   *  run108867.CosSimIDVolSolOnTorOn [[http://atlasdqm.web.cern.ch/atlasdqm/test/8/IDCosmic/run_108867/run/][old MC reference]] [[http://atlasdqm.web.cern.ch/atlasdqm/test/10/IDCosmic/run_108867/run/][new MC reference]]

---+++++ The new larger size IDVol samples 
Files used:

689 for valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s540_d167_r676_tid067157<BR>
693 for valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s541_d168_r677_tid067158

   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/432/IDCosmic/run_108866/run/][valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s541_d168_r677_tid067158 ref: run 96903]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/431/IDCosmic/run_108866/run/][valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s541_d168_r677_tid067158 ref: new MC]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/430/IDCosmic/run_108866/run/][valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s541_d168_r677_tid067158 ref: old MC]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/432/IDCosmic/run_108867/run/][valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s540_d167_r676_tid067157 ref: run 91890]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/431/IDCosmic/run_108867/run/][valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s540_d167_r676_tid067157 ref: new MC]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/430/IDCosmic/run_108867/run/][valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s540_d167_r676_tid067157 ref: old MC]]


---+++++ Latest Production Sample, please use this!
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108864/run/][valid2.108864.CosSimPixVolSolOffTorOff.recon.HIST.s532_d168_r677_tid065079]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108865/run/][valid2.108865.CosSimPixVolSolOnTorOn.recon.HIST.s531_d167_r676]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108866/run/][valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s534_d168_r677_tid065082]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108867/run/][valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s533_d167_r676_tid065083]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108868/run/][valid2.108868.CosSimMuonVolSolOffTorOff.recon.HIST.s536_d168_r677_tid065080]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/410/IDCosmic/run_108869/run/][valid2.108869.CosSimMuonVolSolOnTorOn.recon.HIST.s535_d167_r676_tid065081]]

---+++++ Older Reconstruction Interation, please don't use!
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108864/run/][valid2.108864.CosSimPixVolSolOffTorOff.recon.HIST.s532_d168_r671_tid064236]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108865/run/][valid2.108865.CosSimPixVolSolOnTorOn.recon.HIST.s531_d167_r670_tid064235]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108866/run/][valid2.108866.CosSimIDVolSolOffTorOff.recon.HIST.s534_d168_r671_tid064239]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108867/run/][valid2.108867.CosSimIDVolSolOnTorOn.recon.HIST.s533_d167_r670_tid064240]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108868/run/][valid2.108868.CosSimMuonVolSolOffTorOff.recon.HIST.s536_d168_r671_tid064237]]
   * [[http://atlasdqm.web.cern.ch/atlasdqm/test/400/IDCosmic/run_108869/run/][valid2.108869.CosSimMuonVolSolOnTorOn.recon.HIST.s535_d167_r670_tid064238]]
  


---+++ [[CosmicSimValidationTechnical][Technical Details]]
---+ Detailed Validation Comparisons
Tae Jeong and I looked through the produced plots and contacted experts.
An e-mail was send to tracking, muon and e-gamma performance convenors to ask for further comparisons.
Here we list observed differences between old and new MC with possible explanations.
Old MC refers to the [[CosmicSimulationSamplesRel14#ATLAS_GEO_03_00_00][ATLAS_GEO_03_00_00 TRT Barrel sample generated by Else and Jamie]]. Both MC samples were reconstructed
with 14.5.2.Y_rel_5.
When appropriate we also list comparisons between distributions in new MC and data.
 
---+++Pixel
---+++++Pixel Clusters
The [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run//InnerDetector/Pixel/PixelExpert/General/Offline_num_clusters_low_occupancy.html][number of pixel clusters]] is reduced and there are more [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/Pixel/PixelExpert/General/m_Pixel_track_clus_groupsize.html][larger clusters]] in the new MC. This is the expected behavior due to a fix in digitization, that spreads charge more evenly. 

---+++++Pixel Timing
The behavior in the old MC is not understood. In the new MC a [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run//InnerDetector/Pixel/PixelExpert/Timing/Offline_Lvl1A.html][propper peak]] as in data is observed.

---+++TRT
---+++++TRT hits on track
There is a [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run//InnerDetector/IDAlignment/Tracks_NoTriggerSelection/GenericTracks/Ntrthits_per_track.html][tendency towards fewer TRT hits on tracks]] in the new vs the old MC.
This is not fully explained yet, but thought to be related to the inclusion of the TRT endcap volume in filtering.

---+++++TRT occupancy
When comparing new with old MC, the TRT high occupancy is down for the barrel and up for the Endcap.
This is likely due to the different track illumination caused by the larger filter volume that includes TRT Endcaps.
Low threshold occupancy is dominated by noise and does not show this effect.
 [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/TRT/TRTB/hAvgHLOcc_A.html][Barrel A]]
 [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/TRT/TRTB/hAvgHLOcc_C.html][Barrel C]]
 [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/TRT/TRTEA/hAvgHLOcc_A.html][EndCap A]]
 [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/TRT/TRTEC/hAvgHLOcc_C.html][EndCap C]]

---+++++TRT rt relation
The [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run//InnerDetector/TRT/TRTB/hrtRelation.html][rt relation]]
seems consistent with xenon.

---+++++TRT eventphase
A difference between MC and data is observed in the 
[[http://atlasdqm.web.cern.ch/atlasdqm/test/330/IDCosmic/run_1/run/InnerDetector/TRT/TRTB/hEvtPhase.html][TRT eventphase]].
But it agrees with when comparing with the old 
[[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/InnerDetector/TRT/TRTB/hEvtPhase.html][MC]].

Explanation by Sasa and James: EP distribution is not simulated in MC, all tracks come at the same time within 3BC and the spread is 
only due to EP resolution.  The actual value does not matter so much as long as LE && TE distributions are reasonable?

---+++Muons
---+++++Muon phi reconstruction
[[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run//MuonTracks/ConvertedMBoy/NoMuonTriggerSelection/m_muon_receta_recphi.html][Changes in the phi distribution]] with respect to older reconstruction is due to an updated definition in the muon reco. The same can be observed for the [[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run/MuonTracks/ConvertedMBoy/NoMuonTriggerSelection/m_muon_receta_recphi.html][new data reprocessing]].

---+++++Muon number of chambers attached to tracks
The number of muon chambers  attached to the track is larger in the new MC than in data.
This is due to lower HV settings and chambers timing problems in the data.

[[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonCombined/Tracks/MuidContainer/muon_nphiCh.html][MC]]
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonCombined/Tracks/MuidContainer/muon_nphiCh.html][data]]
[[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonCombined/Tracks/StacoContainer/muon_nphiCh.html][MC]]
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonCombined/Tracks/StacoContainer/muon_nphiCh.html][data]]

This effect is a bit more clearer in the RPC plots here:

[[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCMiddle.html][MC]]
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCMiddle.html][data]]

[[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCOuter.html][MC]]
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCOuter.html][data]]

[[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonCombined/Tracks/MuidContainer/muon_nrpcPhiCh.html][MC]]
[[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonCombined/Tracks/MuidContainer/muon_nrpcPhiCh.html][data]]

  [[http://atlasdqm.web.cern.ch/atlasdqm/test/331/IDCosmic/run_9/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCOuter.html][MC]]
  [[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MuonDetectors/RPC/GLOBAL/GlobalHitsPerRPCOuter.html][data]]

---+++++Muon Chamber MDT residuals

Maria showed [[http://indico.cern.ch/subContributionDisplay.py?subContId=5&contribId=8&confId=49659][here]] a widening of MDT residuals.
I had a closer look and there seems to be also a problem with the  
[[http://atlasdqm.web.cern.ch/atlasdqm/test/432/IDCosmic/run_108867/run//MuonSegments/Moore/mdt_hitSignedRadius.html][drift radius]]
I suspected a t0 problem, Domizia explains, that t0 refinement has likely not been run for the simulation.
 
---+++ MET
There seems to be a change in MET reco as pointed out by Hideki.
This is due to the new muon angle definitions that is not propagated to th MET reco yet.
But the distributions seem to agree between [[http://atlasdqm.web.cern.ch/atlasdqm/test/332/IDCosmic/run_9/run/MissingEt/Expert/Sources/phi_MET_MuonBoy.html][old, new MC]] and [[http://atlasdqm.cern.ch/tier0/Cosmics08_r2/2/physics_IDCosmic/run_91890/run//MissingEt/Expert/Sources/phi_MET_MuonBoy.html][reprocessed data]].

TJ pointed out a 
[[http://atlasdqm.web.cern.ch/atlasdqm/test/432/IDCosmic/run_108867/run//Global/CaloCluster/m_dphi_trt_v_emGM.html][ difference between data and MC:]].
This is likely a selection effect due tracks away fro the interaction point, but needs to better understood.


---++++ magnetic field
Domizia calculated the bending power  and finds a disagreement between MC and data (3.2 Tm s 4.4 Tm and 4.6 Tm expected).
This could also explain differences in the angular distributions seen in the ID cosmics (taking shafts etc into account).
Checks are underway to see if this could be cured with the new GEO-06 field map ...
---+ Validation Analysis
A few selected people have been asked directly to test there analysis on the new sample.
A mail has been send tracking, muon and e-gamma performance convenors to ask for further comparisons.
*If you have contributions, please add them here!!!*
   * extrapolation of tracks for validation MC<br />
     <img src="%ATTACHURLPATH%/toppos_MCnew2.gif" alt="toppos_MCnew2.gif" width='348' height='336' />
   * extrapolation of tracks for official dataset valid2.108867.CosSimIDVolSolOnTorOn.recon.ESD.s533_d167_r676<br />
     <img src="%ATTACHURLPATH%/toppos_MC_108867.gif" alt="toppos_MC_108867.gif" width='348' height='336' />
   * From Tommaso: Pixel cluster size vs incidence angle on the module. The agreement with cosmics data is quite good.<br />
      [[%ATTACHURL%/LorentzDataVsSim26may.eps][LorentzDataVsSim26may.eps]]
      <img src="%ATTACHURLPATH%/LorentzDataVsSim26may-1.gif" alt="LorentzDataVsSim26may-1.gif" width='509' height='349' />

---+ Known Problems
   * possible event number overlap, due to bug in event offset setting 

---+ Release Tests
A variety of test were run to check fixes and qualify releases.
---++++ Simulation/Digitisation
   * 14.5.1.4  
   * 14.5.1.5  (XML trigger database problems)
   * 14.5.1.6
---++++ Reconstruction
   * 14.5.2.Y_rel_5 plus fixes:
   * 14.5.2.Y-VAL_rel_3
   * 14.5.2.Y-VAL_rel_4
   * 14.5.2.Y_rel_5
   * 14.5.2.10 (rare crashes in muon & egamma reco)
   * 14.5.2.10 plus fixes:
   * 14.5.2.11 (rare crashes in muon reco, calo entry layer not stored)
   * 14.5.2.11 plus fixes:

-- Main.AndreasKorn - 16 Apr 2009
-- Main.AndreasKorn - 28 Apr 2009
-- Main.AndreasKorn - 15 May 2009
 

   * [[%ATTACHURL%/LorentzDataVsSim26may.eps][LorentzDataVsSim26may.eps]]: LorentzDataVsSim26may.eps
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who
gif	LorentzDataVsSim26may-1.gif	r1	manage	73.9 K	2009-06-02 - 18:02	AndreasKorn
eps	LorentzDataVsSim26may.eps	r1	manage	24.6 K	2009-05-31 - 17:06	TommasoLari
gif	toppos_MC_108867.gif	r1	manage	47.1 K	2009-05-15 - 13:02	AndreasKorn
gif	toppos_MCnew2.gif	r1	manage	21.2 K	2009-04-16 - 13:51	AndreasKorn
Topic revision: r15 - 2009-06-02 - AndreasKorn
Main
Webs
Public webs
Welcome Guest
- Cern Search
- TWiki Search
- Google Search
Main All webs
Copyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback