L1T known issues in 2016 to 2023 **Copy**

This pages collects all the information the L1T DPG group has in terms of known issues.


Run 3

2023

Muons

First run (fill) affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
367065 (8723) ------ ------ ------   ------ Many Muon Rate vs PU plots drop around 62 PU PFE elog
367661 (8784) ------ ------ ------ l1_hlt_collisions2023/v98 ------ EMTF BDT LUT update (lower pT scale) Fill 8784 CMSLITOPS-416
368216 (8850) ------ ------ ------ ------- ------ ME-1/1/23 is offline. Causes a dip in efficiency at eta < -1.6 & -2.6 < phi < -2.4 Fill 8850
367546 (8775) ------ ------ ------ ------- ------ ME-1/1/1 is offline. Causes a dip in efficiency at eta < -1.6 & -0.1 < phi < 0.1 Fill 8775
366396 (8637) ------ ------ ------ ------- ------ ME-4/2/4 is offline since 2023 run start. No visible effects on performance Fill 8637
368454 (8873) ------ ------ ------ ------- ------ SingleMu22 Rate vs. PU discontinuity JIRA
368336 (8860) ------ 368343 ------ ------- ------ Muon Efficiency Dip in Fill 8860 JIRA
368542 (8880) ------ ------ ------ ------- ------ ME-1/1/1 and a CPPF link in EMTFm3 is masked due to constant error state. CPPF link corresponds to phi = 2.5 in -1.6 < eta < -1.2. This was apparently a mistake, since masking a CSC chamber can impact CSCID=1 chamber in the same sector. Masking ME-1/1/1 caused ME-1/1/36 to lose occupancy as well, causing bigger inefficiency. Will be fixed after TS1 Fill 8880
368822 (8901) ------ ------ ------ ------- ------ VME crate had an issue and we see low occupancy in CSC chambers -2/2/33-36 in this run. On top of that ME-1/1/1 and ME-1/1/36 were already off before this run which is in the same eta/phi region as well. Fill 8901

Calo

First run (fill) affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
366530 (8653) ------ ------ ------ l1_hlt_collisions2023/v41 ------ Apply veto to first bunch before train (disabled before this run for 2023) Fill 8653
366749 (8676) ------ ------ ------ l1_hlt_collisions2023/v50 ------ Updated EG & tau LUTs, apply HB ZS (0.5GeV) at Layer 1 caloParams_2023_v0_1 Fill 8678
366873 (8695) 366895 (8696) ------ ------ l1_trg_collisions2023/v12 ------ HCAL timing scans during fills 8695,8696 JIRA
367296 (8740) ------ ------ ------ l1_hlt_collisions2023/v84 ------ Set prescale from 0 to 1 to correctly enable veto on first bunch before train (still disabled before this run for 2023) Fill 8740
367607 (8780) ------ ------ ------ l1_hlt_collisions2023/v95 ------ Update tau calibration & iso caloParams_2023_v0_2 Fill 8780
368229 (8853) ------ ------ ------ l1_trg_collisions2023/v25 ------ EG Rate vs. PU shifts due to ECAL transparency condition changes between fills L1TP slides JIRA
368822 (8901) ------ ------ ------ l1_hlt_collisions2023/v126 ------ Update L1T JECs DPG slides
368822 (8901) ------ ------ ------ l1_hlt_collisions2023/v126 ------ Update HCAL timing alignment JIRA

Menu

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
366350 ------ ------ ------ collisions2023/v36 ------ New L1 menu deployment 2023 v1_0_0 CMSLITDPG-1102
366869 366943 ------ ------ from collisions2023/v59 to collisions2023/v64 L1_DoubleLLPJet40, L1_HTT120_SingleLLPJet40, L1_HTT160_SingleLLPJet50, L1_HTT200_SingleLLPJet60, L1_HTT240_SingleLLPJet70 Increase ps value for LLP seed during 900 b HCAL Phase Scan CMSHLT-2776
366801 ------ ------ ------ collisions2023/v55 L1_DoubleMu0_Upt6_IP_Min1_Upt4, L1_DoubleMu0_Upt15_Upt7 Disabling displaced muon seeds due to high rate from EMTF CMSHLT-2777
366834 ------ ------ ------ collisions2023/v56 L1_DoubleJet_90_30_DoubleJet30_Mass_Min620 Enable L1_DoubleJet_90_30_DoubleJet30_Mass_Min620 CMSHLT-2775
367296 ------ ------ ------ collisions2023/v84 L1_FirstBunchBeforeTrain Unprescale L1_FirstBunchBeforeTrain CMSHLT-2796
367406 ------ ------ ------ collisions2023/v90 ------ New L1 menu deployment 2023 v1_1_0 CMSLITDPG-1102
367472 ------ ------ ------ collisions2023/v93 L1_DoubleMu0_Upt6_IP_Min1_Upt4, L1_DoubleMu0_Upt15_Upt7 Re-enabling BMTF based displaced muon seeds CMSHLT-2801

DQM

PR #41381 enables the Tau offline DQM plots.

PR introducing the switch to PUPPI jets has been put on hold until jet experts have the calibration code ready to be ported over.

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources

Others L1 related changes

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources

Others L1 unrelated changes that are of interest for us.

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
367765 ------ ------ ------ N/A N/A HCAL response corrs updated in Prompt (not at L1/HLT) HB energy scale down by 9%, much weaker effect elsewhere  
368557 ------ ------ ------ N/A N/A Update of the CHS JECs for prompt (fixing the previously missing L1 i.e. PU correction)  

2022

Muons

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
355100 359922 359924 ------ -------- ------ CSC misalignment causing efficiency drop in eta > 2.1 in EMTF. Fixed by deploying new LUTs on 06/10/2022 slides
355100 356619 356709 ------ all keys until l1_hlt_collisions2022/v156 ------ EMTF was not vetoing quality 0 LCTs. Causes efficiency drop around 1.5 < abs(eta) < 2.1 slides
355100 355463 355558 ------ all keys until l1_hlt_collisions2022/v103 ------ EMTF neighbor links were masked by mistake ------
355100 357900 359356 ------ ------------- ------ EMTF register configs had bit shift causing "use_gem" flag to be enabled by mistake. Results in efficiency drop in 1.6 < abs(eta) < 2.1 whenever GEM HV is on. Fixed on 26/09/2022 (during TS1) JIRA
355679 356135 356309 ------ from l1_hlt_collisions2022/v106 until l1_hlt_collisions2022/v132 (for EMTF) and l1_hlt_collisions2022/v159 (for OMTF) ------ Faulty CSC sector was masked in EMTF/OMTF. Efficiency drop in negative endcap phi = 1 slides
359569 360225 360270 ------ ------------- ------ CSC chambers ME+2/1/05 and ME+3/1/05 are disabled due to HV issue. Loss of EMTF efficiency at 1.6 < eta < 2.5 && 1.6 > phi > 1.3. Fixed on Oct 12th elog fix elog

Smaller EMTF issues and changes


First run affected Last run affected First run with fix Change date(s) Comments Extra resources
356712 ------- ------- ------ ------- ------ l1_hlt_collisions2022/v160: EMTF DAQ readout window reduced. No effect on performance just on DQM ------

CSC input

First run affected Last run affected First run with fix Change date(s) Comments Extra resources

CPPF input

First run affected Last run affected First run with fix Change date(s) Comments Extra resources

BMTF Kalman Filter


Calo

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
356382 ------ ------ ------ collisions2022/v138 ------ Update caloL2 MP firmware to v95 to fix LLP jet and MB eta restriction JIRA Fill 8063
356383 353386 ------ ------ collisions2022/v138 ------ Tested EG, tau & MET calibrations JIRA Fill 8063
356633 ------ ------ ------ collisions2022/v150 All Full 2022 calibrations deployed, corresponding to caloParams_2022_v0_4 Fill 8083
356695 ------ ------ ------ ------ All HCAL PFA1p deployed (1bx early) Fill 8085
356778 ------ ------ ------ ------ All HCAL PFA1p timing fix (1bx added to algo latency to match PFA2 latency) Fill 8091
359272 ------         ECAL pedestals update ( elog) Fill 8178
360334 ------ ------ ------ collisions2022/v250 All HCAL calibrations update CMSLITDPG-1021, significant increase in scale Fill 8264
361740 ------ ------ ------ ------ All HCAL calibrations update CMSLITDPG-1072, small decrease in scale Fill 8366
361766 ---- ----- ----- ----   ECAL inter-calibration constants update e-log validation slides Fill 8368 Nov. 8th
362154 ------ ------ ------ collisions2022/v330 All Update of JEC & EG calib + iso CMSLITDPG-1080. Corresponds to caloParams_2022_v0_5 Fill 8401
362352 ------ ------ ------ l1_hlt_collisions2022/v331 All EG calib + iso CMSHLT-2575. Rolling back to previous EG LUTs (both calib and iso) due to less than linear PU dependency of the EGiso seeds  
362695 ------ ------ ------ l1_hlt_collisions2022/v350 All HCAL conditions update CMSHLT-1082. Fill 8489
362596 362696 362698 ------ ------ LLP seeds The change in the Calo L1 6:1 LUT impacts the HCAL L1 LLP paths, resulted in 5 to 8 times higher rates for LLP seeds. CMSLITDPG-1083, CMSLITDPG-1084.  

Menu

First run affected Last run affected First run with fix Certification (golden json) Trigger key Path affected Comments Extra resources
Run 2 362657 362673 ------ collisions2022/v350   Removal of the PS counter reset at every LS CMSLITDPG-980
355100 362657 362673 ------ collisions2022/v350 L1_TripleMu_2SQ_1p5SQ_0OQ_Mass_Max12, L1_TripleMu_3SQ_2p5SQ_0OQ_Mass_Max12 Additional OS requirement in TripleMu seeds with invariant mass cut CMSLITDPG-980
360850     ------ collisions2022/v275 All Masking last empty bx before collision (possibly buggy)  
360327     ------ collisions2022/v248 L1_TripleMu_2SQ_1p5SQ_0OQ_Mass_Max12, L1_TripleMu_3SQ_2p5SQ_0OQ_Mass_Max12 Disabling L1_TripleMu_2SQ_1p5SQ_0OQ_Mass_Max12 due to high rate after TS1 CMSLITDPG-960
356041 359998 360012 ------ collisions2022/v242 L1_SingleMuShower_Nominal, L1_SingleMuShower_Tight Disabling (and later high PS) of the HMT seeds because of very high rate observed in data, that required an update of the CSC thresholds during TS1 CMSLITDPG-953
361464     ------ ? All Mask last empty bx before train so that bx1 is unprefirable. Mind that isolated bunches remain prefirable ! ELOG

DQM

CMSSW_12_4_11_patch1 which fixes some previously empty DQM plots for muon/MET/EG efficiencies was deployed around run 362585.

Run 2

2018

Muons

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
------ ------ ------ GOOD   EMTF From beginning of 2018, track-building window = 2 BX, fixed theta window hit matching bug. Presentation Rate impact (slide 15)
------ 315357 315361 GOOD   EMTF CPPF board +2 loaded with wrong firmware, sending high rates of noise. Excess SingleMu22 triggering for 75° < phi < 165°, efficiency expected to be OK. Slides
------ 315741 315764 GOOD   EMTF CPPF firmware bug, all CPPF digis corrupt. Expect 5% SingleMu efficiency loss in 1.2 < abs(eta) < 1.7. Slides
316664 316665 316666   l1_trg_collisions2018/v21 BMTF, OMTF Some issue with DTs and RPCs ... should update with details. BMTF OMTF
317295 317297 ------   l1_trg_collisions2018/v25 BMTF, OMTF Some issue with RPCs ... SingleMu22 rates spike. Rate vs. PU
------ ------ 318622 GOOD   EMTF Reduce theta window for eta > 1.6, modify track-building and quality for low quality tracks. Proposal Details Rate impact (p.15)
318653 317297 ------   omtf_base/v28 OMTF Test of the new OMTF firmware, higher then usual data-to-emualator discrepancies.  
318669 318670 ------   omtf_base/v28 OMTF Additionally to the above the RPC links disabled on the OMTF input, smaller OMTF efficiency.  
320007 320009 ------ BAD   EMTF Broken CSC links in ME+, missing tracks. EMTF report, Swatch report, L1 report, elog
321051 ------ ------ GOOD   All Luminosity scale shifted, causing apparent decrease in WBM rates for all paths SingleMu0_BMTF before after SingleEG28er1p5 before after SingleJet180er2p5 before after

321837 322243 ------ GOOD omtf_base/v31 OMTF OMTF firmrware update - changes that increase the OMTF efficiency in case of running without RPC https://its.cern.ch/jira/browse/CMSLITOPS-151 https://its.cern.ch/jira/browse/CMSLITOPS-161 http://cmsonline.cern.ch/cms-elog/1048924
323099 ------ ------ GOOD omtf_base/v35 OMTF OMTF firmrware update - algorithm v6, the eta assignment is improved, includes also changes that increase the OMTF efficiency in case of running without RPC https://its.cern.ch/jira/browse/CMSLITOPS-171 http://cmsonline.cern.ch/cms-elog/1064282 MKonecki.pdf
------ ------ 323693 GOOD emtf_base/v102 EMTF Small fix to theta and phi coordinate calculation for CSC LCTs in EMTF Presentation JIRA

Smaller EMTF issues and changes


CSC input

First run affected Last run affected First run with fix Change date(s) Comments Extra resources
316457 316655 316665 2018-05-16 / 2018-05-20 CSC chamber ME-1/1/21 corrupt wiregroup number, bad theta assignment for LCTs. Creates hole in efficiency for eta < -1.65, -165 < phi < -155 deg (-2.88 < eta < -2.71 rad). Chamber ME-4/1/21 is permanently dead, which exacerbates the inefficiency. JIRA Slide 15 Offline DQM Online DQM
316701 316792 316793 2018-05-21 / 2018-05-24 CSC chamber ME-1/1/21 corrupt wiregroup number, bad theta assignment for LCTs. Creates hole in efficiency for eta < -1.65, -165 < phi < -155 deg (-2.88 < eta < -2.71 rad). Chamber ME-4/1/21 is permanently dead, which exacerbates the inefficiency. JIRA Slide 15 Offline DQM Online DQM

CPPF input

First run affected Last run affected First run with fix Change date(s) Comments Extra resources
315738 315741 315764 2018-04-05 CPPF board -1 firmware loading failed, sending high rates of noise. No impact on EMTF rates or efficiency. Slides

BMTF Kalman Filter


Firmware versions

Version First run Change date Algo revision (hex) Comments Extra resources
v1.2 317505 2018-06-06      
v2.1 320399 2018-07-27      
v2.2a 321870 2018-08-27      
v2.3 322397 2018-09-07      
v2.4 323301 2018-09-22   Through run 323399 (TS2 ramp-up only)  
v2.5 324131 2018-10-05      
v2.7.1 324818 2018-10-17 93500160 "Final" Kalman version  

Calo

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
------ 315490 315506 GOOD l1_trg_collisions2018/v13 All Initial 2018 Layer-1 and Layer-2 calibs deployed, including ZS of low-ET ECAL TPs in TT 26-28. calol2_collisions2018/v18 = caloParams_2018_v1_1_ECALZS eLog
------ ------ 316455 GOOD calol2_collisions2018/v20 EG, jets Update EG iso, turn off HF JEC caloParams_2018_v1_1_ECALZS_noHFJEC_newEGIso eLog
------ 316441 316455 GOOD l1_trg_collisions2018/v21 EG, HF Jet EG Loose Isolation LUT fixed (no longer less efficient than Tight Iso for some PU), Layer-2 HF Jet scale factors set to 1.0. JIRA
------ ------ 316700 GOOD calol2_collisions2018/v21 EG Relax EG H/E cut in the barrel caloParams_2018_v1_2 eLog
------ 316667 316700 GOOD l1_trg_collisions2018/v22 EG H/E cut in barrel loosened from 2-4 to 2^-3. JIRA
316944 316944 316985 ??? l1_trg_collisions2018/v24 All 5/10 FEDs of the EE+ off. elog DQM Tau eff
317434 317434 ------ BAD l1_trg_collisions2018/v27 All HCAL out of the run JIRA
------ ------ 318182 GOOD calol2_collisions2018/v25 Tau Update tau iso caloParams_2018_v1_3 eLog
------ ------ 319549 GOOD l1_trg_collisions2018/v36 MET, jets HCAL apply TDC timing cuts in HF. 10 - 20% lower HF jet and MET rates, no efficiency loss. HCAL changes twiki Jet120_FWD rate vs. PU before after Slides
------ ------ 320268 GOOD l1_trg_collisions2018/v48 All HCAL update IsoTrack calibrations. Increased energy scale especially in endcap, 5 - 10% higher jet and MET rates. JIRA elog HCAL changes twiki Jet35 rate vs. PU before after
321051 ------ ------     All Luminosity scale shifted, causing apparent decrease in WBM rates for all paths SingleMu0_BMTF before after SingleEG28er1p5 before after SingleJet180er2p5 before after

Menu

First run affected Last run affected First run with fix Certification (golden json) Trigger key Path affected Comments Extra resources
------ 315974 316058 GOOD l1_hlt_collisions2018/v97 All L1T 2018 menu v1_0_0 deployed. GIT WBM
------ 316271 316361 GOOD l1_hlt_collisions2018/v113 All 2.2e34 column with higher thresholds on most paths replaced by previous 2.0e34 column. Before After
------ 316363 316377 GOOD l1_hlt_collisions2018/v115 All Fits to rate vs. PU plots in WBM updated with 2018 data. Before After
316457 316457 ------ GOOD l1_hlt_collisions2018/v119 All Special "HLTPhysics" path with many lower thresholds enabled from LS 19 - 130, PU around 50. Seed thresholds Column changes Menu rate Rate vs. PU
------ 316569 316590 GOOD l1_hlt_collisions2018/v123 EG, MET Thresholds lowered on Single(Iso)EG, DoubleEG, and MET paths in 2.0e34 column. Before After
------ 316879 316928 GOOD l1_hlt_collisions2018/v129 EG In columns <= 2.0e34, prescale factors lowered for L1_SingleEG8er2p5 (20 Hz --> 100 Hz), L1_SingleEG10er2p5 (70 Hz --> 350 Hz), and L1_SingleEG15er2p5 (200 Hz --> 400 Hz). JIRA
319941   ------   l1_hlt_collisions2018/v169 All

L1 menu updated from v1_0_0 to v2_0_0

Including 18 new seeds and lowering PS for an ALCA seed

JIRA1

JIRA2

321051 ------ ------     All Luminosity scale shifted, causing apparent decrease in WBM rates for all paths SingleMu0_BMTF before after SingleEG28er1p5 before after SingleJet180er2p5 before after

2017

Muons

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
294034 ------   GOOD   EMTF CSC chambers ME-1/1/34 and 35 killed by water leak. Hole in SingleMu triggering for eta < -1.6, -0.61 < phi < -0.26 (20°).  
294034 ------   GOOD   EMTF CSC chamber ME-2/1/03 dead. Reduced SingleMu efficiency for eta < -1.6, 0.61 < phi < 0.96 (20°).  
294034 300817 301046 GOOD   EMTF Corrupt LCTs from ME-1/1/06. Hole in SingleMu triggering for eta < -1.6, 0.78 < phi < 0.96 (10°).  
    296295 GOOD ugmt_base/v37 uGMT Activated uGMT eta/phi coordinate extrapolation to the vertex. Switch to "aggressive" cancel out tuning. cancel out slides
296443 301450 301452 GOOD   EMTF EMTF input link timing mis-configured in Cosmic runs, see non-uniform CSC LCT distributions    
    298653 GOOD   EMTF EMTF assigns SingleMu quality to station 2-3-4 tracks. Applied only in sector -6, reduces inefficiency near ME-1/1/34, and 35. slides
299297 300239 300240 GOOD   EMTF In ~1/2 of runs, EMTF receiving no LCTs from ME-1/1/23. Hole in SingleMu triggering for eta < -1.6, -2.53 < phi < -2.35 (10°).  
    300088 GOOD emtf_base/v35 EMTF EMTF assigns SingleMu quality to station 2-3-4 tracks in all sectors. JIRA
302216 ------   GOOD   EMTF EMTF sending pT = 0 tracks in -2.1 < eta < -1.7, thrown away by uGMT, do not fire trigger. Report
305033 305043 305044 BAD emtf_base/v43 EMTF EMTF buggy firmware resulting in 90% rate (and efficiency) drop for abs(eta) > 1.2 1 2 3
305044 305044 305045 GOOD   EMTF EMTF sectors +2 and +4 not building tracks (PC LUTs disappeared), 33% inefficiency for eta > +1.2. Report
306121 ------   GOOD   TwinMux Deployment in production of TwinMux configuration enabling RPC-only triggers in MB1 and MB2

Smaller EMTF issues and changes


CSC LCTs (see also CSC whiteboard)

First run affected Last run affected First run with fix Change date(s) Comments
300806 300816 300817 2017-08-09 (10) Chamber ME-1/1/08 (Sector 1b, Station 1, CSC ID 3) transmits no LCTs.

Calo

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
294034 304365 304366 GOOD calol2_algo_mp_egamma_collisions2017/v3 LooseIsoEG Slight inefficiency at high pT (~5%) related to potential saturated towers in isolation region. Does not affect IsoEG seeds.  

uGT

2016


Muons

First run affected Last run affected First run with fix Certification (golden json) L1 key Path affected Comments Extra resources
272022 272022   GOOD collisions2016_TSC/v42 All muons WBM rates through the roof, not clear why  
272922 272930   BAD collisions2016_TSC/v58 All muons L1 muon rates crazy, result of buggy HLT release  
273013 273063   BAD collisions2016_TSC/v58 All muons Sector +1 missing, 273017 and 273063 have excess rate in sector +1  
273290 273302   BAD collisions2016_TSC/v62 All muons OMTF Sector +4 phi stuck at 0  
    273423 GOOD   All muons BMTF fixed eta sign-reversal problem. In previous runs, some inefficiency because HLT could not match muons  
    273725 GOOD   Double muon OMTF fixed duplicate EMTF tracks. Reduced DoubleMu rates by removing false triggers from single muons  
    274094 GOOD   All muons OMTF FW change boosting efficiency. Not sure what the change was. Primarily affected abs(eta) ~ 1.2  
    274174 GOOD   All muons BMTF new pT assignment algorithm. Reduced rate, no noticeable effect on efficiency  
275289 275290   GOOD collisions2016_TSC/v90 OMTF muons 20% lower efficiency for OMTF muons caused by runs with high L1A rate  
    275890 GOOD collisions2016_TSC/v98 All muons OMTF small change (what?) to better match emulator. Small effect on rate and efficiency?  
275911 275931 275963 GOOD   - endcap muons, phi -45 to -15 CSC MPC board broken, not sending ME-1/1a hits to the OMTF, EMTF in sector 6  
  276097 276215 GOOD   None EMTF fixed DAQ output of LCTs, now matches CSCTF. No impact on tracks.    
  276831 276834 GOOD   None Output LCTs from CSCTF missing. Only affects re-emulation from CSCTF digis (OMTF).    
RunA 277166   GOOD   DoubleMuon (+Tag and Proble method) L1 muon efficiency drops for DoubleMuon trigger with both muons in the same sector in the EMTF. This bug invalidates efficiency measured with tag and probe method. More details in EndcapHighPtMuonEfficiencyProblem
    277166 GOOD   EMTF Only best-quality track in single sector / BX assigned pT. Others get pT = 0, discarded by uGMT.  
    277428 GOOD   EMTF Tracks mis-assigned with pT of track from same sector, previous BX.  
    277428 GOOD   EMTF pT LUT upgraded to v2, which removes outlier hit (LCT) in otherwise straight 4-hit tracks.  
277932 278092   GOOD   EMTF No LCTs from Sector +5, CSC ID 1, in Stations 1, 3, and 4. Low efficiency from -95 to -105 deg.    
277653 278018   GOOD   BMTF re-emulation BMTF DAQ not working. That means that we can not re-emulated these runs stating from the BMTF input collection.    
    278175 -   BMTF Cancel-out bug fix. Fixes the inneficiency that appears in runs<278175, in the region around eta~-0.3.  
282917 ------   GOOD   TwinMux Deployment in production of TwinMux configuration enabling RPC BX correction to DT existing primitives, more details in ELOG

Smaller EMTF issues and changes


Firmware
First run affected Last run affected First run with fix Change date Comments
  272022 272760 2016-05-05 DAQ ME had output CSC ID range 0 - 8 instead of 1 - 9; SP output ME2_ID, 3_ID, and 4_ID were filled with 4, 5, or 6 when they should have been 7, 8, or 9.
  278986 279024 2016-08-18 2nd-earliest LCT FW in Sector -6, improves LCT recovery in chambers with CSC ID 1.
  280024 280187 2016-09-05 2nd-earliest LCT FW in Sectors -1, -2, -3, -4, +1, +2, and +3, with improved LCT recovery.
  280385 281601 2016-09-12 2nd-earliest LCT FW in remaining Sectors (-5, +4, +5, +6), with improved LCT recovery.
281601 281727 281797 2016-09-20 (09-28) Test FW in Sector -6 reduced LCT matching window in station 2, resulting in demoted tracks and some inefficiency.
  282092 282408 2016-10-06 New FW with symmetric patterns, fixed pattern phi, and fixed ME1 neighbor LCTs ( ???)
?????? ?????? ?????? 2016-??-?? (10-19) FW in all Sectors except +6 reduced LCT matching window in station 2, resulting in demoted tracks and some inefficiency.
?????? ?????? ?????? 2016-??-?? pT LUT was written with bad values in mode 7 (CLCT bit wrong), mode 10 (random offset), and high pT tracks (1/pT overflows into negative values). Fairly small effect in mode 7, very small for negative pT bug.
?????? ?????? ?????? 2016-??-?? Theta duplication bug in FW.

Online Software
First run affected Last run affected First run with fix Change date Comments
  280024 280187 2016-09-05 EMTF LCTs in BX -3 only output if there was a track in the sector. Accidentally changed so this problem affected both BX -2 and -3 (daq_valor_delay = 49).
  280349 280363 2016-09-08 LCTs in BX -2 and -3 reported whether or not there was any track (daq_valor_delay = 51).
  281727 281797 2016-09-28 DAQ readout window changed from [-3, +4] to [-3, +3] BX.

DQM
First run affected Last run affected First run with fix Change date(s) Comments
  XXXXXX XXXXXX 2016-XX-XX Spikes in track eta ~1.5 because of overflow OMTF muons not cancelled out, firing DoubleMu triggers.
272760 273302 273402 2016-05-05 (05-13) Unpacker incompatible with firmware change; hit occupancy plots shifted, track BX plot empty.

CSC LCTs (see also CSC whiteboard)

First run affected Last run affected First run with fix Change date(s) Comments
  ongoing   2016-01-01 Chamber ME+2/2/29 (Sector 5, Station 2, CSC ID 6) transmits no LCTs.
273725 ongoing   2016-05-19 Chamber ME-2/1/3 (Sector 1, Station 2, CSC ID 3) transmits no LCTs.
  276097 276215 2016-07-01 EMTF LCTs output to DAQ even if there was no track in the sector. Less than 1% of LCTs received by CSCTF missing in EMTF, vs. ~10% before fix.
277932 278018 278167 2016-08-01 (08-03) Due to MPC-EMTF FW mismatch, no LCTs from chambers with CSC ID 1 in Sector +5, except in ME+2.
278769 ongoing   2016-08-13 LCTs from ME-1/1/06 (Sector -1b, Station 1, CSC ID 1) have corrupt halfstrip numbers.
  278986 279024 2016-08-18 2nd-earliest LCT FW in Sector -6, improves LCT recovery in chambers with CSC ID 1.
  280024 280187 2016-09-05 2nd-earliest LCT FW in Sectors -1, -2, -3, -4, +1, +2, and +3, with improved LCT recovery.
  280024 280187 2016-09-05 EMTF LCTs in BX -3 only output if there was a track in the sector. Accidentally changed so this problem affected both BX -2 and -3 (daq_valor_delay = 49).
  280349 280363 2016-09-08 LCTs in BX -2 and -3 reported whether or not there was any track (daq_valor_delay = 51).
  280385 281601 2016-09-12 2nd-earliest LCT FW in remaining Sectors (-5, +4, +5, +6), with improved LCT recovery.
281601 282092 282408 2016-09-24 (10-04) Old MPC FW not sending BC0's from ME+1/1/36 (Sector 6, Station 1b, CSC ID 1), EMTF receives no LCTs.
282408 ongoing   2016-10-06 ME+1/3/17 (Sector +3, Station 1a, CSC ID 9) died: CSC elog
<!--
*For early behavior, check DQM plots from May 15 (run 273450)*

*Later behavior seen clearly in high-rate unstable runs from July 30 (277792 and 277801)*

*Latest update from October 9, run 282735, also using CSCTF validation page*

*Dead chambers*
* ME+1/3/17 - not on whiteboard. New as of 2016-10-06.
* ME+2/2/29 - 2016-05-11 : ALCT corrupted data
* ME-2/1/3 - 2015-10-01 : Digital 7.5 V low

*Chambers with low-occupancy halfstrips and wiregroups*
* ME+1/1/13 - not on whiteboard
* ME+1/1/26 - not on whiteboard
* ME+3/1/07 - 2009-11-09 : CFEB3 comparators
* ME+3/1/12 - not on whiteboard.

* ME-1/1/21 - 2016-08-01 : DCFEB6 dead
* ME-1/1/33 - 2014-11-19 : Noisy AFEB 8 (needs higher threshold)

*Chambers with dead halfstrips*
* ME+1/1/03 - 2016-08-25 : DCFEB1 user proms problem, DCFEB6 not configured
* ME+1/1/21 - 2016-05-11 : TMB config fail: Optical link bad
* ME+1/1/25 - 2016-08-01 : DCFEB5 not configured
* ME+1/2/21 - 2012-03-30 : CFEB2 3.3 V = 2.51 V, Voltage regulator problem
* ME+1/2/31 - 2010-09-06 : CFEB5 6 V missing, 6 V fuse blown
* ME+2/1/03 - 2009-11-09 : CFEB4 comparators + sometime CFEB4 no SCA data
* ME+2/2/05 - 2014-09-09 : CFEB1, 6V off
* ME+2/2/10? (not in CSCTF or whiteboard)
* ME+2/2/15 - 2009-11-09 : CFEB5 comparators
* ME+2/2/19 - 2010-08-19 : CFEB5, 5 V read 1.82 V
* ME+3/1/07 - 2009-11-09 : CFEB3 comparators
* ME+3/1/11 - 2015-09-27 : CFEB3, no SCA
* ME+3/2/19 - 2009-11-09 : CFEB5 comparators
* ME+3/2/21? (not in CSCTF or whiteboard)
* ME+3/2/29 - 2009-11-09 : CFEB4 comparators
* ME+4/1/15 - 2009-11-09 : CFEB5 disconnected from DMB, Cause all other CFEBs dead
* ME+4/2/32 - 2014-09-01 : CFEB1 DAV error, Comparators are OK

* ME-1/1/12 - 2016-08-25 : DCFEB7 not configured
* ME-1/1/14 - not on whiteboard
* ME-1/1/30 - not on whiteboard
* ME-1/2/33 - 2009-12-15 : CFEB1, 6 V problem Fuse?, 6 V readings = 0
* ME-1/3/15 - not on whiteboard
* ME-2/1/09 - not on whiteboard
* ME-2/2/27 - not on whiteboard
* ME-2/2/28? (not in CSCTF or whiteboard)
* ME-3/1/09 - 2014-11-21 : CFEB6 Layer6 dead
* ME-3/1/13 - 2009-11-09 : CFEB3 comparators
* ME-3/2/16 - 2016-09-22 : CFEB3 lost 6 V
* ME-4/1/01 - 2009-11-09 : CFEB3 comparators
* ME-4/1/11 - 2010-09-01 : CFEB5 has 6.14 V instead of 3.3 V, FPGA not programmed
* ME-4/1/15 - 2012-04-25 : CFEB5, comparators dead
* ME-4/2/08 - 2015-09-27 : CFEB2, 6 V problem
* ME-4/2/34 - 2014-09-01 : CFEB5, not configured

*Additional issues seen in August*
* 278345 - 278509 : No LCTs from ME+1/1/21 (Sector +4, CSC ID 1, in Station 1a)
* 279588 : No LCTs from ME-1/1/08 (Sector -1, CSC ID 3, in Station 1b)
* 279653 - 280194 : Few or no LCTs from ME-1/1/12 (Sector -2, CSC ID 1, in Station 1b) (Fixed by 280238?)
-->


Calo

First run affected Last run affected Certification (are these runs in the golden json) L1 key Path affected Comments Extra resources
  275376 GOOD up to collisions2016_TSC/v94 All electrons H/E selection applied for all L1EG candidates, may affect efficiency at high pT (>300 GeV) depending on L1 seeds + offline selections used.
The fixe went only at the same time as the switch to Run2016C.
 
Period H Period H GOOD ?? All seeds including HTT Saturated jets were not saturating HTT L1THTTSaturationBug

uGT

First run affected Last run affected Certification (are these runs in the golden json) L1 key Path affected Comments Extra resources
  273302 GOOD up tp collisions2016_TSC/v62 L1_DoubleMu0er1p6_dEta_Max1p8, L1_DoubleMu_10_0_dEta_Max1p8 Due to a problem with the O2O, the uGT emulator does not find the L1 candidates associated to these triggers #362
277982 278018 (up to LS1038) BAD till the lumi group account for that   All paths Un-accounted dead time (WBM did not account of it) of about 6% - generates a general trigger inefficiency  
278270 279029 GOOD UGT_collisions_RS/v105 (UGT_BASE_RS_PRESCALES/v140) to UGT_collisions_RS/v118 (UGT_BASE_RS_PRESCALES/v152) L1_ SingleJet60 L1 prescale xml is wrong for L1_SingleJet60 It was 0 2000 1500 1200 1000 700 600 400 70 40 20 15 10 6 4 3 0 while it should be: 2000 1500 1200 1000 700 600 500 360 270 140 70 50 36 27 15 5 0

-- PierluigiBortignon - 2016-06-23

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2023-06-28 - EvanCollins
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback