The Run Control and Monitoring System of the CMS Experiment.

Petrucci, Andrea

doi:10.22323/1.050.0026

Cited by 3 publications

(3 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, it provides them with tools to perform post-mortem analysis. It constantly analyses the monitoring data from the Run Control system [5][6][7][8], and based on procedures defined by experts, finds the optimal way to recover when dataflow is stuck.…”

Section: Daqexpertmentioning

confidence: 99%

DAQExpert the service to increase CMS data-taking efficiency

et al. 2020

Self Cite

View full text Add to dashboard Cite

The Data Acquisition (DAQ) system of the Compact Muon Solenoid (CMS) experiment at the LHC is a complex system responsible for the data readout, event building and recording of accepted events. Its proper functioning plays a critical role in the data-taking efficiency of the CMS experiment. In order to ensure high availability and recover promptly in the event of hardware or software failure of the subsystems, an expert system, the DAQ Expert, has been developed. It aims at improving the data taking efficiency, reducing the human error in the operations and minimising the on-call expert demand. Introduced in the beginning of 2017, it assists the shift crew and the system experts in recovering from operational faults, streamlining the post mortem analysis and, at the end of Run 2, triggering fully automatic recovery without human intervention. DAQ Expert analyses the real-time monitoring data originating from the DAQ components and the high-level trigger updated every few seconds. It pinpoints data flow problems, and recovers them automatically or after given operator approval. We analyse the CMS downtime in the 2018 run focusing on what was improved with the introduction of automated recovery; present challenges and design of encoding the expert knowledge into automated recovery jobs. Furthermore, we demonstrate the web-based, ReactJS interfaces that ensure an effective cooperation between the human operators in the control room and the automated recovery system. We report on the operational experience with automated recovery.

show abstract

Section: Daqexpertmentioning

confidence: 99%

DAQExpert the service to increase CMS data-taking efficiency

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…The PLC information was passed to the TCS by the proprietary Siemens S7 driver [9]. The essential communication between the TCS and the power supplies was based on the Microsoft OPC (OLE for Process Control) standard [10], while the communication between the Run Control and Monitoring System (RCMS) [11] and the TCS was guaranteed by PSX (PVSS SOAP eXchange) [12], an application based on the SOAP (Simple Object Access Protocol) protocol [13]. The CAEN and PLC data were written to the database only when there were significant changes from the previous measurements.…”

Section: Detector Control and Safety Systemsmentioning

confidence: 99%

The CMS tracker operation and performance at the Magnet Test and Cosmic Challenge

Adam¹,

Bergauer²,

Dragicevic³

et al. 2008

J. Inst.

View full text Add to dashboard Cite

During summer 2006 a fraction of the CMS silicon strip tracker was operated in a comprehensive slice test called the Magnet Test and Cosmic Challenge (MTCC). At the MTCC, cosmic rays detected in the muon chambers were used to trigger the readout of all CMS subdetectors in the general data acquisition system and in the presence of the 4 T magnetic field produced by the CMS superconducting solenoid. This document describes the operation of the Tracker hardware and software prior, during and after data taking. The performance of the detector as resulting from the MTCC data analysis is also presented.

show abstract

“…The CMS Run Control and Monitoring System (RCMS) [3,4,5,6], includes automation at various levels [7,8]. Cross-checks ensure that all configuration changes are applied to relevant components of the system and in the correct order.…”

Section: Introductionmentioning

confidence: 99%

Operational experience with the new CMS DAQ-Expert

et al. 2019

Self Cite

View full text Add to dashboard Cite

The data acquisition (DAQ) system of the Compact Muon Solenoid (CMS) at CERN reads out the detector at the level-1 trigger accept rate of 100 kHz, assembles events with a bandwidth of 200 GB/s, provides these events to the high level-trigger running on a farm of about 30k cores and records the accepted events. Comprising custom-built and cutting edge commercial hardware and several 1000 instances of software applications, the DAQ system is complex in itself and failures cannot be completely excluded. Moreover, problems in the readout of the detectors,in the first level trigger system or in the high level trigger may provoke anomalous behaviour of the DAQ systemwhich sometimes cannot easily be differentiated from a problem in the DAQ system itself. In order to achieve high data taking efficiency with operators from the entire collaboration and without relying too heavily on the on-call experts, an expert system, the DAQ-Expert, has been developed that can pinpoint the source of most failures and give advice to the shift crew on how to recover in the quickest way. The DAQ-Expert constantly analyzes monitoring data from the DAQ system and the high level trigger by making use of logic modules written in Java that encapsulate the expert knowledge about potential operational problems. The results of the reasoning are presented to the operator in a web-based dashboard, may trigger sound alerts in the control room and are archived for post-mortem analysis - presented in a web-based timeline browser. We present the design of the DAQ-Expert and report on the operational experience since 2017, when it was first put into production.

show abstract

The Run Control and Monitoring System of the CMS Experiment.

Cited by 3 publications

References 2 publications

DAQExpert the service to increase CMS data-taking efficiency

DAQExpert the service to increase CMS data-taking efficiency

The CMS tracker operation and performance at the Magnet Test and Cosmic Challenge

Operational experience with the new CMS DAQ-Expert

Contact Info

Product

Resources

About