Reaching new peaks for the future of the CMS HTCondor Global Pool

Yzquierdo, A. Pérez-Calero; Mascheroni, Marco; Flechas, Maria Acosta; Dost, J M; Haleem, Saqib; Anampa, K. Hurtado; Khan, Farrukh Aftab; Kizinevič, Edita; Peregonov, N.

doi:10.1051/epjconf/202125102055

Cited by 2 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A successful scheduling is achieved by simultaneously ensuring that all available resources are efficiently used [379], a fair share of resources between users is reached, and the completion of CMS tasks follows their prioritization, minimizing job failures and manual intervention. While the SI typically manages 100k to 150k simultaneously executing tasks, recent scalability tests [380] have demonstrated the capacity of the infrastructure to sustain in excess of half a million concurrently running jobs.…”

Section: Central Processing and Productionmentioning

confidence: 99%

Development of the CMS detector for the CERN LHC Run 3

Hayrapetyan,

Tumasyan,

Adam

et al. 2024

J. Inst.

View full text Add to dashboard Cite

Since the initial data taking of the CERN LHC, the CMS experiment has undergone substantial upgrades and improvements. This paper discusses the CMS detector as it is configured for the third data-taking period of the CERN LHC, Run 3, which started in 2022. The entire silicon pixel tracking detector was replaced. A new powering system for the superconducting solenoid was installed. The electronics of the hadron calorimeter was upgraded. All the muon electronic systems were upgraded, and new muon detector stations were added, including a gas electron multiplier detector. The precision proton spectrometer was upgraded. The dedicated luminosity detectors and the beam loss monitor were refurbished. Substantial improvements to the trigger, data acquisition, software, and computing systems were also implemented, including a new hybrid CPU/GPU farm for the high-level trigger.

show abstract

Section: Central Processing and Productionmentioning

confidence: 99%

Development of the CMS detector for the CERN LHC Run 3

Hayrapetyan,

Tumasyan,

Adam

et al. 2024

J. Inst.

View full text Add to dashboard Cite

show abstract

“…The SI team is continuously working on detecting and solving scaling bottlenecks to the infrastructure, with the support of the HTCondor and GlideinWMS developers teams. As a consequence of the accumulated experience, our setup currently includes multiple "nonstandard" customized settings, most of them aimed at avoiding the saturation of the main collector service of the pool, as described in previous reports [24]. Some of these specialized settings are: (a) Our HTCondor Connection Broker (CCB) service is running on a separate host to the CM, and configured with an enlarged pool of available connection sockets.…”

Section: Pushing the Limits Of The Cms Global Poolmentioning

confidence: 99%

“…The main goal for the Spring 2023 tests of the CMS SI was to assess the potential scalability of our Global Pool, considering the following updates since our latest tests (2021, see [24]). These include the evolution in HTCondor software (tested version 10.0. physical host for the CM processes (AMD EPYC 7302 at 3 GHz), the adoption of tokenbased authentication for HTCondor services in our SI [26], and the incrementally improved configuration of our infrastructure.…”

Section: The Si 2023 Scale Testsmentioning

confidence: 99%

HPC resources for CMS offline computing: An integration and scalability challenge for the Submission Infrastructure

Pérez-Calero Yzquierdo,

Mascheroni,

Kizinevic

et al. 2024

EPJ Web of Conf.

View full text Add to dashboard Cite

The computing resource needs of LHC experiments are expected to continue growing significantly during the Run 3 and into the HL-LHC era. The landscape of available resources will also evolve, as High Performance Computing (HPC) and Cloud resources will provide a comparable, or even dominant, fraction of the total compute capacity. The future years present a challenge for the experiments’ resource provisioning models, both in terms of scalability and increasing complexity. The CMS Submission Infrastructure (SI) provisions computing resources for CMS workflows. This infrastructure is built on a set of federated HTCondor pools, currently aggregating 400k CPU cores distributed worldwide and supporting the simultaneous execution of over 200k computing tasks. Incorporating HPC resources into CMS computing represents firstly an integration challenge, as HPC centers are much more diverse compared to Grid sites. Secondly, evolving the present SI, dimensioned to harness the current CMS computing capacity, to reach the resource scales required for the HLLHC phase, while maintaining global flexibility and efficiency, will represent an additional challenge for the SI. To preventively address future potential scalability limits, the SI team regularly runs tests to explore the maximum reach of our infrastructure. In this note, the integration of HPC resources into CMS offline computing is summarized, the potential concerns for the SI derived from the increased scale of operations are described, and the most recent results of scalability test on the CMS SI are reported.

show abstract

Reaching new peaks for the future of the CMS HTCondor Global Pool

Cited by 2 publications

References 10 publications

Development of the CMS detector for the CERN LHC Run 3

Development of the CMS detector for the CERN LHC Run 3

HPC resources for CMS offline computing: An integration and scalability challenge for the Submission Infrastructure

Contact Info

Product

Resources

About