Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility

Timm, Steve; Cooper, Gregory F.; Fuess, S.; Garzoglio, Gabriele; Holzman, B.; Kennedy, Robert; Grassano, D.; Tiradani, Anthony; Krishnamurthy, Ram; Vinayagam, S.; Raicu, Ioan; Wu, Hongjun; Ren, Shihong; Noh, S. Y.

doi:10.1088/1742-6596/898/5/052041

Cited by 7 publications

(7 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A second HTCondor CERN pool includes the on-site CMS resources, as well as opportunistic BEER [12] and Azure [13] cloud slots. The HEPCloud [14] pool, joining cloud and HPC resources in the USA (e.g. at NERSC [15]), is managed from the FNAL site.…”

Section: The Cms Submission Infrastructurementioning

confidence: 99%

Reaching new peaks for the future of the CMS HTCondor Global Pool

et al. 2021

View full text Add to dashboard Cite

The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 350k CPU cores, is employed to successfully manage the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict a noticeable expansion in the amount of CPU that will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring and expanding the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high effciency in our workload scheduling and resource utilization.

show abstract

Section: The Cms Submission Infrastructurementioning

confidence: 99%

Reaching new peaks for the future of the CMS HTCondor Global Pool

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Resources in the Global Pool are still mainly acquired with GlideinWMS pilots [1], although the SI now also includes locally instantiated slots (e.g DODAS [6]), BOINC [7] (CMS@Home [8]), opportunistic resources (such as the CMS HLT), etc. The HEPCloud [9] pool, joining cloud and HPC resources in the USA, is managed from the FNAL site. The CERN pool includes on-site resources allocated to CMS, but also opportunistic BEER [10] and Azure cloud slots.…”

Section: Increasing Complexity In Cms Simentioning

confidence: 99%

Resource provisioning and workload scheduling of CMS Offline Computing

Yzquierdo¹

2021

Proceedings of 40th International Conference on High Energy Physics — PoS(ICHEP2020)

View full text Add to dashboard Cite

The CMS experiment requires vast amounts of computational capacity in order to generate, process and analyze the data coming from proton-proton collisions at the Large Hadron Collider, as well as Monte Carlo simulations. CMS computing needs have been mostly satisfied up to now by the supporting Worldwide LHC Computing Grid (WLCG), a joint collaboration of more than a hundred computing centers geographically distributed around the world. However, as CMS faces the Run 3 and High Luminosity LHC (HL-LHC) challenges, with increasing luminosity and event complexity, growing demands for CPU have been estimated. In these future scenarios, additional contributions from more diverse types of resources, such as Cloud and High-Performance Computing (HPC) clusters, will be required to complement the limited growth of the capacities of WLCG resources. A number of strategies are being evaluated on how to access and use WLCG and non-WLCG processing capacities as part of a combined infrastructure, successfully exploit an increasingly more heterogeneous pool of resources, efficiently schedule computing workloads according to their requirements and priorities, and timely deliver analysis results to the collaboration, which are described in this paper.

show abstract

“…However, they now also include vacuum-instantiated slots (e.g Cloud based DODAS [7] managed resources), BOINC [8] slots (at the heart of CMS@Home [9]), opportunistic (including HLT slots and slots acquired by pilots running in non-CMS OSG sites). The HEPCloud pool [10] is managed from the Tier-1 site at FNAL, and enables access to cloud and allocation-based HPC resources in the USA. The CERN pool now also includes Batch on EOS Extra Resources (BEER) [11], where computing tasks are allowed to opportunistically make use of the unused capacity on CERN storage servers.…”

Section: Increasing Complexitymentioning

confidence: 99%

Evolution of the CMS Global Submission Infrastructure for the HL-LHC Era

et al. 2020

View full text Add to dashboard Cite

Efforts in distributed computing of the CMS experiment at the LHC at CERN are now focusing on the functionality required to fulfill the projected needs for the HL-LHC era. Cloud and HPC resources are expected to be dominant relative to resources provided by traditional Grid sites, being also much more diverse and heterogeneous. Handling their special capabilities or limitations and maintaining global flexibility and efficiency, while also operating at scales much higher than the current capacity, are the major challenges being addressed by the CMS Submission Infrastructure team. These proceedings discuss the risks to the stability and scalability of the CMS HTCondor infrastructure extrapolated to such a scenario, thought to be derived mostly from its growing complexity, with multiple Negotiators and schedulers flocking work to multiple federated pools. New mechanisms for enhanced customization and control over resource allocation and usage, mandatory in this future scenario, are also described.

show abstract

Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility

Cited by 7 publications

References 1 publication

Reaching new peaks for the future of the CMS HTCondor Global Pool

Reaching new peaks for the future of the CMS HTCondor Global Pool

Resource provisioning and workload scheduling of CMS Offline Computing

Evolution of the CMS Global Submission Infrastructure for the HL-LHC Era

Contact Info

Product

Resources

About