INFN Tier–1: a distributed site

The INFN Tier-1 located at CNAF in Bologna (Italy) is a center of the WLCG e-Infrastructure, supporting the 4 major LHC collaborations and more than 30 other INFN-related experiments. After multiple tests towards elastic expansion of CNAF compute power via Cloud resources (provided by Azure, Aruba and in the framework of the HNSciCloud project), and building on the experience gained with the production quality extension of the Tier-1 farm on remote owned sites, the CNAF team, in collaboration with experts from the ALICE, ATLAS, CMS, and LHCb experiments, has been working to put in production a solution of an integrated HTC+HPC system with the PRACE CINECA center, located nearby Bologna. Such extension will be implemented on the Marconi A2 partition, equipped with Intel Knights Landing (KNL) processors. A number of technical challenges were faced and solved in order to successfully run on low RAM nodes, as well as to overcome the closed environment (network, access, software distribution, … ) that HPC systems deploy with respect to standard GRID sites. We show preliminary results from a large scale integration effort, using resources secured via the successful PRACE grant N. 2018194658, for 30 million KNL core hours.

show abstract

“…The present work is a continuation of a series of integration efforts, as reported in [24], [25], [26].…”

Section: Future Directions and Conclusionmentioning

confidence: 88%

Extension of the INFN Tier-1 on a HPC system

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…The present work is a continuation of a series of integration efforts, as reported in [27], [28], [29], [30].…”

mentioning

confidence: 80%

Enabling HPC systems for HEP: the INFN-CINECA Experience

Ciangottini¹,

Noferini²,

Bozzi³

et al. 2021

Proceedings of International Symposium on Grids &Amp; Clouds 2021 — PoS(ISGC2021)

Self Cite

View full text Add to dashboard Cite

In this report we want to describe a successful integration exercise between CINECA (PRACE Tier-0) Marconi KNL system and LHC processing. A production-level system has been deployed using a 30 Mhours grant from the 18th Call for PRACE Project Access; thanks to CINECA, more than 3x the granted hours were eventually made available. Modifications at multiple levels were needed: on experiments' WMS layers, on site level access policies and routing, on virtualization. The success of the integration process paves the way to integration with additional local systems, and in general shows how the requirements of a HPC center can coexist with the needs from data intensive, complex distributed workflows.

show abstract

“…Following the CNAF Tier-1 strategy [13] the CINECA nodes were configured as an elastic extension of CNAF Tier-1 [14], and were receiving all the jobs targeted for the standard site.…”

Section: Cinecamentioning

confidence: 99%

Extending the distributed computing infrastructure of the CMS experiment with HPC resources

Adelman-McCarthy

Caspart²,

Peris³

et al. 2023

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Particle accelerators are an important tool to study the fundamental properties of elementary particles. Currently the highest energy accelerator is the LHC at CERN, in Geneva, Switzerland. Each of its four major detectors, such as the CMS detector, produces dozens of Petabytes of data per year to be analyzed by a large international collaboration. The processing is carried out on the Worldwide LHC Computing Grid, that spans over more than 170 compute centers around the world and is used by a number of particle physics experiments. Recently the LHC experiments were encouraged to make increasing use of HPC resources. While Grid resources are homogeneous with respect to the used Grid middleware, HPC installations can be very different in their setup. In order to integrate HPC resources into the highly automatized processing setups of the CMS experiment a number of challenges need to be addressed. For processing, access to primary data and metadata as well as access to the software is required. At Grid sites all this is achieved via a number of services that are provided by each center. However at HPC sites many of these capabilities cannot be easily provided and have to be enabled in the user space or enabled by other means. At HPC centers there are often restrictions regarding network access to remote services, which is again a severe limitation. The paper discusses a number of solutions and recent experiences by the CMS experiment to include HPC resources in processing campaigns.

show abstract

INFN Tier–1: a distributed site

Cited by 6 publications

References 4 publications

Extension of the INFN Tier-1 on a HPC system

Extension of the INFN Tier-1 on a HPC system

Enabling HPC systems for HEP: the INFN-CINECA Experience

Extending the distributed computing infrastructure of the CMS experiment with HPC resources

Contact Info

Product

Resources

About