Big Data Tools and Cloud Services for High Energy Physics Analysis in TOTEM Experiment

Avati, V.; Blaszkiewicz, Milosz; Bocchi, Enrico; Canali, Luca; Castro, Diogo; Cervantes, Javier; Grzanka, L.; Guiraud, Enrico; Kašpar, J.; Kothuri, Prasanth; Lamanna, M.; Malawski, Maciej; Mnich, Aleksandra; Mościcki, J.; Murali, Shravan; Piparo, D.; Tejedor, Enric

doi:10.1109/ucc-companion.2018.00018

Cited by 3 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Access to the platform was granted to a group of TOTEM scientists who actively used SWAN [6] in place of the production service at CERN. With this setup, TOTEM scientists demonstrated that it is possible to reduce the time required for the final analysis steps by a factor of 200x and they successfully validated the obtained physics results [7].…”

Section: Sciencebox Heritagementioning

confidence: 70%

“…The fst chart deploys the daemon writing files to persistent storage (either physical block devices or virtualized storage, including dynamically provisioned storage offered by cloud providers) and is horizontally scalable, allowing for the addition of storage on when required. • CERNBox, in green, is a collection of 8 charts, 6 of which make use of the revad chart available in the CS3 Organization 7 . All 6 of the charts run the revad 8 binary, each providing a specialized backend integration service according to the configuration enforced via Stretched hexagons represent umbrella charts, i.e., charts expressing dependencies against other charts; Rectangles represent component charts, i.e., charts describing the resources required to run one component; Ovals represent additional components developed to make ScienceBox fully self-standing, i.e., component charts providing commodity functionalities like caches, databases, identity providers, tooling for automated configuration, etc.…”

Section: Chart-based Architecturementioning

confidence: 99%

See 1 more Smart Citation

ScienceBox 2.0: Evolving the demonstrator package for CERN storage and analysis services

Bocchi,

Desai,

Alfageme Sainz

2024

EPJ Web of Conf.

Self Cite

View full text Add to dashboard Cite

With containers being the de-facto standard to package, distribute, and run applications, Helm charts are on the rise for application deployment in managed clusters (e.g., Kubernetes, OpenShift), providing developers and operators with a rich ecosystem of tools to utilize, as well as the means to configure applications and roll changes out in a programmatic way. This paper describes the reboot of the ScienceBox project: The containerized software bundle providing the ability to deploy CERN storage and analysis services on any cloud or local infrastructure. While the service offering provided through ScienceBox remains unchanged, we evolved the original implementation to make use of Helm charts across the entire stack and incorporated a major architectural update to CERNBox, replacing the previous PHP backend with a distributed microservices architecture. ScienceBox maintains the flexibility to be deployed in a few clicks for demonstration purposes, or scaled out on managed clusters for the provisioning of a multi-user service. It also removes external dependencies by deploying additional services (e.g., IDP, DBs) and facilitates the configuration of the service stack by providing automated configuration scripts, making the package fully self-contained and easy to use.

show abstract

Section: Sciencebox Heritagementioning

confidence: 70%

Section: Chart-based Architecturementioning

confidence: 99%

ScienceBox 2.0: Evolving the demonstrator package for CERN storage and analysis services

Bocchi,

Desai,

Alfageme Sainz

2024

EPJ Web of Conf.

Self Cite

View full text Add to dashboard Cite

show abstract

“…With this setup, TOTEM scientists validated the obtained physics results and demonstrated that it is possible to reduce the time required for the final steps of their analysis by a factor 280x when compared to single core execution (i.e., from 8 hours to less then 2 minutes). We invite the interested reader to refer to [14] for further details.…”

Section: Totem Experiments Analysis On the Helix Nebula Science Cloudmentioning

confidence: 99%

ScienceBox Converging to Kubernetes containers in production for on-premise and hybrid clouds for CERNBox, SWAN, and EOS

et al. 2020

Self Cite

View full text Add to dashboard Cite

Docker containers are the de-facto standard to package, distribute, and run applications on cloud-based infrastructures. Commercial providers and private clouds expand their offer with container orchestration engines, making the management of resources and containerized applications tightly integrated. The Storage Group of CERN IT leverages on container technologies to provide ScienceBox: An integrated software bundle with storage and computing services for general purposes and scientific use. ScienceBox features distributed scalable storage, sync&share functionalities, and a web-based data analysis service, and can be deployed on a single machine or scaled-out across multiple servers. ScienceBox has proven to be helpful in different contexts, from High Energy Physics analysis to education for high schools, and has been successfully deployed on different cloud infrastructure and heterogeneous hardware.

show abstract

Declarative Big Data Analysis for High-Energy Physics: TOTEM Use Case

Avati

Blaszkiewicz

Bocchi

et al. 2019

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Big Data Tools and Cloud Services for High Energy Physics Analysis in TOTEM Experiment

Cited by 3 publications

References 7 publications

ScienceBox 2.0: Evolving the demonstrator package for CERN storage and analysis services

ScienceBox 2.0: Evolving the demonstrator package for CERN storage and analysis services

ScienceBox Converging to Kubernetes containers in production for on-premise and hybrid clouds for CERNBox, SWAN, and EOS

Declarative Big Data Analysis for High-Energy Physics: TOTEM Use Case

Contact Info

Product

Resources

About