Site specific monitoring of multiple information systems – the HappyFace Project

Büge, Volker; Mauch, Viktor; Quast, G.; Scheurer, A.; Trunov, A.

doi:10.1088/1742-6596/219/6/062057

Cited by 5 publications

(3 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The main monitoring sources are the Service Availability Monitor (SAM) [9], HammerCloud [10], PhEDEx, the WLCG Information System and the batch systems of the Tier-1 sites. The aggregation and visualization layer is provided by several tools, such as the CMS Site Readiness [11], the Site Status Board [12], the Service Usability Monitor [13] and HappyFace [14].…”

Section: Facility Monitoringmentioning

confidence: 99%

“…Batch system-specific plugins are used to format the relevant data as standard XML files and a dedicated HappyFace instance. HappyFace [14] is an aggregation and visualization tool for monitoring information widely used in German WLCG sites and was particularly suited for this application (altough in principle any visualization tool capable of reading the XML feeds could be used). Currently, there are no plans to extend the project to Tier-2 sites because of the amount of effort needed to have the XML generators deployed everywhere, but it could be easily adopted by other experiments.…”

Section: Facility Monitoringmentioning

confidence: 99%

See 1 more Smart Citation

Towards a global monitoring system for CMS computing operations

Bauerdick

Sciabà

2012

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Abstract. The operation of the CMS computing system requires a complex monitoring system to cover all its aspects: central services, databases, the distributed computing infrastructure, production and analysis workflows, the global overview of the CMS computing activities and the related historical information. Several tools are available to provide this information, developed both inside and outside of the collaboration and often used in common with other experiments. Despite the fact that the current monitoring allowed CMS to successfully perform its computing operations, an evolution of the system is clearly required, to adapt to the recent changes in the data and workload management tools and models and to address some shortcomings that make its usage less than optimal. Therefore, a recent and ongoing coordinated effort was started in CMS, aiming at improving the entire monitoring system by identifying its weaknesses and the new requirements from the stakeholders, rationalise and streamline existing components and drive future software development. This contribution gives a complete overview of the CMS monitoring system and a description of all the recent activities that have been started with the goal of providing a more integrated, modern and functional global monitoring system for computing operations. IntroductionThe CMS computing system is operating since 2008, much before the start of LHC proton-proton data taking. Its role is to enable the collaboration to process, store, distribute and analyse data collected by the CMS experiment. Like for the other LHC experiments, it is built over the infrastructure and the services provided by the Worldwide LHC Computing Grid (WLCG) as an upper layer of services and tools that take into account the CMS data model and implement the CMS computing model.The operation of such complex system requires substantial effort from CMS, from WLCG and the sites; it is therefore of utmost importance to be able to know in detail the system status and its history at all times, as the availability of good monitoring information is a prerequisite for efficient operations. In November 2010 CMS critically reviewed all the available monitoring with the goal of identifying its weaknesses and finding ways to improve it.The purpose of this paper is i) to give an overview of the CMS monitoring system, the areas covered by it, the existing tools and the known deficiencies of the system, ii) to describe the process pursued by CMS to achieve a global monitoring system based on a limited number of common tools and iii) to talk about the ongoing developments along the lines defined by the global strategy.

show abstract

Section: Facility Monitoringmentioning

confidence: 99%

Section: Facility Monitoringmentioning

confidence: 99%

Towards a global monitoring system for CMS computing operations

Bauerdick

Sciabà

2012

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

show abstract

“…At distinct points in time, a variety of checkpoints have been predefined to verify smooth operation and the desired level of quality of all required services. In order to minimise administrative efforts and to lower manpower consumption significantly, the "HappyFace Project" [12] was born. HappyFace is a widely modular and flexible metamonitoring system.…”

Section: • Computing Clustermentioning

confidence: 99%

German contributions to the CMS computing infrastructure

Scheurer

2010

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Abstract. The CMS computing model anticipates various hierarchically linked tier centres to counter the challenges provided by the enormous amounts of data which will be collected by the CMS detector at the Large Hadron Collider, LHC, at CERN. During the past years, various computing exercises were performed to test the readiness of the computing infrastructure, the Grid middleware and the experiment's software for the startup of the LHC which took place in September 2008. In Germany, several tier sites are set up to allow for an efficient and reliable way to simulate possible physics processes as well as to reprocess, analyse and interpret the numerous stored collision events of the experiment. It will be shown that the German computing sites played an important role during the experiment's preparation phase and during data-taking of CMS and, therefore, scientific groups in Germany will be ready to compete for discoveries in this new era of particle physics. This presentation focuses on the German Tier-1 centre GridKa, located at Forschungszentrum Karlsruhe, the German CMS Tier-2 federation DESY/RWTH with installations at the University of Aachen and the research centre DESY. In addition, various local computing resources in Aachen, Hamburg and Karlsruhe are briefly introduced as well. It will be shown that an excellent cooperation between the different German institutions and physicists led to well established computing sites which cover all parts of the CMS computing model. Therefore, the following topics are discussed and the achieved goals and the gained knowledge are depicted: data management and distribution among the different tier sites, Grid-based Monte Carlo production at the Tier-2 as well as Grid-based and locally submitted inhomogeneous user analyses at the Tier-3s. Another important task is to ensure a proper and reliable operation 24 hours a day, especially during the time of data-taking. For this purpose, the meta-monitoring tool "HappyFace", which was developed at the University of Karlsruhe, is used in order to allow even non-expert shift crews to monitor and operate a centre continuously and to contact on-call experts, if needed.

show abstract

The HappyFace Project

Mauch

Birkholz

et al. 2011

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Site specific monitoring of multiple information systems – the HappyFace Project

Cited by 5 publications

References 0 publications

Towards a global monitoring system for CMS computing operations

Towards a global monitoring system for CMS computing operations

German contributions to the CMS computing infrastructure

The HappyFace Project

Contact Info

Product

Resources

About