How CERN Monitors the World's Largest Computing Grid with Grafana and Mimir | GrafanaCON 2024

The European Organization for Nuclear Research (CERN) may be famous as the home of the Large Hadron Collider (LHC), which produces around one petabyte of data every day, but not many people know about the computing infrastructure surrounding that impressive machine. CERN has its own data centers for collecting the data from the experiments and making it available to physicists all around the world. The CERN data centers also serve as the core tier of the world’s largest computing grid, WLCG, connecting over 170 sites from 42 countries with the accumulated power of about 1.4 million computer cores.

In this talk, CERN Computing Engineer Nikolay Tsvetkov provides an overview of the CERN Monitoring Service and how it leverages Grafana and Mimir to deliver essential monitoring information to IT service managers and WLCG experts most effectively.

Chapters:
0:00 Introduction to CERN
2:40 The Worldwide LHC Computing Grid (WLCG)
3:29 CERN's monitoring service
4:16 Challenges with the monitoring service
5:45 Current architecture (high level overview)
7:09 Data types
8:55 Monitoring service with Grafana (overview)
10:26 Deployment
12:03 CERN dashboards
12:31 Operational challenges
14:10 Migration to unified alerting
16:51 Future steps with Grafana
18:22 Grafana Mimir pilot (a history)
19:28 Overview of the Grafana Mimir pilot
20:16 Grafana Mimir pilot deployment
20:41 Grafana Mimir pilot deployment in numbers
21:20 More dashboards: Kubernetes cluster monitoring, Grafana Mimir monitoring
21:58 What's next for CERN with Grafana and Mimir?

Helpful links:

-----
👍 If you found this video useful, be sure to give it a thumbs up and subscribe to our channel for more helpful Grafana videos.

📱 Follow us for the latest and greatest on all things Grafana and our other OSS projects.

#Grafana #Observability #CERN #GrafanaCON