Cheap DIY Monitoring with OSS Analytics & Visualization | Robert Hodges | Conf42 DevSecOps 2023

Chapters
0:00 intro
1:43 preamble
2:07 about robert
3:21 monitoring is for answering questions
3:55 what's the best way to answer these questions?
4:36 off-the-shelf solutions? perhaps not for you...
5:23 let's build a monitoring system with open source
6:06 pick an opne source analytic database
7:22 a short list of reasons why clickhouse is popular
8:50 clickhouse optimizes for fast response on large datasets
10:35 ...and supports [many] dozens of input formats
11:16 it also has great support for time-ordered data
12:30 grafana pairs well with clickhouse for observability apps
14:00 sooo... how do we ingest vmstat data and display it?
14:23 step 1: generate vmstat data
15:12 here's the output
15:38 step 2: design a clickhouse table to hold data
17:28 step 3: load data into clickhouse
18:23 step 4: build a grafana dashboard to show results
19:26 step 5: go crazy!
20:12 demo
26:38 more software to build monitoring on clickhouse
27:51 where can i find out more?
28:54 thank you and have fun!