6 Easy Ways to Improve your Log Dashboards with Grafana and Loki

Are you new to Grafana or Grafana Loki or both, then this video is for you. It shows you how to implement a log dashboard in a few easy steps, that goes beyond the scope of the Explore mode of Grafana.

00:00 Introduction
02:02 1. Adding Template Variables for Log Labels
03:16 2. Adding Text Boxes to Filter Logs
04:38 3. Adding Ad Hoc Filters
07:52 4. Make it Look Beautiful!
10:50 5. Use Data Links for Filtering or Drill Downs
12:14 Final Adjustments
14:15 6. Add Instructions
16:00 Summary

[maxlagus]

Literally the only guide that actually shows how to do stuff! Like from me and my team:)

[MattFine]

This was very well done. Thank you. Please continue to make additional videos like this tutorial.

[krzysztofwiatrzyk]

You have presented using ad-hoc filters perfectly to learn! Thanks you dear sir, I was trying to understand it from Grafana docs but it is just overwhelming.

[mexby]

Thanks bro! It's amazing explanation how using loki more effectively

[Babe_Chinwendum]

Thank you so much. This was really helpful!

[Lars-pivx]

Great video! I wished there was more. I wonder if there Is any solution to do such ad hoc filters with "regex" or "pattern" parsed logs?

[joffemannen]

A more concrete question maybe? Was counting top user agents, but now that our traffic has increased we have more than 2000 different user agents per time unit and I run into the max series issue, with a query like topk(50, sum by(user_agent_original) (count_over_time({deployment_environment="prod", event_name="request"} [$__range]))), where I naively first thought the topk(50 would protect me from that limit. It's an instant query, showing a table view with the values as a gauge. I could parse the user agent harder to get major browser version to get the options below 2000, but this is structured metadata, so I can't do that in LogQL, I have to do it in the collector (or in promtail?). I can't increase the 2000 limit, and I don't want to. Any way to rewrite the query to come around this issue?

[agpjustordinaryviewer]

Currently my office is working some pilot projects to have centralized logging and metrics dashboard using Grafana Loki. We found out Grafana and Loki are powerful tools, however it is quite difficult to find references in Google. This video is very very insightful video for Grafana Loki.

However, there is one thing that is not working from our Grafana (v10.0.1). If we change to instant type, then all different values in a pie chart will be aggregated so it will display one value only. This issue doesn't happen in Query type.

Have you ever heard about this issue?

[utpxxx]

will this work with the json parser for the aggregation if they are not labels in loki already?

[joffemannen]

Nice! Got me going. I'm new to LogQL and Grafana, got some Splunk experience and am struggling to translate what I have. But this was a nice start. Any recommended youtubes as next step? I'm still struggling with a few things: 1) The base query is implemented in each panel - a lot of maintenance and I guess the query spends CPU x Nbr of panels. 2) I have a few regexes, I guess I should consider implementing them in the proxy infront of loki so they are available in simple filters for performance and maintenance. 3) The drill downs with Data Links - I only manage to do them in one level, and what corresponds to your "cluster" filter gets stuck for some reason - I want to drill down like 4 levels without making 4 dashboards with 8 separate panels with separate queries because that's a lot of maintenance. 4) Doing some arithmetic, I guess I have to learn transformations - like error rate in %, not in "per second". 5) Combining similar values in the same graph - some of my log entries have 4 timings - time to first byte, request end time etc - right now in 4 panels. 5) Do the same but for logs in BigQuery. I'm sure I'll figure some of this out on my own but one more kick in the right direction would save me some pulled hairs

[girirajb.c]

can you send me your promtail configuration for the above dashboard please?

[AjayKumar-lmyr]

How to store Grafana Loki logs in Azure Blob Storage

[abhishekkhanna]

Can you please share the application you used to create this dashboard?

[photographymaniac]

This is not working for unstructured logs where we use pattern to match

[bganesh]

please dont add music br it is very disturbing

[iyiempire]

just type simple query:
fields @message
| filter @message like /$Filter/
| limit 100

dont make it hard