Introduction to Ingesting logs with Loki | Zero to Hero: Loki | Grafana

Have you just discovered Grafana Loki? In this Zero to Hero episode, we dive deeper into how to ingest your logs into Loki. Buckle up and get ready to learn about:

00:00 - Intro
00:43 - How does Grafana Loki Ingest logs?
01:31 - How are your logs stored within Grafana Loki?
02:19 - Collectors and clients for ingesting logs into Loki
04:05 - Tutorial Intro
04:51 - Tutorial Setup
05:45 - Discovering log files with Grafana Alloy
07:41 - Configuring the Loki write endpoint
08:38 - Scraping the discovered log files
10:19 - What are Loki Labels
11:35 - Dynamically Adding new labels using Alloy
14:03 - Migration Tool for Alloy (Promtail, Otel, Agent)
14:45 - Outro

Helpful links:

-----
👍 If you found this video useful, be sure to give it a thumbs up and subscribe to our channel for more helpful Grafana videos.

📱 Follow us for the latest and greatest on all things Grafana and our other OSS projects.

#loki #logs #opensource #Grafana #observability #tutorial #beginnersguide

[matts]

Really great videos, thank you for the knowledge and great job at pacing!!

[jdpalaciob]

I love your products and how active you guys are with webinars and these kind of videos. I've been working with Grafana and Loki for 3+ years now and I found them amazing. I will just ask for one thing, Could you guys please make a more detailed (not so beginner) video about loki's configuration? After all this time I still find myself lost with a lot of the config parameters and sometimes the documentation is not enough(some definitios look vague to me). I will love to see something more in depth, someting more for those whiare alredy out of the beginners phase (I mean, basic set up or docker compose in lcoal env). It would be awesome to see one of you going through Loki's configuration explaining each section with the most relevant things on them .If you guys read this, thanks a lot!

[PrashantSingh-unyj]

Excellent and clear doubts about grafana logs with alloy agent.

Thanks

[ben_]

Will there be a series like this for alloy

[proflanky]

Complex log scrapping with regex and timestamp is what I want to see.

[legooos]

Thank you very much, i was waiting for the Alloy video and it is finally here!
What i don't understand is why in the Alloy graph the arrow goes from loki.source.file to local.file.match and not the other way around, i.e. the way pipeline stages actually go (match files > map source to targets > process > ship to loki) . Or am i missing something?

[legooos]

Would love to know more about the labels, specifically how to dynamically discover and relabel service_name based on the path of the log files, I'm currently struggling with how to achieve this labeling setup:
/var/log/app1/ > service_name=app1
/var/log/app2/ > service_name=app2

[JamesGreen-gvyn]

Consider if using Docker is really "beginner" level. Personally, I believe that showing how to do all this directly under Linux will provide a better understanding of how the applications work and avoid the added configuration complications of something like Docker. Having a docker compose file that just magically spins up a bunch of processes like this hides some valuable understandings.

[TobiasWolf-wxlk]

Nice video, but you could tone down your hand gestures a little bit. They distract from your words.