How to collect logs in k8s with Loki and Promtail

This episode will explain the importance of logs to fully understand how our applications are behaving.
This episode will also explain the architecture of Loki and Promtail.
In the tutorial, we will install Loki and build a dashboard in Grafana
Timestamps
00:00 - Introduction
02:20 - Importance of Logs
03:02 - Standardized logging
08:28 - Centralized logging
10:09 - Loki
16:19 - Tutorial
Links:

[dannykopping]

Loki maintainer here. Great job! This is a very accessible introduction into Loki, packed in quite a lot in a short time.

[Znerox]

That |="text" thing is SO helpful, I haven't come across this info anywhere else.

[MrEdinaldolaroque]

Thank you for this! It was very helpful to me.

[DaniVendettaXII]

Very nice, thank you so much. I'll try that.

[pradeepaselvanesan]

Thank you for a excellent tutorial, I would be more helpful if you are explaining about retention and configurations.

[TalkAsap]

In which part of the video is `promtail` installed? I see that Loki is installed and then logs are just there.

[diego]

i have grafana, loki and promtail installed on k8s... why I cannot get many of my pods listed when I select "pod" as label filter?

[Sajmon]

Do you have film about avoiding collecting everything ? it is normaly must have by helm charts on k8s maby ?

[AjayKumar-lmyr]

Hi all,

I'm not getting all the pods and namespace in the Loki, what i do

[rigobertocorujo]

Hello sir, this is a really great video. I was hoping you might be able to answer a question for me, please. I am running an application inside a kubernetes pod. The application does not write its log to stdout, but rather, writes its log file to inside the pod. Every directory in the path is local to the pod (i.e., not a mounted volume). How could I get promtail to scrape that log? Thank you.

[baskisful]

Nice video, thank you! I was able to pull local logs and visualize them in Loki. Wondering how it would work to send logs from a remote kubernetes cluster, Do I need to install some kind of LB along with promtail to send logs to loki kube cluster.

[pigrebanto]

ok, but what about configuring the storage behind Loki? can it use storageClass ?

[jooj]

This is great explanation and tutorial. But what in the case where i have java/golang applicaitons running. THey have diffrent log format so querying with logql can parse for example java in json but Go app is with errors. Do you know about solution or config to somehow make the logs compatibile, with same labels or something usable ? (can find a proper wors for it :D )

[wertwyd]

Hi, suppose i have custom logs in path applications/a.log which is in my-application pod how i can send this logs to grafana, i know it can be performed using promtail configuration in normal servers, how it can be done in kubernetes cluster

[Thirumalesh]

Great content..! Thanks . Is there any way to get the Loki logs via API

[sunhsiang]

How to collection the log file rather than stdout？

[yaohu]

I want to received some pods logs, How to achieve it？