How to configure Fluentbit to collect Logs for our K8S cluster ?

In this episode, we will explain Fluentbit's architecture and the differences with FluentD.
During the tutorial, we will install Fluentbit and create a log stream pipeline to collect logs and send it to the Dynatrace Log Ingest API.

Timestamps
00:00 - Introduction
03:00 - Fluentbit
13:33 - Differences with FluentD
15:05 - Tutorial
Links:

[KaleLazic]

Thank you! I just tested the fluentbit on K8s integration with Dynatrace and your video helped a lot!

[pardhunani]

Nice video ! Looking farward to learn from you more

[emmaasoh]

Hi! Great video! I would love a tutorial on shipping logs to click house and visualizing on grafana

[mehransaeed]

Thanks for your video. I have spun the fluenbit pods in one of namespaces but getting this error.
I have double checked var/log/containers folder have read permissions.

I ran these pods and deployment files as root user. below is the error.

[2024/07/01 12:32:44] [error] [input:tail:tail.0] read error, check permissions: /var/log/containers/*.log

[AlirezaAry]

Hi there, thank you for your video and the GitHub repo, currently im using these k8s filter.
But i wonder how can we parse multi lines logs that our microservices generating in k8s?
I check the official documents and try multiline parsers in input section or custom parsers in filter sections, but still i see some of my logs are spilited in one line!
Our microservices usually are spring boot and they have stack traces in their console logs

[bex.doctor]

Can you make a video tutorial on fluentbit sending data on elasticsearch? TIA

[tiefkluehlfeuer]

Why is the config format different to Fluentd? It is even from the same developers, and on a first glance describing similar things.
That makes it hard to port from FluentBit to Fluentd, when things get larger and you need a plugin that FluentD has but FluentBit has not.

[vrajbhatt]

how to collect cronjob logs? Fluentbit is not able to forward cronjob's pod's logs on opensearch

[kryptdervel]

I think that you should mention that other videos are a prerequisite to understanding the tutorial of this video.

I felt like I wasted quite a bit of time only to realize that in the tutorial section you keep on mentioning what you did the last time.

[COD_zone_]

can You make a video on how to send logs to a file in local environment after processing them?

[ashishjohn]

Hello,
What if application generate custom log in custom path inside pod, then how to configure fluent bit configuration?
Thanks

[rakeshsm]

Can you make vdo on how to send logs on aws cloudwatch using fluent bit.

[theindianwomenpioneer]

Hi, does Fluentbit read/get only stdout logs from the Kubernetes container? or can it read logs from the volume mount folder as well?

[AftabAlam-ddnn]

Can you please provide more details about fluentbit_ds.yaml you deployed at 25:34?