Apache Kafka - 2022 Edition [.NET 6 Consumer and Producer, Docker containerized Kafka services]

#kafka #dotnet #csharp
I have done a couple of videos in 2018 for Kafka, but since then there have been a lot of improvements and changes in the Kafka echo system. And same is true for the Kafka client NuGet package.

Hence, I am creating a new series on Kafka with .NET 6 application, starting from explaining the basics of Kafka, to busing a distributed Microservices application using Kafka.

In this video, I will cover the basics of Kafka and a simple example of Producer and Consumer for Kafka topics.

The command used in the video to download the docker-compose file for Kafka and then start containers:
2. docker-compose up -d

Stay tuned for the next week's video, as I will cover building a real-life application using Kafka and ASP.NET 6.

[sontran]

Thank you for putting out the time to create these videos. They are extremely helpful to get a brief overview of the technology.

[BINLIANG-dh]

Thank You Very Much！Your Video Explanation Was Very HelpFul To Me

[ta-cvig]

Thank you for supporting us in the Dev community with such valuable content!!

[olayinkayusuf]

Hi Am trying to download the docker compose file but is not working pls assist

[krunaljethva]

I have some concerns about docker file can you explain which Image is used for which part. I basically want to remove unwanted images from it.

[HassanAli-cfii]

good job,
can i ask you a question ?
what if i want to access these environment variables (like bootstrap servers) in docker without implementing it in code

[PedroMartins-uxmv]

Can you publish to the same topic, messages from different object types?
For instance, in the weather topic, we may want to publish a temperature object, a humidity object etc...
And in the consumer, could we subscribe to the topic and only consume messages of the X object type? Without consuming all messages and checking for the type.

[ankitaghadge.]

I got an error like docker-compose is not recognised by internal or external command. What to do now?

[franciszekkaliszewski]

7:14 When you have 3 partitions and 5 consumers then 2 consumers will be idle! To make use of them you need to rebalance to 5 partitions.

[youcantsee]

Hello I used your docker file but can not start Kafka

[franciszekkaliszewski]

Two consumers from the same consumer group will never consume from the same Kafka partition, by design.

[johndoe-cdvt]

is it apache kafka (free) or the confluent paid licensed offer ?...

[anandsutrave]

is apache kafka different from confluent kafka?

[karthikkeyan]

Ohh for god's sake. Please rehearse well before recording. Too much of pauses in between sentences tests the patience of the listener. I hope you could take this criticism constructively. Otherwise, it's well put-together content. Keep it up.