Apache Kafka Topics | Single Consumer to Multiple Topics | Kafka Consumers

Welcome to my video series on Apache Kafka and in this video we're going to see how we can use a single Apache kafka consumer to subscribe to multiple topics and receive data from multiple topics

Yes, it's possible with apache kafka that a single consumer can simultaneously connect to multiple topics and get the data from the both at the same time.

However, we must remember that when a consumer is connected to a topic, it is actually connected to a partition of a topic. If a topic has only 1 partition, then the consumer will receive all data, and if a topic has multiple partitions, it will receive data from the partitions where it is attached to.

To actually demonstrate the same, I've created a small python program with confluent python as I didn't found any way to associate multiple to a kafka console consumer

Thanks for watching the video, here are the contents of the video

Timecodes:
0:00 : Multiple topics to a single consumer
0:38 : Kafka Console Scripts and Confluent Python
1:01 : Creating Kafka topics
1:28 : Working with kafka console producer and console consumers
1:53 : Limitation with kafka console consumers
2:15 : Kafka confluent python consumer
2:40 : Multiple Topics and Single Kafka Consumer
3:09 : kafka Consumers and Topic partitions

#kafka #apachekafka #kafkaconsumer #eventdriven #softwaredevelopment #programming #streaming

About Me i.e. An Insightful Techie

Greetings and Thanks a lot for checking out my YouTube Channel. I’m Deepak K Gupta (Daksh). This channel is a medium for me to share my learnings and journey as a Techie so that you not only learn from my experience but also from my mistakes

As a techie I am closely associated with software development, so most of my content will revolve around Programming Languages, AI, Machine learning and Databases. I share things which will help you learn, remember and use these things in an effective and efficient way.

As a Techie, I also know that there is a life beyond software development and it has a profound impact on our career as well as on our well being. I also share those learnings which I feel are worth sharing with the intention that it MAY help you in taking better decisions in your life.

Last but not the least, I'm a traveler and explorer by nature. I would like to take you with me on some of the interesting journeys around the world. Believe me there is more to learn outdoors than indoors

Hope you’ll like my contents and will be part of my journey 🙏

[nehalakhani]

Thank you for valuable information. Looking forward for more such videos on Kafka