Kafka implementation in Spring boot 3 Microservices | Producer and Consumer | Code Decode

In this video of code decode we have implemented the kafka in spring boot 3 microservices
If you want to participate in Mock Interview send your nominations using the below google form

Udemy Course Discounted Link

This video provides a comprehensive overview of setting up Apache Kafka and creating two microservices using Spring Boot 3. It includes installation steps for Kafka, details on using the @KafkaListener annotation for consuming messages, and an explanation of consumer groups, offset management, and partition assignment in Kafka.

Kafka Installation:

Download a Kafka binary (e.g., Scala 2.12 or 2.13) from the official site.
Extract the downloaded file and navigate to the Kafka folder in an administrative PowerShell.
Start Zookeeper and Kafka servers using specified commands.
Setting Up Microservices:

Utilize Spring Initializr to create two microservices with dependencies on Spring Web and Kafka.
Key Concepts:

@KafkaListener Annotation: Marks methods for message consumption from Kafka topics.
Topics Attribute: Specifies the Kafka topic to listen to, with values resolved at runtime.
Consumer Group: A set of consumers sharing the same group ID to balance message processing load.
Kafka Behavior:

Load Balancing: Kafka assigns partitions to consumers within the same group, allowing parallel processing.
Offset Management: Kafka tracks message offsets for fault tolerance and high availability. Each consumer group maintains its offsets, enabling recovery and scalability.
Temporary Directory and Offsets:

The __consumer_offsets internal topic stores offsets for consumer groups, aiding in message processing continuity.
The recovery-point-offset-checkpoint file is used for tracking last successful offsets, ensuring integrity during recovery.
Overall, the content illustrates the practical steps to install Kafka, create microservices with Spring Boot, and understand the critical concepts of message consumption and offset management in Kafka.

[DhritimanPandit]

please continue this series, great video, implemented the same without any issues.

[DancerLashya]

That is an excellent explanation, Please do the videos for Kafka for multiple producers and stream API and connectors as well it will really help my career. You are really doing a great job.

[filmy]

Very knowledgeable and informative session👍

[sujithak]

Please continue this series, this is much helpful, thanks !

[physrivdos]

Guruji, Please create the next level video. 🙏
Thanks for introducing the kafka guid tool, it is really useful explore the topics quickly.

[satishdhaigude]

Very nice explanation, could you please make one more video with multiple producer and multiple consumers

[taufeeq]

helpful ma'am please continue the series

[sandeeppatil]

Very helpful Mam please continue series, thanks

[physrivdos]

Thank you for the gr8 video.
One suggestion. It would be gr8 if you could use dark mode wherever possible ✌

[SivaKumarR-rx]

Great explanation mam waiting for next video

[rajanid]

Thank you so much for the great explanation. Most awaiting concepts. Waiting for the next topics which you said in the video and also can you share a video for handling failure mechanism.

[pranawkaushal]

Please create a video on multiple consumer & producer. I have asked similar question on interview to handle situation in multithreading env.

[prudhvimokrala]

Thank you for this video.
Can you explain multiple producers, multiple consumers using kafka streams.

[vikram]

It is very useful for us & Thank you ! If you can make video on aws lambda it will help us to understand.

[mahithakotha]

Very informative video. Could you please share a video on kafka streams and avro serializer, deserializer and details on streaming part

[mnsravani]

Hi mam.tq so much for sharing this knowledge.here 2services is not taken right.

[sarannav]

Love the content. would you mind answering this ? shouldn't the consumer properties for key and value be stringDeserializer? wondering how it works even if you've given as stringSerializer.

[RAVIKUMAR-rsfd]

how do we handle exceptions while listening from producer if something goes wrong and vice versa

[raj]

Where can we find the previous video related to Kafka which you were referring in the video? I looked thru the channel I didnt find it

[Yogesh-qp]

Hello Ma'am, is it possible to share that document in description? It will be very helpful for us.