Apache Kafka Tutorial with Spring Boot Reactive & WebFlux | Kafka Tutorial

🎁 🚀 COUPON Code: EARLY_BIRD_30

We'll explore the nuances of Kafka Clusters, Producers, Consumers, Topics, Partitions, Consumer Groups, Offsets, and demystify Serialization.

As part of our comprehensive demonstration, we'll construct an entire application designed to consume a reactive REST API stream utilizing Spring Boot Reactive and WebFlux. The producer component will dispatch events to a Kafka broker, while a dedicated consumer will process and store this data seamlessly into a DynamoDB database.

Recommended Courses:

CONNECT WITH ME:

Table of content:
00:00 Intro
04:02 What is a message broker
06:13 Kafka overview
09:42 Kafka Cluster
11:06 Kafka Broker
12:14 Kafka Producer
12:54 Kafka Consumer
13:37 Kafka Topic
14:46 Kafka Partitions
17:38 Kafka Partitions Offsets
21:37 Kafka Consumer Groups
23:13 Kafka Installation
25:30 Play & Explore Kafka
33:08 Create a new Spring boot project
34:18 Configure Kafka Producer and Consumer
40:50 Configure Kafka Topic
42:57 Create a Kafka Producer
46:10 Create the REST API
48:40 Send the first message
50:36 Create the Kafka Consumer
54:23 Configure Kafka for JSON Object & Serialisation | Deserialisation
58:04 Create Kafka Json Producer
01:01:37 Adjust the REST API
01:03:48 Configure the truster packages
01:07:08 Adjust the Consumer and test the changes
01:09:58 Real world application - Overview
01:15:04 Create the Producer project
01:16:34 Configure the producer
01:18:29 Configure the WebClient (WebFlux)
01:19:25 Create the Wikimedia Kafka Producer
01:21:11 Create the Wikimedia Stream consumer
01:25:14 Consume and Publish to Kafka Topic
01:30:40 Implement the Kafka Consumer
01:35:06 Test the application
01:35:52 Outro

#SpringSecurity #kafka #apachekafka #tutorial

[igxcwss]

The best kafka tutorial I have ever seen, On top of that the diagrams make the things really understandable and to relate with the code.

[guuridev]

Not gonna lie, this channel is top tier Spring Boot content nowadays.
Straight to the point, made it look so easy, well explained with pragmatic methods, 10/10, salutes from Spain 🫡

[magadiflo-dev]

Great, I really like when you use diagrams, I feel it is easier to understand the concepts, thank you very much for the time you took to share this knowledge.

[MalobikaNandy]

Great content. Learned a lot. Thank you!

[ogookafor]

Awesome. So far I've covered about 7 hr in total of your tutorials. It's hight time I clicked the Join button. THANKS ALOT.

[arefsa]

Ali, you teach us how to walk and learning to run is our duty. Thank you for your exceptional teachings

[abdelhaibouaicha]

Generated by Talkbud:
📝 Summary of Key Points:

📌 Kafka is a distributed, fault-tolerant, and highly scalable message broker and stream processing platform. It can handle large volumes of data streams in real-time and provides advantages such as scalability, durability, fault tolerance, and real-time processing.
🧐 Kafka consists of components such as Kafka clusters, producers, consumers, topics, partitions, offsets, and consumer groups. Producers publish messages to Kafka topics, consumers subscribe to topics and process messages, and topics can be divided into partitions for parallel processing.
🚀 The video demonstrates how to install Kafka and configure topics, producers, and consumers within a Spring Boot framework. It also highlights the importance of serialization, deserialization, and offsets in Kafka.
📌 A real-world example is presented, showing how to create a Kafka topic, configure a producer and consumer, and implement a reactive REST API that consumes data from a streaming source and publishes it to the Kafka broker. The consumer transcribes the messages into a database, ensuring no messages are missed.

💡 Additional Insights and Observations:

💬 "Kafka allows for the decoupling of producers and consumers, enabling flexibility and independence in application development."
📊 Kafka is designed to handle large volumes of data streams and can process millions of messages per second.
🌐 Kafka has a rich ecosystem with connectors for integrating with various data storage systems, stream processing frameworks, and analytics tools.

📣 Concluding Remarks:

The video provides a comprehensive overview of Kafka and its components, explaining its benefits and capabilities. It also offers practical examples of how to use Kafka in a Spring Boot application, demonstrating the configuration of producers, consumers, and topics. The video emphasizes the scalability, fault tolerance, and real-time processing capabilities of Kafka, making it a powerful tool for handling large volumes of data streams.

[whfjmjo]

Zo`r tushintirib qo`yibsiz, Alloh rozi bo`lsin, ko`p narsalarni sizni darslaringizni ko`rib o`rganyapman👍👍👍

[QuickMixKZ]

Kafka has a reactive client. The title of the video is confusing. I expected to see an example of using a reactive client here.

[jasongoossens]

Very good tutorial! I like the no-fluff approach! (but OTOH, that makes it slightly less tailored to complete beginners 🤷‍♂)

[tobbythebeast]

your tutorials are the best.you are my savior as always.keep up the good work.love you 😘😘😘 (plz consider doing tutorial on Kafka streams)

[haykelmaaoui]

Great work Ali, we are still waiting to explain how debugging with Intelij like evaluate expression, ....

[cyxmltd]

Really Great and Helpful for me Thank you!

[wilsonvaboum]

Autrement dit 😀, very nice tutorail, well done

[AmayasABBOUTE]

Great tutorial ! Do we need a zookeeper systematically when we use kafka ?

[naderayed]

Thank you very much, Mr. Ali, for your efforts, I appreciate it <3 <3 . I'm interested in finding a solution to start up Kafka and Zookeeper using Docker. I believe using containers would be more efficient .

[ramanav]

can you guide me on how to do Kafka clustering in the spring boot application, do one video one how kafka brokers work in real time applications

[saurabhmaurya]

how can we fetch all the messages from the particular topic after hitting end-point url ?..Help me with this..I tried To do with the help of KafkaConsumer<String, Comment> consumer .. this has a method poll .. but after hitting end point i'm getting null in consumer..please help me with this ..

[qqzbkeg]

Did only I notice that the script for introduction is ai generated, and it is obvious that you are reading it.

[TikTokTrendsCompilation]

Finally! Just Please don't make a generic tutorial with boilerplate minimal kafka producer/consumer example. Everyone already made tutorials for that. There are tons of blogs posts for that.I already learned how to setup the basics of kafka to work and many people also figured it out, or if they havent yet they can easily learn in 10 minutes. We don't need another 1057th tutorial showing the basics of producer/consumer with kafka.

Please turn this tutorial series into a practical real world project that uses kafka, such as a chat app, live-stream, or any real world usage with kafka. I don't know how to use kafka in a real world project because no one explains it. You could be the first one to finally explain it. How do i even connect kafka to a frontend angular/react/nextjs project? I have no clue. NPM doesnt even have a kafka library.

How would i deploy kafka to AWS production app? I have no clue because no one explains it. Please make sure the tutorial series covers these concepts otherwise the tutorial would be no different than 1000s of others that already exist.