RabbitMQ vs Kafka | Trade-off's to choose one over other | Tech Primers

This video covers the differences between RabbitMQ & Kafka by using an Event Driven Architecture case study

Join this channel by contributing to the community:

🎬Video Editing: FCP

---------------------------------------------------------------
🔥 Disclaimer/Policy:
The content/views/opinions posted here are solely mine and the code samples created by me are open sourced.
You are free to use the code samples in Github after forking and you can modify it for your own use.
All the videos posted here are copyrighted. You cannot re-distribute videos on this channel in other channels or platforms.
#RabbitMQ #Kafka #TechPrimers

[manojBadam]

Thanks for the nice video. I'm new to rabbitMq couple of questions to understand it better

1. What happens in RabbitMQ if all the consumer apps are down? will the queue persist the message until one of the consumer comes online?

2. In rabbitMQ, how does broker knows about the eventType? does it read the. payload or there are any headers to define the eventType?

3. If i were to have a blue-green deployment model for my consumer apps. Can we define smart rules in rabbitMq broker to send events to blue or green stack dynamically ?

4. If my rabbitmq queue consumer died during the processing, can another consumer re-process the same message ?

[cheequsharma]

I was searching about the difference at so many places, but you made the search a full stop. This is no concrete and to the point Explanation. Thanks a lot mate. Subscribed for more. Thanks again, this take a lot of efforts to make such content, much appriciated . :)

[devashishrana]

Appreciate the video :D

I think for event distribution in case the events are decoupled you can create two separate topics in KAFKA
1. TOPIC_EVENT_1
2. TOPIC_EVENT_2

Once created, you can create two consumer groups
1. CONSUMER_TOPIC_EVENT_1_AND_2
2. CONSUMER_TOPIC_EVENT_2

Hence, you can add first consumer group to both 1st and 2nd topics, second to only the 2nd topic

[mkbhd]

Thanks much for putting efforts to explain things in a simpler way as always. I wish you get more viewers/subscribers that what you have right now. Only one suggestion from my end is please try to post more videos. I know it's not easy as I said, as it takes lot of your time. Thanks again!

[abhilash]

very well explained. You are really doing a wonderful job. These videos help a lot in understanding the concepts. I wish you good health and lots of success.

[haleemafatima]

You've an excellent understanding Sir! Thank you for simplifying this

[chitthiaayeehai]

I have not worked on RabitMQ just have done a few pocs, but Kafka hands down is the most powerful tool i have seen in my career. Spring gives out of the box integration with Kafka and u can plan ur fill application on these two monsters. Kudos !!! to u dude as always :-)

[BrianStDenis-pjtq]

Liked. Well done, and well spoken. Question about your last point on the Kafka limitations about producer coordination regarding partitions. In my experience, producers produce to a topic, not to a partition. And, Kafka evenly distributes the messages across the partitions within the topic. In that scenario, producers don't know or care about how many partitions there are. Are you referring to a mode where producers specify or know about the partitions?

[HariHaraKumar]

Thank you for your continues efforts to educate others.

[CyberGenious]

definitely a good comparision for a beginner to understand . thank you very much for your efforts.

[tayibahmed]

In the example at 6:05, you mentioned Kafka would store different event in different partitions - I guess you meant different Topics?

[sriaya]

Nice video sir, with spring cloud stream we can configure in a generic way so that we can change from rabbitmq to Kafka and vice-versa.

[anuragagnihotri]

Thanks for the detailed video. At 07:57, Kafka has high throughput and highly scalable. What is the comparison with Mb/sec and Req/sec and also what makes RabbitMQ having less throughput is it handling of new messages or storage layer?

[chilukabharath]

the point what i am searching for 3:22 to 3:44 thank you!...

[bautistabaiocchi-lora]

thanks for the video, its exactly what I was looking for.

[sagartyagi]

About the coupling n decoupling part...how about using consumer groups?

[harbaapkabaap]

Thanks for the nice video! One thing is not clear, what do you mean by "streaming" in kafka? Can you show some messages in action with and without streaming? TCP/IP always streams data, so what do you mean by streaming in kafka? Also RabbitMQ also support pub/sub so the pub/sub example you showed can fit to both the tools.

[rhexcasas]

Thanks nice video. Easy to understand.

[babe]

Thanks for the very well summed up video. Here are few queries for me
1.Since kafka is cluster, we have high availability.Is there a way of having high availability for Queue?
2.If kafka is down for a while, even with 1 broker, it can get all messages from the saved files of local system, is it possible to recover mssgs if quqe is down for a while ?

[MA-zotb]

Very good background. However I think it comes to the scenario you presented (good choice of scenario), the options presented are NOT close to real world scenarios being implemented. If someone is doing that, they don't understand the cost and technical implications from choosing either Kafka option 1 and option2. ... It would be good if you can dig deeper into the situations where there is combination, failures, and you are not offloading everything into Kafka.