Kafka Deep Dive w/ a Ex-Meta Staff Engineer

Kafka is a must-know technology for System Design interviews. This video, with a former Meta staff engineer, breaks down the essentials, starting at a high level and working our way down into more and more detail.

00:00 Intro
01:53 Motivating Example
08:09 Overview
18:41 When to Use
23:43 Deep Dives
41:54 Conclusion

Full writeup here:

Connect with me on LinkedIn:

Preparing for your upcoming interviews and want to practice with top FAANG interviewers like Evan? Book a mock interview at:

Good luck with your upcoming interviews!

[scarlettc]

relied on your videos heavily while preparing for my system design interview and accepted my staff engineer offer today. you're doing the lord's work by not putting this content behind a paywall. will recommend your stuff whenever someone asks me for interview prep resources in the future. 🙏🙏

[KolliMadhukar]

1 Hello interview video = 100 exponents and medium articles thanks a ton for these

[ediancomachio]

You have amazing teaching skills! The World Cup example was incredibly good and entertaining to watch. I’ve paused my interview journey for now, but I always watch your videos for the pure knowledge they provide. Thank you so much!

[aghileslounis]

It's not just for an interview at this point but a VERY high quality Kafka course!

God, you're so talented 😲

I don't know if it's just me, but it's EXACTLY how I like to learn new things, diagrams, some code and a high quality high level overview. The rest I'll figure it out easily.

People will love your courses if you decide to make some, it's very rare for someone of your level to take time to explain that well

[t.jihad]

This covers something that many other system design resources doesn't cover, which is the answer of why, when and trade-offs. Thank you so much.

[AdemolaBuwo]

This is pure gold right here, my God! 🤯. Thanks for taking the time to break down these concepts.

[sambitdash]

This is amazing content. The worth of these videos is in gold. Please keep these free always. Please dont ever pay-wall these videos. Thanks again. 🙏

[abhijit-sarkar]

37:12 - The way idempotent producer mode works is that each producer is assigned a unique id, and each message from a producer is assigned a monotonically increasing sequence id (per topic). The server will discard a message if it's sequence id is not greater than the latest seen by the topic.

[mouadet-tali]

Haven't seen videos that explain things so clearly since Ali Ghodsi Data sciences lectures

[MrSnackysmorez]

I cannot thank you guys enough for putting these videos together! The way you lay the points out and provide the information really goes well with my learning style. Please keep them coming as I cannot get enough of these. Your content is the best out there in terms of teaching of teaching system design!

[amikaichuang]

The best system design video about Kafka I have ever seen.

[SantoshKumar]

Most awaited topic. Thank you for the detailed and insightful video on Kafka. Your every video is a gold mine. 🙏🏻 ❤

[karvinus]

I always struggled to choose between queues, stream and pub-sub but this video makes it super easy to understand what to use and when to use.

[bjugdbjk]

by far, this is the best, Explaantion with an usecase s the selling point for your channel subscription!
Amazing efforts, your knowledge sharing is highly appreciated, Thanks a ton brother.
Website is quite an another very informative resource, Thanks again for keeping it free.

[anirudhheda]

This is awesome. Answered all my questions within the first 15 minutes. The rest was just bonus xD. Would love to see more content!

[goyalpankaj]

This is hands down the best Kafka explanation I have seen so far :)

[viveksharma-ttnj]

Thank you so much for such details explanation !! after watching got another perspective of handling failure scenarios using retry and dead letter queue. Thanks again for such a great content !!

[prashantmishra-ywxu]

Great explanation, you made all the intricacies of kafka sound so simple, thank you so much for making this video !!!

[cineramafilms]

This video is so so good! I am lucky to have found this before my interview!

[sidforreal]

Just went through the whole video, and loved it depth of the topics you have explained