What is Kafka? Kafka Tutorial for Beginners

this introduction to kafka video, gives a pretty detailed overview on how apache kafka works and how you can use it your own system architecture. this gives a details understanding of the kafka architecture as well as key concepts such as topics, partitions, brokers, clusters, producers, consumers and consumer groups.

in addition we look at how you can scale your kafka architecture achieving scalable throughput using topic partition keys and by understanding how topics and topic partitions are scaled across a cluster. we also look at how you can achieve high availability with partitions and brokers in cloud environments through use of cloud availability zones.

if you are an architect or system designer this tutorial will give you a good understanding of how kafka works and how you can use it in your own architecture or designs.

00:00 - intro
00:32 - apache kafka overview
01:05 - producers and consumers
02:13 - kafka brokers
03:00 - producers sending messages to brokers
05:38 - brokers and topics
06:33 - topic partitions
09:10 - kafka clusters
10:30 - apache zookeeper and kakfa clusters
11:28 - scaling zookeeper
13:28 - topic partitions and fault tolerance (leaders and followers)
20:00 - distributing topics across clusters
24:49 - achieving high availability using availability zones and rack awareness
33:32 - message ordering within topic partitions
42:30 - message delivery acknowledgements, transactions and exact once delivery
50:55 - consumers and consumer groups

[nkwejusticemapoulo]

Thank you very much my friend this is awesome

[bjugdbjk]

Luv u man !! fantastic, I follow ur rust lang tutorials, they helped me a lot and this kafka stuff really given lot of insights.
If possible could you make similar one on kubernetes based dev project .

[saiyedayaz]

Well explained !
Thanks Chris Hay for the efforts 🇮🇳

[KheraShanu]

Here before this guy even had 100k (or even 1k) subs!