Apache Kafka on AWS (Amazon Managed Streaming for Apache Kafka / MSK) by Frank Munz

but now back to the Kafka basics:

Apache Kafka is one of the most popular open-source projects for building messaging and streaming applications. Kafka takes data from various sources, makes it available to different applications, and therefore helps to eliminate daily batch jobs.

Kafka plays an important role for Change Data Capture (CDC) and in the world of microservices. This presentation gives an overview of the new Amazon Managed Streaming for Kafka (Amazon MSK).

Based on knowledge gained from several Kafka implementation projects I will explain some of the technical underpinnings first. You will learn about brokers, topics, and Zookeeper. Then I will explain what makes Kafka special, analyse major pain points in on-prem Kafka projects, critically analyse how Kafka differs from Kinesis, and why the cloud is the best way to use Kafka.

[wendelledgard]

I'm learning about Apache Kafka and I have to tell you that this is the best video I've seen so far. Thank you for the content!

[sejalss]

Excellent articulation of the Kafka and AWS Managed Kafka service. Thank you for your simple and clear explanation.

[Raiseren]

Nice I can now get my ASMR boost while learning stuff.

[sheungching]

Clear and Easy to understand. Thank you

[saravmca]

This is best video for Understanding of Kafka and MSK . Very nice presentation and the explanation

[vasu]

Nice Presentation. Clear and easy to understand about options provided in AWS for Kafka.

[volvosbloke]

Thanks for sharing this, great content, much appreciated.

[gyansheelkumar]

great Content, so Helpful ...Thanks for making life so easier in a single video ..much appreciated man

[RonakZala]

Thanks a lot for this. You made it so simple and clear!

[sujitkumarpatel]

Very nice presentation, video and very good explanation/comparison on Kafka(AWS MSK) Vs. AWS Kinesis. Many thanks for creating this video and sharing. Appreciated.

[ksjadon]

Nice content. For better understaning, play with 1.5 X speed.

[elijahgavrilov]

Great demo. Question is how to make Kafka available outside of private VPC, but for authorized clients?

[subashkannudass]

You should create more videos on Kafka & MSK, thanks

[semalsherathia]

Why did the messages appear in different order when consumed than it was during producer? Is it because we partitioned the topic and hence the messages went to different partition and read in incorrect order?

[p.a]

The messages appeared in a different order from what you entered. Is that normal?

[nainaarabha]

I have one doubt. Can we host multiple kafka producers in one ec2 instance?

[camilas]

What kind of producer partition strategy do you have in MSK? I am looking for this information but I can't find it.

[arpankhetani]

Once we open Session manager, how did you went to kafka folder to run the kafka-topics and other commands in session ?

[ersingharjot]

Hello Munz, Thanks for sharing..
I am looking for Live PM via Kafka data and apply for ML . you have any tutorial on this..

[kalyanimuppidi]

I have got a query as to how you accessed the kafka prompt in session manager during 28:27 time stamp in the video. I need the commands to do it. It will be of great help if you can provide with it.