Get Started with Amazon Managed Streaming for Apache Kafka (MSK) | Amazon Web Services

In this video, you’ll see how to get started with Amazon Managed Streaming for Apache Kafka (MSK). You’ll learn how to provision an MSK cluster, create a Kafka topic, and produce and consume messages from the cluster.

For more information on this topic, please visit the resource below:

Subscribe:

ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.

#AWS #AmazonWebServices #CloudComputing

[Veewarrior]

Here are the commands if you are looking for them (I used kafka version 3.5.1) :

sudo yum install java-1.8.0
tar -xzf kafka_2.12-3.5.1.tgz
aws configure
aws kafka list-clusters
--bootstrap-server <server info> --create --replication-factor 3 --partition 1 --topic <topic name>
--bootstrap-server <server info> --list
--bootstrap-server <server info> --topic <topic name>
--bootstrap-server <server info> --topic <topic name> --from-beginning

[paulmakhabane]

Please share the commands run from the video

[abhaysharma]

Whether the brokers were created inside the private subnets ? Also the client EC2 machine was also created inside one of the same private subnet in which brokers were created ? Please clarify ?

[HANEUIJUN]

Thanks for the nice video, it could have been even better if the command used in the video are attached here as well. Anyway thanks again for great video!

[MichaelBriggs-ovgh]

If I understand correctly, we need to attach an IAM role to our EC2 instance for this to work, yet there's no explanation as to what additional permissions we need?

[flesz_]

MSK (account A) will get accessed by Kinesis Data Firehose over multivpc private connectivity from account B
For inbound rules I would need to configure 14001-14100 port ranges as multi-vpc uses them.
However what source IP range to use when the MSK is accessed from the Kinsesis ?

[flesz_]

I am getting access denied, configured IAM role and used encryption (not plaintext) . it would be nice if someome could provide correct config for the policy

[ziranshuzhang]

Why can't you put those installation command and the material we need in the comment so we can follow the video much easier.

[PoojaGupta-bikw]

I'm new to AWS. I've a requirement to create an springboot producer app which connects with MSK and produces the data, could you help me with cluster config and sprinboot app configs in this case?