Spin up Kafka Broker and Zookeeper on Docker

Spin up Kafka Broker and Zookeeper on Docker

Commands

docker stop zookeeper kafka
docker rm zookeeper kafka
docker run --name zookeeper -p 2181:2181 -d zookeeper

docker run -p 9092:9092 --name kafka -e KAFKA_ZOOKEEPER_CONNECT=husseinmac:2181 -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://husseinmac:9092 -e KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1 -d confluentinc/cp-kafka

🏭 Software Architecture Videos

💾 Database Engineering Videos

🛰 Network Engineering Videos

🏰 Load Balancing and Proxies Videos

🐘 Postgres Videos

🚢Docker

🧮 Programming Pattern Videos

🛡 Web Security Videos

🦠 HTTP Videos

🐍 Python Videos

🔆 Javascript Videos

Support me on PayPal

Become a Patreon

Stay Awesome,
Hussein

[rsantamaria]

Thanks for all those explanations. You are excellent. And I like when you talk about « Listeners » that is also the way I prononce it in my head when I am writing. Thanks again.

[thedrunkencatlady]

Thank you so much for the simple tutorial!! ☺☺

[anl]

I'm saying it after a lot of try: It's still the easist way to spin up a healthy kafka server in 2023! <3

[weitanglau]

Great video!
Can you also make a video on deployment on kubernetes as well?

[erwinrommel]

How do you configure the topic inside your kafka could you show that

[abusufiyanathani]

I am getting an error saying zookeeper audit is disabled, can anyone help me..

[PiyushKumar-odei]

Can one video happen using Docker Swarm?

[tSobota]

Hi Hussein, thanks for your video :)
How about one RPC stack video? Thrift or gRPC. How the hell it works internally? :D

[onhazrat]

🎯 Key Takeaways for quick navigation:

00:01 🐘 To set up Zookeeper and Kafka in Docker, ensure you have Docker installed.
00:30 🚀 Use `docker run` to spin up a Zookeeper instance, provide a container name, and expose port 2181.
01:10 📡 For Kafka, expose port 9092, set environment variables for Zookeeper connection, and advertised listener.
03:25 💡 Kafka broker requires environment variables for Zookeeper connection and advertised listener.
07:48 🔄 Configure Kafka replication factor if running a single broker to avoid confusion.

Made with HARPA AI

[seriouslycurious]

My Kafka instance is unable to connect with zookeeper. tried machine name as well as localhost. Any other options ?
Here is the error -

INFO - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

INFO - Socket error occurred: localhost/127.0.0.1:2181: Connection refused

[faisalaleissa]

. Will not attempt to authenticate using SASL (unknown error)

[rahulkumarsingh]

I am getting an error while connecting kafka to zookeeper, it says connection refused.. What to do?

[AhmadEzzeir]

Can we find web ui admin for it

Thanks