How to Install Kafka Using Docker - Write Your First Kafka Topic | Better Data Science

The first video in the Apache Kafka series. Learn how to set up Kafka environment on any OS (Windows, Mac, Linux) using Docker. Create your first Kafka topic, and learn how to connect shell and Visual Studio Code to Kafka Docker container.

» ARTICLE LINK

» FOLLOW BETTER DATA SCIENCE

» FREE “LEARN DATA SCIENCE MASTERPLAN” EBOOK

» GEAR I USE

[deeproy]

thanks man. Helpful content ...just a word of advice. Try to zoom more into the screen.
adding the docker compose file:
version: '3'

services:
zookeeper:
image: wurstmeister/zookeeper
container_name: zookeeper
ports:
- "2181:2181"
kafka:
image: wurstmeister/kafka
container_name: kafka
ports:
- "9092:9092"
environment:
KAFKA_ADVERTISED_HOST_NAME: localhost
KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181

[stevecanny]

Great job Dario, thanks for this, this helped me a lot! :)

[___vandanagupta___]

After watching so many videos, I understood finally from your video ! Thanks so much

[anusha]

Nice explanation for kafka beginners. I am going to follow this series! Thanks so much.

[yneewyp]

Hi Dario! Thank you for this video. It is very useful. I read your article about this video and i saw "you won’t write producers and consumers today, but you will in the following article". Pls tell me where i can find next article?

[mvs]

gud shor video, please make sure to zoom in, it will help a lot

[cellentmaya]

Thanks for the video and the images. Your images worked great!!!... Can you share how you set up your Dockerfile to create both images?... I tried using your setup (docker-compose.yaml file) with verified images but it didn't work. It exited it right away.

[MJ-tntw]

9:27 /bin/sh how to enter interactive mode in terminal following it in mac actually stuck here thankyou

[seamuswaldron]

Using a Macbook Pro M1, I found that the kafka container would always fail to connect to zookeeper on boot and exit. 

The error was:

INFO SASL config status: Will not attempt to authenticate using SASL (unknown error)

To solve this, I added one extra variable (KAFKA_LISTENERS) to the environment section of the yml file:

environment :
KAFKA_ADVERTISED_HOST_NAME : localhost
KAFKA_ZOOKEEPER_CONNECT : zookeeper:2181
KAFKA_LISTENERS : localhost:9092


I also chose to use the ubuntu containers:

ubuntu/zookeeper
ubuntu/kafka

I hope this helps anyone with the same issue.