Integrate Kafka and MQTT - How to connect MQTT and Kafka

MQTT and Kafka can be integrated. I will show 5 different options on how to connect MQTT & Kafka. We will implement 2 of these options together.

The code can be found on GitHub:

If you want to know more about MQTT, follow my MQTT beginners guide here:

If you want to learn about Kafka, have a look at my usecase with a real-time maps scenario here:

The mentioned blog of Kai Waehner can be found here. It is wonderful.

[giuliocattarin]

Super helpful, thanks a lot for the tutorial!

[robinzclark]

Great video. Thank you so much. Awesome dog too.

[abdulmeral]

thank you very much man, i made my project thanks to you ;)

[xavierpierre]

for avoid concern like you have b'temp' due to ascii encode you can use utf-8 encode and then after on mqtt_kafka_bridge you can use :
msg_payload = str(message.payload.decode("utf-8", "ignore"))

And thanks for your tutorial i follow it and it's work well even if for kafka part we need to follow your playlist for install kafka on windows and do some configuration to be ready i success to make it work and i'm thankfull to you for that it's a very nice tutorial.

[michaelnicholson]

Nice video.
The delay in your consumer and bridge during option 2 demo was because you had some text selected in the command prompt. Unfortunately I do it all the time :-)
I look forward to your video on Confluent Kafka.

[Lionhat-]

can you make tutorial how to send data mqtt to MySQL database

[rezahamzeh]

Amazing! Can you please create a tutorial for Confluent Kafka? It seems COnfluent is more production-ready than pykafka and kafka python