Part 7 - Kafka producer in python | Kafka for beginners

In this video we will be writing a Kafka producer in python that will be sending messages to Kafka topic. we will use the Kafka-python library for this purpose. we will also use the Faker module of python to generate some random data.

pip install kafka-python
pip install Faker

[pyalgoGPT]

Salute, you saved life of those who Python programmers, who want Do advance analytics with only Python, with using some other tools,

[ritujsrivastava]

It helped me a lot. Your whole Kafka for beginners series is really helpful. Thanks for explaining each and everything.🙏

[tejassontakke]

Thanks for explaining in the simplest way. Thanks a ton..!! Please create a new playlist on more advanced topics related to KAFKA.

[manindersingh]

Love you brother. Great way of explaining the things. Please make more videos you have talent to explain the things in easy way. Thanks alot

[atulbisht]

thankyou for giving us your valuable time....

[prashantmehta]

Awesome content and lucid presentation. This channel will grow big, keep it up.

[elvioram]

thanks a lot for you video. very clear!!

[stefkostov]

Thank you for the tutorial you explain very good

[madhulikamitra]

i started kafka with python and your video is saving my life. I have a question though and it maybe my ignorance but i have gone through java setup for using kafka and there slf4j is used for logging. is there any similar logging technique for python?

[noorbasha]

Hi i am getting error. NoBrokersAvailable
even kafka server and zoo keeper running it is throwing error how to fix it
Thanks in advance

[sarathbaiju]

Hi sir, is any options to see published message under a topic in UI?
Or is it any rest api endpoints available for the same?

[yanxon]

Hi thank you for the awesome tutorial. I believe it’s possible to use python to create topics instead of using CMAK.

[podunkman]

U have talent to create very clear, high value tutorials. Thanks to you I'm starting to understand what Kafka is. I have experience with REST services and I do not understand few things:
"producer" is not a part of Kafka but external program that delivers messages using Kafka protocol? "Consumer" is any client that ask for/receive information?

But in most of cases client will inform "I want information now". We do not want to keep it sending all the time. For instance I want to get row with ID x from database. How to create such 'producer'? How to ask for such row from client side?

[rajshetty]

Hello sir, I've watched all your videos in this series, just wanted to confirm, this is a basic Kafka stream right? The producer is sending random fake date and the consumer is consuming it in real time

[soumax]

You teach so well. Can I connect with you so that I can get some guidance in my big data learning path.

[ryanrodrigues]

Is using an infinite loop the only way to have my producer produce data. Is this a common practice in production environments?

[tommylg]

Hi, in this case you are connected directly to Kafka server in case of if this server failed. How producers can contact to another broker? Let say if Kafka cluster implemented

[tarunmittal]

why we use faker library in this sir could u please comment.

[AnkitBhardwajjgd]

there is no error but still, i can't see messages under my topic. Anyway to debug?

[harshitamittal]

I used producer.send in my code. Code is successfully run as well but it is not showing in ui.. how to debug this