Kafka Tutorial | Python Producer and Consumer code | Python with Apache Kafka

Video includes:

How to develop Python code to connect Kafka server.
Producer and consumer API and Python code

pip install kafka-python
conda install -c conda-forge kafka-python

[masonmeredith]

you may have saved my grade with this video, I appreciate it!

[udupi]

Very simple and easy to understand video, ,, Thanks a lot

[joshmkhari]

Solid video, helped direct me on the right path

[HarpreetSingh-epfz]

Thank you so much for this video!

I have used your video for the configuration on Linux Ubuntu and it works!
I have a small question...
I want to work with the Kafka server for streaming data, but I can not find how to fix it. Do you know how I can connect to the Kafka Streaming service with an IP and port number?

[Navinkumar-incn]

Thank you for this video its help me a lot.

[udforall]

Hello, How can we get the consumer data into the JSON file or what we required files? Please suggest

[minaxihiavaraye]

can you please share some tips how we can save consumer side data into csv file ?
Thank you

[deepakgupta-vjbc]

is there a way to replace the Celery Beat with Kafka Producer and Celery Task with Kafka Consumer in Django?

[venkatkrishnan]

Can we use this for message sending act like web socket

[pranavmishra]

very useful video, can you make a video on how to make small services using python like for example if you could help us in integrating Kafka with flask meaning with the help of flask send the data stream like fake events from any source for testing purpose to the Kafka

[kottakaburlu]

Excellent video. Need help python for below scenario

In our project when user upload file from UI then kafka message generating json format with below details.
id, file loc, date, user name

to automate file validation I want read kafka message to get id, filename.
then i will compare that id, file data in hive table.

to achieve above process using python what are the details to I required.

[kaushalkumar]

thanks successfully repro producer consumer using jupyter notebook on my windows...

[kumarabhishek]

Can you please make a video on storing Kafka records in postgresql database

[sujanyerremsetti]

i am getting error while creating a topic using python "rdkafka#producer-1| [thrd:background]:Purging 1 unserved events from background queue can u please tell how can i clear this

[tejaswinik.n]

I am able to Setup Kafka manually I am able to send messages using producer and receive using consumer, but when the same thing was run in python no message was sent to Kafka consumer

[NarendiranKrishnan]

hi sire, your video is osmmm, But there is one problem i am still facing till now in the kafka producer Jupyter notebook i.e. in the python integration, Where when my producer sends the message i always receive an error

KafkaTimeoutError: KafkaTimeoutError: Failed to update metadata after 60.0 secs

I did exactly follow your tutorial and still ended up with this, if possible can you help me out?
it will be great.. . and thanks in advance.

[angberaature]

Hi, how can you stream a csv file on a localhost to your kafka topic

[unwantedopinion]

hi, can u also make video on Streaming API in kafka using Python and also how to use all three {producer, STream, Consumer}APIs all together.

[mellamputisriramchowdary]

Really good explanation, But i want to connect remote kafka server to do this operations, Apart from local host i need to give ip address and username password. Please can you help how can i do it ?

[alokkumar]

how to list out the number of topics available using python?