Apache Kafka and Python

Code and data go together like tomato and basil; not many applications work without moving data in some way. As our applications modernise and evolve to become more event-driven, the requirements for data are changing. In this session we will explore Apache Kafka, a data streaming platform, to enable reliable real-time data integration for your applications.

We will look at the types of problems that Kafka is best at solving, and show how to use it in your own applications. Whether you have a new application or are looking to upgrade an existing one, this session includes advice on adding Kafka using the Python libraries and includes code examples (with bonus discussion of pizza toppings) to use.

With Kafka in place, many things are possible so this session also introduces Kafka Connect, a selection of pre-built connectors that you can use to route events between systems and integrate with other tools. This session is recommended for engineers and architects whose applications are ready for next-level data abilities.

Speaker:

[t.f.]

I wish every tutorial on YT would be that well presented and clear. Thanks for the effort!

[talktotask-ubfh]

Excellent video presentation and very nice technical content explained.
+1 like and +1 subscriber.

Thank you.

[sashakhalikov]

This is the best Kafka tutorial I've seen. Inspiring work. Thank you.

[nachoeigu]

The best explanation I have seen about Kafka

[sirharis]

This was so comfortable to watch and easy to grasp the concept with the analogy presented. Well done.

[danielmijailalpistesarmien]

I cannot believe that this channel stopped doing videos at all. Excellent explanation! I will surely follow you!

[naveenbanappa]

Thank you. Wonderful content with clear and understandable explanation on the basics.

[smtek]

Exactly what I needed for a project, thanks!

[kajalmishra]

You presentation, and the way of explaining each slides is amazing.

[BenjaminKelm]

Thank you for your tutorial. Very clearly presented!

[volodink]

Hi! Thanks for the great explanation! Can you share theese jupyter notebooks?

[daqa]

excellent presentation, thanks for the tips.

[michastachowski]

Thank you for a great explanation, Francesco :)

[saddamkhadra]

Thank you for the great explanation, very detailed, I wonder if there is any possibility to download the code for educational purposes

[vinodsingh]

Can you guide me anywhere I will get code for practice purpose, thanks

[victoriwuoha]

Concerning this.. How would Kafka already initiate a primary key on the sink table? Would it be better to create the sinks first?

[sourav_-_]

i wish i knew about this kafka shit before, i made a similar thing with websocket for fast component communication. lol

[RahulChauhanart]

Hi, how do I close consumer for indefinitely waiting for the message?

I tried this
for message in consumer:
...
consumer.close()

but consumer is keep waiting for msg even though there are no msg in the queue

[gleblobinsky]

Could you make a video how to use Kafka peek or how to do something like kafka peek using Python?

[badrelmazaz]

Avoid pizza all'ananas and pizza al cioccolato hahaha, love from Italy