Beginners: Getting started with Kafka Python and Elastic Search | Hello world Example with Code

preview_player
Показать описание
Рекомендации по теме
Комментарии
Автор

Hi Soumil,
Thanks for the amazing video, I had a few doubts regarding using kafka for microservices.
1. When kafka is used, is the consumer microservice simply a python program that keeps on listening using while loop ? Or can we put it in server (like fastapi) somehow ? I am assuming if we put it in server, we need to hit an api endpoint everytime we want the consumer to consume something and I am not sure how will this consumer be realtime.
2. If the consumer crashes, how to make sure that when it start again, it doesn't read the already processed messages and neither looses any messages sent to kafka at the time it was dead ?
3. How to horizontally scale the consumer such that one message is read only once ?

harshraj_
Автор

sir its stuck here and wont go any further
broker | [2024-04-03 02:20:47, 565] TRACE [Controller id=1] Checking need to trigger auto leader balancing

flosrv
Автор

can u pls make some videos on low level design

khushaltrivedi
Автор

Hii Soumil,
Could you please tell me in this tutorial what is the use case of elastic search ?

Gaurav-wywm
Автор

How can I start Elasticsearch on my local?

xcimbom