filmov
tv
Demo of Confluent Kafka Python Wrapper

Показать описание
Problem statement: A real-time dashboard that displays the number of page views per second for a website.
The website generates a high volume of page views, and you want to process them in real-time.
Setup:
Kafka producer - sends the “page view” events in real-time.
Kafka consumer group with multiple consumer instances.
Each consumer instance processes a subset of the messages.
In the video, we see that the consumers are all a part of the same consumer group, and are processing jobs present in different partitions of the same topic.
The website generates a high volume of page views, and you want to process them in real-time.
Setup:
Kafka producer - sends the “page view” events in real-time.
Kafka consumer group with multiple consumer instances.
Each consumer instance processes a subset of the messages.
In the video, we see that the consumers are all a part of the same consumer group, and are processing jobs present in different partitions of the same topic.