Stream processing with Kafka and Python – Ilia Khaustov

Making decisions is impossible without knowledge, and knowledge is obtained from information that evolves from data. While the classical “data warehouse” approach focuses on taking all available data into account, the “streaming” approach is centred around the idea of reacting to events as soon as possible, extracting all the knowledge necessary for decision making “on the go”. Kafka stands out from other message brokers because it’s not a message broker - it’s a streaming platform originating from LinkedIn, a platform well known for its fast-paced communication dynamics. In this presentation you will learn about Kafka, Kafka-Connect and Kafka Streams and dive into a practical example of using Kafka Streams DSL on a real data stream and Python scripts will help to provide input and interpret output to/from a Kafka cluster.