Kafka Streams - Aggregate, Transform & Join With Windowing In 20 MINS | Spring Cloud Stream

In this video will look into how we can do Aggregation, Transformation and Joining using Spring Cloud Stream Kafka Streams

We will look into right from producing the message to a Kafka topic, then aggregating a Kafka stream, transforming it, and then finally joining two Kafka Streams.

-----------------
Gear I use :
-----------------

---- Chapters ---------

00:00 - Introduction
00:27 - Creating Spring Cloud Streams Kafka Project
01:22 - Kafka Stream Dependencies
01:38 - Kafka Streams Pipeline Example Overview
03:06 - Sending Message to Kafka Topic (Kafka Producer)
04:14 - Kafka Producer Properties
05:21 - Viewing Messages In The First Kafka Topic
06:10 - Kstream or Kafka Stream Transformation
06:58 - Spring Cloud Kafka Stream Properties
07:35 - Kafka Streams Serializer and Deserializer
09:14 - Viewing Kstream or Kafka Streams Transformation Output
10:02 - KStreams Or Kafka Streams Aggregation
12:41 - Spring Cloud Kafka Stream Aggregator Properties
14:06 - Viewing Kafka Stream Aggregation Output in Kafka Topic
15:47 - Kstream Or Kafka Stream Join Operation
17:30 - Spring Cloud Kafka Stream Joining Properties
18:44 - Custom Serializer Deserializer
19:40 - Viewing Kafka Stream Joining Output in Kafka Topic
21:06 - Conclusion

Music Credits:-

Sappheiros - Rain
----------------------------
Social Media
--------------------------------------------------

[himanshumahajan]

Hi Nice video. I have some doubts -
1. Can we do batch processing with KafkaStreams in Spring Cloud Stream ?
2. Is it possible to read and write to topics with different broker address ?
3. For scalable systems, does it support multithreading ? Because I tried consumer: concurrency property, doesn't seem to work.

[elmahdiaitlmahfoud]

hello sir, why the producer is publishing messages every 1second in "first-topic"

[Demon_KD]

Can you please suggest any udemy course to learn this kstreams, joins, ktables.