Watermarking in stream processing | Course in Spark Structured Streaming 3.0 | Lesson 7

preview_player
Показать описание
Full Course is available here:

Рекомендации по теме
Комментарии
Автор

This is the best video on watermarking on Youtube! It's so practical, most literature is focussed on high-level mumbo jumbo except actually explaining how it is actually implemented. Kudos to you Amit for making this.

nilanjansarkar
Автор

One of the best explanation about the watermark. Thanks

DataTechByAnandKumar
Автор

Man, your explanation is awesome. Thanks.

danieltost
Автор

Amit, уou saved my day. Apache Flink has the same feature, however, the documentation about it is not clear. Thanks to you, eventually, I understand how it works.

izebit
Автор

Thanks for the video! This is really useful

williamson-mcgee
Автор

excellent video, thanks for the detailed explanation! Is the watermark implementation using Kafka as src also covered in a different video ?

karanalang
Автор

However, I liked the video, superb explanantion...

ambar
Автор

Sir i watched this video and really loved the way you have put. But i am also very sad to see most of the videos on your channel are unavailable. Can you do something for that?

kumarankit
Автор

As per your slide output, 12:17 should be Dog instead of Owl, please correct it...

ambar
Автор

In "UPDATE" output mode, we get output after each trigger time unlike "APPEND" mode where we get data only at the end of watermark. I have one more doubt ralated to "UPDATE" mode, do we get our data again in the output (it can be console or kafka) when watermark time ends?

deepanshuaggarwal