Introduction to Stateful Stream Processing with Apache Flink • Robert Metzger • GOTO 2019

preview_player
Показать описание
This presentation was recorded at GOTO Amsterdam 2019. #GOTOcon #GOTOams

Robert Metzger - PMC member of the Apache Flink project; Co-founder, Engineering Lead Ververica

ABSTRACT
Stream Processing has evolved quickly in a short time: only a few years ago, stream processing was mostly simple real-time aggregations with limited throughput and consistency. Today, many stream processing applications have sophisticated business logic, strict correctness guarantees, high performance, low latency, and maintain terabytes of state without databases. Stream processing frameworks also abstract a lot of the low-level details away, such as routing the data streams, taking care of concurrent executions, and handling various failure scenarios while ensuring correctness.
This talk will give an introduction into Apache Flink, one of the most advanced open source stream processors that powers applications in Netflix, Uber, and Alibaba among others. In particular, we will go through the use cases that Flink was designed for, explain concepts like stateful [...]

Download slides and read the full abstract here:

#ApacheFlink #EventStreaming #DataProcessing #StreamProcessing

Looking for a unique learning experience?

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
Рекомендации по теме
Комментарии
Автор

Host's PPT slides were so vividly to illustrate the concept of Flink and its application. Its Awesome !

kauffmann
Автор

Robert Metzger has amazing teaching ability!...great talk

psychicopus
Автор

Amazing talk, learnt a ton. Moreover picked up some speaker notions, kudos Robert!

ami
Автор

Veverica means squirrel in Slovenian... wondering if name Ververica has anything to do with that or is it just a coincidence?

spacelessspace
Автор

“These notions of time mostly affect the latency…… and the correctness”

benjaminmalley
Автор

What does he mean by "Queries change faster than data"?

himanshugupta
Автор

I'm writing a streaming application with Flink and getting this error from Flink - : Connection Unexpectedly closed by remote task manager xx1.xx2.xx3.xx4:abcd. This might indicate the that the remote task manager was lost.



The configurations for Flink are as follows

flink.parallelism.default = 60
= 3
= 1G
= 512mb
= 2048mb

Could anyone please help me what is the cause for the error and how to fix it.

esakkisundar