Fundamentals of Stream Processing with Apache Beam

QCon San Francisco International Software Conference is back this November 18-22, 2024. Software leaders at early adopter companies will come together to share actionable insights to help you adopt the right technologies and practices.

Get exposed to new ideas and innovative approaches to software development and engineering, guaranteed to inspire and challenge you.

Don’t miss this opportunity to take your knowledge and skills to the next level and stay ahead in the fast-paced world of technology.

------------------------------------------------------------------------------------------------------------------------------------------------

Frances Perry and Tyler Akidau discuss Apache Beam, out-of-order stream processing, and how Beam’s tools for reasoning simplify complex tasks.

[thbatman]

best presentation on windowing concepts...

[YCLian]

I usually listen to talks when I do house chores, TBH, I find the constant switch between speakers very hard to follow.

[sanjeebpanda]

It's one of the best video to understand the Windowing features for streaming. Thanks a lot.

[johnnyq]

Is this alternating-speaker arrangement meant to demonstrate their innovative/creative spirit? It's annoying.

[junkmail]

Watermark is the earliest time you can see the data due to transmission delay. That’s easier to understand than “no timestamp earlier than the watermark will be seen”.

[zahidadeel]

content of presentation is very good and speakers explained it well. But that constant switching was a bit difficult to follow.

[abhishes]

yup. constant switching is very annoying

[tianzicai]

What is meant by "once the watermark passes the end of the window"? at 20:09?

[americanaccounts]

Is 'When' at 20:51 a combination of Batch and Stream Processing? When 'When' is only Stream Processing: Are the firings a kind of late and early observer?