Building Robust, Scalable and Adaptive Applications on Spark Streaming - Tathagata Das (Databricks)

preview_player
Показать описание
Live from Spark Summit 2016 in NYC.

Hear the lead developer of Spark Streaming speak about how his grad school project is now running in production in many companies. T.D. shares his thoughts about the future of the project.

Learn about:
- Backpressure: A new feature to make apps robust against data rate surge.
- Elastic Scaling: Make apps scale with load variations

Includes live demo towards the end!

// About the Presenter //
Tathagata Das is an Apache Spark Committer and a member of the PMC. He’s the lead developer behind Spark Streaming, and is currently employed at Databricks. Before Databricks, you could find him at the AMPLab of UC Berkeley, researching datacenter frameworks and networks with professors Scott Shenker and Ion Stoica.

Follow T.D. on -
Рекомендации по теме
Комментарии
Автор

Very informative... and very well explained.. thanks a lot TD.. !!

rupalimaitri
Автор

excellent features and very good explanation...Thanks TD

krishnareddyvenkat
Автор

Great demo, especially the customer function to simulate the real time data rate increase. Thanks TD for the product!!

weekendresearcher