Project Zen: Making Spark Pythonic | Reynold Xin | Keynote Data + AI Summit EU 2020

Project Zen: Making Spark Pythonic

Reynold Xin
Co-founder & Chief Architect, Databricks

In this keynote from Reynold Xin, the top contributor to Apache Spark and PMC member, we will review the state of the project and highlight major community developments in the 10th anniversary release and beyond. Reynold will review how the recent Spark 3.0 release focused on making it easier to use, faster, and more ANSI standard compliant. With Python representing nearly 70% of notebook commands, he’ll focus on the development of Project Zen – the community effort to make Spark more Pythonic. This includes improvements in development tooling, API design, error handling and more, to make data scientists and engineers more productive with data.

Demo: Pythonic Spark with Real Koalas

Caryl Yuhas
Sr. Manager, Field Engineering, Databricks

About:
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.

Connect with us: