Metaflow. The journey to Kubernetes - Oleg Avdeev

For the DoK Day North America 2021 @ Kubecon
Playlist:

Metaflow is an open source machine learning platform, originally built and broadly battle tested at Netflix to help with ML, analytics and other data intensive use cases.

It was initially built to heavily rely on AWS, but in the last five months we've been rebuilding it to allow to run large-scale data crunching workloads on Kubernetes using Metaflow. In this talk we'll share the pleasant surprises and challenges we've ran into in our journey to get to a consistent, friendly experience on K8S for data scientists.