One decade of learnings from serving ML models to billions of users - Jakob Pörschmann (Google)

*dida conference 2023*

*Speaker:* Jakob Pörschmann from Google

*Full Title:* One decade of learnings from serving machine learning models to billions of users

*Abstract:* Google is arguably the largest user of ML in production. At scales of Billions of users and Thousands of models served every day, manual processes obviously don't suffice. Emerged from necessity, Google is also among the most active contributors to the MLOps research and open-source community. This talk gives an overview of what we learned over the years. It provides an insight into the tools and best practices we use ourselves. Finally, we explore how all this is translated into the design of MLOps tools on GCP.