Deploying ML Models in Production: An Overview

preview_player
Показать описание
The deployment of ML models in production is a delicate process filled with challenges. You can deploy a model via a REST API, on an edge device, or as as an off-line unit used for batch processing. You can build the deployment pipeline from scratch, or use ML deployment frameworks.

In this video, you'll learn about the different strategies to deploy ML in production. I provide a short review of the main ML deployment tools on the market (TensorFlow Serving, MLFlow Model, Seldon Deploy, KServe from Kubeflow). I also present BentoM - the focus of this mini-series - describing its features in detail.

=================

1st The Sound of AI Hackathon (register here!):

Join The Sound Of AI Slack community:

Interested in hiring me as a consultant/freelancer?

Connect with Valerio on Linkedin:

Follow Valerio on Facebook:

Follow Valerio on Twitter:

=================

Content:

0:00 Intro
0:36 ML deployment strategies
1:32 Basic ML deployment
3:27 Disadvantages of basic ML deployment
4:57 Overview of ML deployment tools
9:54 BentoML
14:00 What's next?
Рекомендации по теме
Комментарии
Автор

ML Ops is such a rarely taught topic in academia. Thank you so much for this explanation. I hope there is more to come!

Erosis
Автор

Thank you very much! This was the most helpful resource I've found on the topic!

stefanvasilev
Автор

Almost starting as a data science consultant and I really need this video series!!! Comes at perfect time

Diegownz
Автор

Thanks very much for the detailed explanation. Really helpful👏

travelwithak_
Автор

Good summary of all different ML "framework" (if we may agree on that) to deploy a ML model. Thank for that 🙏

fcojperez
Автор

Hello, great video, well explained, i would like to know if BentoML can be used to Deploy MeshSegNet models?

ahmedgoniboulama
Автор

Great video as always. You really helped me a lot with my master thesis. This video series is yet another important building piece in dealing with audio machine learning projects. If I may add a comment. The Mnist dataset is a good example to demonstrate the deployment, but since the channel is called "the sound of ai" it would also be very interesting to see how to deploy a model that classifies an audio stream in real time.

maxwohrle
Автор

Hey! I've been trying to work on deploying some complex models and wondered if you had any experience in industry tools that do this well

The scenario is essentially I have two models that need to be run, but one of the features they use is a completely separate model. Is there any industry standard software you know of to make that easier to do in a more scalable way? And if I eventually add more models that then depend potentially on those?

Coolblockj
Автор

Can you make a comparison video using ZenML and other MLOps tools?

karndeepsingh
Автор

Great Explanation..From where to get code files?

sarthak
Автор

How are you? my question is different, please guide me I need to develop model language for Local language for speech recognation!

tirateable
Автор

Thank you so you amazing, videos, could you please make a vedio about how to use CHATGPT in programming

abdullrahmanelhayek
Автор

I was really hoping if someone in the audio domain talks about deploying an speech model and give some pointers on ML Observability.

sudharsankp