Continuously Train & Deploy Spark ML and Tensorflow AI Models from Jupyter Notebook to Production

preview_player
Показать описание
Notebook:

Conference:

Meetup:

In this completely demo-based talk, Chris Fregly from PipelineIO will demo the latest 100% open source research in high-scale, fault-tolerant model serving using Tensorflow, Spark ML, Jupyter Notebook, Docker, Kubernetes, and NetflixOSS Microservices.

This talk will discuss the trade-offs of mutable vs. immutable model deployments, on-the-fly JVM byte-code generation, global request batching, miroservice circuit breakers, and dynamic cluster scaling - all from within a Jupyter notebook.

Chris Fregly is a Research Scientist at PipelineIO - a Machine Learning and Artificial Intelligence Startup in San Francisco.

Chris is an Apache Spark Contributor, Netflix Open Source Committer, Founder of the Advanced Spark and TensorFlow Meetup, Author of the upcoming book, Advanced Spark, and Creator of the upcoming O'Reilly video series, Deploying and Scaling Distributed TensorFlow in Production.

Previously, Chris was a Distributed Systems Engineer at Netflix, Data Solutions Engineer at Databricks, and a Founding Member of the IBM Spark Technology Center in San Francisco.
  1. Generative AI on AWS
  2. machine learning
  3. artificial intelligence
  4. tensorflow
  5. spark
  6. kubernetes
Рекомендации по теме
Continuously Train & 0:57:55

Continuously Train & Deploy Spark ML and Tensorflow AI Models from Jupyter Notebook to Productio...

Boston Spark Meetup 0:28:22

Boston Spark Meetup - May 2018 - Continuous Train + Deploy ML/AI Models (Video Including Speaker)

Boston Spark Meetup 2:04:53

Boston Spark Meetup - May 2018 - Continuous Train + Deploy ML/AI Models (PipelineAI)

Continuous Deployment - 2:45:09

Continuous Deployment - Spark ML and Tensorflow AI - ODSC Workshop - San Francisco - Mar 2017

Apache Spark and 0:28:55

Apache Spark and Tensorflow as a Service - Jim Dowling

Intelligent Applications with 0:30:40

Intelligent Applications with Apache Spark and Kubernetes from Prototype to Production

Deploy Spark ML 0:09:55

Deploy Spark ML model as Web Service Using Azure Machine Learning

Best Practices for 0:23:41

Best Practices for Engineering Production-Ready Software with Apache Spark

Tutorial 1-Machine Learning 0:30:58

Tutorial 1-Machine Learning Model Retraining Approach-Incremental And Continuous Model Training 🔥🔥🔥🔥...

Operationalizing Machine Learning 0:38:25

Operationalizing Machine Learning on Spark and TensorFlow

How to Productionize 0:28:26

How to Productionize Your Machine Learning Models Using Apache Spark MLlib 2 x-Richard Garris

Resource-Efficient Deep Learning 0:20:06

Resource-Efficient Deep Learning Model Selection on Apache Spark

Fully Reproducible ML 0:34:32

Fully Reproducible ML Deployment with Spark, Pachyderm, and MLeap

Why do we 0:02:20

Why do we split data into train test and validation sets?

Unifying State-of-the-Art AI 0:16:19

Unifying State-of-the-Art AI and Big Data in Apache Spark - Reynold Xin (Databricks)

Kamil Owczarek - 0:24:56

Kamil Owczarek - CONTINOUS APPLICATIONS WITH SPARK 2.0

Scaling Machine Learning 0:29:53

Scaling Machine Learning with Apache Spark

Getting Ready to 0:26:35

Getting Ready to Use Redis with Apache Spark - Dvir Volk

Distributed Machine Learning 0:41:04

Distributed Machine Learning with Apache Spark / PySpark MLlib

MLLeap, or How 0:28:03

MLLeap, or How to Productionize Data Science Workflows Using Spark

Distributed Deep Learning 0:39:38

Distributed Deep Learning with Keras/TensorFlow on Spark: yes you can! By Guglielmo Iozzia

Machine Learning with 0:32:49

Machine Learning with Spark and Cassandra: Model Deployment

Deploying Large Spark 0:42:19

Deploying Large Spark Models to Production and Model Scoring in Near Real Time by Subhojit Banerjee

TensorFrames: Deep Learning 0:30:40

TensorFrames: Deep Learning with TensorFlow on Apache Spark (Tim Hunter)