Scalable ML acceleration with ONNX Runtime

preview_player
Показать описание
Technical session delivered by Manash Goswami, Principal Program Manager at Microsoft.

ONNX Runtime is an open source inference engine for ONNX Models. ONNX Runtime Execution Providers (EPs) enables the execution of any ONNX model using a single set of inference APIs that provide access to the best hardware acceleration available. In simple terms, developers no longer need to worry about the nuances of hardware specific custom libraries to accelerate their machine learning models. This technical session demonstrates that by enabling the same code to run on different hardware platforms using their respective AI acceleration libraries for optimized execution of the ONNX model.

Stay connected with Arm:
  1. Arm®
  2. Arm Architecture
  3. Arm Holdings
  4. Arm
  5. Arm Processors
  6. AIoT
Рекомендации по теме
Scalable ML acceleration 0:29:31

Scalable ML acceleration with ONNX Runtime

Accelerating ML Inference 0:28:28

Accelerating ML Inference at Scale with ONNX, Triton and Seldon | PyData Global 2021

Deploy Machine Learning 0:24:38

Deploy Machine Learning anywhere with ONNX. Python SKLearn Model running in an Azure ml.net Function

Accelerate Transformer inference 0:16:32

Accelerate Transformer inference on CPU with Optimum and ONNX

011 ONNX 20210324 0:07:21

011 ONNX 20210324 Peng ONNX Runtime Update

ONNX and ONNX 0:44:35

ONNX and ONNX Runtime

Open Neural Network 1:00:26

Open Neural Network Exchange (ONNX) in the enterprise: how Microsoft scales ML - BRK3012

Accelerate Big Model 0:01:08

Accelerate Big Model Inference: How Does it Work?

RedisAI from the 0:08:04

RedisAI from the Command Line: Iris Classification with ONNX

ONNX Runtime 0:11:27

ONNX Runtime

Object Detection with 0:00:25

Object Detection with Raspberry Pi 4 using ONNX Runtime without GPU acceleration

ONNX Runtime 0:04:46

ONNX Runtime

Train with Azure 0:13:06

Train with Azure ML and deploy everywhere with ONNX Runtime

Machine Learning Inference 0:42:15

Machine Learning Inference in Flink with ONNX

ONNX Runtime speeds 0:18:17

ONNX Runtime speeds up Image Embedding model in Bing Semantic Precise Image Search

Train Machine learning 0:20:48

Train Machine learning model once and deploy it anywhere with ONNX optimization

Deploying ONNX models 0:30:42

Deploying ONNX models on Flink - Isaac Mckillen-Godfried

ONNX Runtime Azure 0:01:00

ONNX Runtime Azure EP for Hybrid Inferencing on Edge and Cloud

Leverage the power 0:41:41

Leverage the power of Machine Learning with ONNX - Ron Dagdag

v1.12.0 ONNX Runtime 0:34:47

v1.12.0 ONNX Runtime - Release Review

Berlin Buzzwords 2019: 0:21:57

Berlin Buzzwords 2019: Lester Solbakken – Scaling ONNX and TensorFlow model evaluation in search

RumPoC - ONNX 0:10:58

RumPoC - ONNX

SAN19-211 ONNX & 0:24:16

SAN19-211 ONNX & ONNX Runtime

MLOps: Onnx Overview, 0:04:55

MLOps: Onnx Overview, Session 2, part 4