Getting Started with NVIDIA Triton Inference Server

Triton Inference Server is an open-source inference solution that standardizes model deployment and enables fast and scalable AI in production. Because of its many features, a natural question to ask is, where do I begin? Watch the video to find out!

#ai #inference #nvidiatriton

[louieearle]

The speaker is hard to understand, and there are no examples that would be helpful to someone just learning the NVidia ecosystem.

[g.s.]

more real examples with code samples!!!!

[ck]

Hard to understand the user, explanation with an example would go a long way in understanding

[phiai]

Here are ste-by-step walkthouroughs how to:
1. Generate deployable models for PyTorch ResNet50 using Nvidia PyTorch Container

2. Deploy PyTorch ResNet50 model on AWS SageMaker using Nvidia Triton Inference Server