NVIDIA NIM for Beginners with Llama 3.1 Dataset Generating App

In this tutorial, we will explore the newly announced NVIDIA NIM platform and use it to create our very own Llama 3.1 Powered Application! 🤩🤩🤩
Specifically, we will dive into NIM's collection of inference microservices, and state of the art APIs! (it's OK if you're not sure what it means yet, I explain it in the video 😉)
The end result, is your own Custom Dataset Maker App that you can adjust and enhance with a little bit of Python! 🤓

This video is perfect for beginners, as I explain all the advanced AI concepts in simple language and with plenty of visual examples. It is also perfect for professionals, as I show you how to skip the entire AI pipeline setup with the help of NIM.

⭐ Checkout the NIM API Catalog Here:

⏰ Timestamps ⏰
------------------------------------------------------------------------------------------
00:00 - intro
00:38 - what is NVIDIA NIM?
00:55 - what are microservices?
01:20 - microservices challenges
01:42 - NIM benefits
02:30 - NIM components
03:11 - what is an API?
03:54 - NIM API Catalog demo
05:10 - NIM deployment options
06:45 - generate NGC API KEY
07:51 - deploy NIM container
09:03 - model health check
09:31 - run basic Llama prompt code
10:37 - a heavy metal song about job search
11:09 - Llama request object
12:29 - Llama response object
13:40 - chain a series of prompts
16:22 - convert prompt response to list
17:45 - save custom dataset to CSV
18:14 - thanks for watching!

🚀 My Brev Launchable - Dataset Maker Notebook 🚀
------------------------------------------------------------------------------------------

📺 Related Tutorials of Mine📺
------------------------------------------------------------------------------------------
⭐ CUDA For Beginners:
⭐ Docker Containers Simply Explained:

🤝 Connect with me 🤝
------------------------------------------------------------------------------------------
🔗 Github:
🔗 X:
🔗 LinkedIn:
🔗 Blog:
🔗 Discord:

💳 Credits 💳
------------------------------------------------------------------------------------------
⭐ Beautiful titles, transitions, sound FX:
⭐ Beautiful Icons:
⭐ Beautiful Thumbnail:
Grok and Firefly

#ai #artificialintelligence #ml #machinelearning #dl #deeplearning #largelanguagemodels #llm #llama #nvidia #python #pythontutorial #pythontutorialforbeginners #pythonforbeginners #learnpython #learning #coding #programming #software #softwareengineer #softwaredevelopment #microservicesarchitecture #microservices #api #container #docker #server #dataset #datascience #computerscience #technology #tech #prompting #application #pythoncoding #tutorial #codingtutorial #jupyternotebook #vscode #cloudcomputing #inference #prediction

[PatrickHoodDaniel]

This is pretty cool. I have a question, is there a way to gather a bunch of data from a specific person (i.e. the writings of my father that passed away a while ago), and a picture of him, and create an avatar and be able to train an LLM to exhibit his persona? Is this possible yet? I watched a presentation from NVidia on the avatar, but the persona from writings from a specific person I'm not sure about.

[zulqurnainhafeez]

Hello watching from Pakistan. Your teaching style is phenomenal i quite learning python almost 1 time but then i watch your video and conditions are totally changed it gives me good understanding and new motivation to start again. Thank you, keep growing.

[zacharyjohnson]

Always an awesome job! Love the thumbnail! Smiling lama is back but in the data centre!

[mauricio]

Can anyone use NIMs? I am interested in Riva but it looks like I need an Enterprise License?

[alexandermuir]

Mariya is back. What an awesome video. Even I understood it.

[harishkumaru]

Hi, your tutorials are so easy to understand. Do you have tutorials in Exploratory Data Analysis with Python?

[nikluz]

Nice to see you finally got a pet llama

[Musikfueralle]

Interesting and very good presentation - thank you

[JerryN]

Thanks Mariya. Another great video. Just out of curiosity, do you plan on doing anything with the OpenAI Swarm feature that was just announced?

[richardmilian]

I like the way you teach this technology, the microservices are interesting and as a beginner i need to get familiar with Docker and i'll watch the tutorial where you explain about it to go into more detail.
From El Salvador thank you so much for this tutorial and the others that you have created.

[markmark]

We need a single released ASAP from 10:38, just say it LOUDER :D

[smalirizvi]

First message!!!! 😊😊
Mariya.
How are you?

[QorQar]

Do you run Coda 12 cardsrtx3050-rtx3090-rtx3060
iam ask card supported cuda12

[Greazvstheworld]

Is your channel good for people who know very little to absolutely nothing about computer programming?

[Tobs_]

watched on fast forward, came for the llama, stayed for Lara Croft hacking into computers 👍

[jonjohnson]

It got the UK national dish wrong though :D

[CrispyWafflez-zx]

HI im looking for someone to help me with python. Ik this isnt exactly relevant to the video but i would like it if someone was willing to help me (the creator if possible too) im new and i really want to learn.

[khkabir]

how to message you in facebook or telegram personally, i need some help