3 Ways to Make a Custom AI Assistant | RAG, Tools, & Fine-tuning

AI assistants are chatbots that can use tools to perform a wide variety of tasks. In this video, I walk through 3 ways to make a custom AI assistant using OpenAI's platform. Each approach is used to make a YouTube comment responder called ShawGPT.

Resources

--

Socials

The Data Entrepreneurs

Support ❤️

Intro - 0:00
AI Chatbot vs Assistant - 0:42
Way 1: GPTs (no code) - 1:48
Way 2: Assistants API (Playground) - 14:30
Way 2: Assistants API (Example Code) - 17:13
Way 3: Fine-tuning API - 30:15
Recap - 46:06

[ShawhinTalebi]

Drop a comment for ShawGPT 👇
--
Resources

[saadowain]

Thanks for everything you do. Please continue.

[fuad]

it was a pleasure watching you and learning new things about llm.

[satsanthony]

Well explained. Good reference to the cooking shows.😆

[wg]

Nice to see you own tutorial applied in the comments on real time....

[adangerzz]

Darn it, Shaw, I missed the first 90 seconds because I was distracted by identifying all your musical gear. I have to start over now! :) (But seriously, thanks for the info!)

[terryliu]

Great series of videos! Thank you for sharing. What would you recommend after watching these videos to dive deeper into the Gen AI development field?

[BrooksColeHOLO]

Really great video, thank you. Please consider using your hand gestures for conveying meaning rather than as an oscilloscope for voice volume. Greater comprehension will ensue.

[somerset]

Very nicely done! I think that the comparison between the first option and the second option would have been more fair if you had provided more examples of your answers in the first one. Do you actually use your auto-responder on YT? Thanks!

[BlueDattebayo]

Thank you so much for the detailed breakdown Shaw, I was wondering if there is a way to bring this execution into the front-end side of things? i.e. Jupyter Notebook into streamlit/gradio? This is intended for an interactive PDF-trained model. Looking forward to hearing from your end! 🙂

[EspressDelivery]

"This is like one of those cooking shows and we cooked the pasta last night and we're gonna eat it in front of you"

"Thus began Shaw Talebi's foray into Mukhbang videos"

[FrancescoFiamingo]

dear Shaw, always great, i m really learning a lot tks to you...even if not from USA and old guy :) :) - i have a few questions :1 ) being the video of 3 months ago it is possible now to fine tune with files rather than json answer/question model? 2) using the rag api assistant how i can make one time loading the files in the assistant and be part of the "model", so to have faster interactions -or is already like that?- 3) when we speak about files in rag, possible to use PowerPoint presentations? 4) would be great if u could make an example of use the "tool" with a simple python code to understand how to integrate those in the assistant. sorry for maybe simple for even wrong questions :) :) :)

[mgarlabX]

Hi Shaw. Amazing instructions, I am enjoying a lot. One question, please: sometimes and randomly the function "wait_for_assistant" freezes at without error messages. Any ideas how to deal with that?

[jaa]

Thank you as always for the informative content! Apologies for the n00b question, but which IDE are you using? I tried opening the repository with PyCham CE but my environment doesn't show the run options in the Jupyter Notebooks. Is it PyCharm Professional or something else?

[fbardeau]

hi,
huge fan of your videos
have a basic question: why not use CSV ou JSON files like in fine-tuning for RAG to improve retrieval? is PDF really ok?
thanks

[MeirMichanie]

I discovered your channel yesterday and I am hucked, great job. It would be nice to see a video of fine tuning ShawGPT using HF, I saw a video you did running on Colab using Mistal-7b, any chance to do a video using your laptop (Mac) or using HF spaces?

[ravityagi]

Hi Shaw. thanks for wonderful Video! I wanted to know cost aspects of your finetuning example. how OpenAI charge for finetuning?

[somerset]

Based on your experience with fine-tuning, would you say it's very similar to few-shot learning that we started including into prompts? Thanks!

[AI_Financier]

can you make a video fine tuning an open source LLM? thanks

[justeverything]

thank you for the very detailed session. One issue I've noticed is that the run = wait_for_assistant(thread, run) command didn't give me any output even after an hour or so and I had to stop it. Is there anything I am missing? Kindly suggest