Create Custom AI Characters Easily 🎭 How To Fine-Tune LLMs For AI Role Play

preview_player
Показать описание

In this video, I show you how to fine-tune an open-source LLM to behave like any character from movies, TV shows, comics...even yourself from text messages!

Enjoy :)

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? ✅

Rent a GPU (MassedCompute) 🚀
USE CODE "MatthewBerman" for 50% discount

My Links 🔗

Media/Sponsorship Inquiries 📈

Links:
Рекомендации по теме
Комментарии
Автор

Should I clone myself with AI and try to fool my family?

matthew_berman
Автор

Finally! I can automate my friendships, have the AI give me the highlights/details of any important information, and get back to living as a hermit.

JasonEllingsworth
Автор

I see a problem here: how do we know, that model responses "kinda" like Rick not because model knew of this character before finetuning? Any model can do what you did in this video right now, without finetuning.

Uterr
Автор

00:00 🎭 You can create a custom AI roleplay bot for characters from TV shows, movies, comics, and even yourself using fine-tuning techniques.
00:27 📊 Data for fine-tuning can be obtained from sources like Kaggle for scripts, which are available in CSV format, or other websites for various dialogues.
01:50 📄 You can also fine-tune a model based on your own text messages, DM history, or telegram messages by converting them into CSV format.
03:02 📂 Google Colab is used to prepare data for fine-tuning, and Gradient AI makes fine-tuning models easy and efficient.
05:36 ⚙ Fine-tuning is performed using NAOUS Hermes 2, and you can adjust the fine-tuning process as needed.
07:01 🗨 The model's responses are generated by providing a query, and you can customize the system message and instructions for roleplay.
08:50 🤖 You can deploy the AI roleplay bot for any character, and the process is versatile, allowing you to mimic various personalities.

antonpictures
Автор

Very cool! This is really another step into creating our own content... I love the last line where he is going to use the portal gun to go back in time and stop the portal gun from being invented! hilarious.

marcfruchtman
Автор

honestly dude i feel like you specifically know what i'm doing and are making videos to help me. you keep giving me exactly what i need. i need ai agents to set up ai agents for me. smh. great video again! i'm saving this one

unc_matteth
Автор

Love your channel man! It's always the first thing I watch when it pops up. I have been playing around with famous characters using character sheets and Oobabooga. I've found that with only a few hundred tokens I can create a scary good interaction because (model dependent) everything is already baked in and all you need to do is point out who you want to talk to. I'm willing to bet that Rick and Morty script was part of your models training data set already. That said, AS ALWAYS, your video has filled my head with day dreams. The idea of training a whole model for a single character is so cool. My challenge to you and anyone that reads this is how small of a model can you train into being a coherent and usable roll play bot.

elwoodfanwwod
Автор

Yes! Today I was researching how to fine tune Mistral 7B on my dataset and now you post this video! ❤
Would be great to also get a tutorial how to fine tune with HuggingFace AutoTrain. This way it could be uploaded to HuggingFace and used from Text-Generation-Webui.

adrianfiedler
Автор

THANK YOU!!!

I was just getting ready to go down this exact rabbit hole when you posted this.

I WOULD LOVE to see a video of this BUT but using all open source/local llms/software.

robertbyer
Автор

Know what I'd really like to see? A guide on an open-source installation of multiple roleplay chatbots that can exist on a Discord server as Discord bots with the ability to communicate with each other and humans. That's my dream chatbot project, my server would love it.

OutlawMantis
Автор

What about an open-source tutorial. NO THIRD PARTY poo poos (I mean gradient is great and all, but come on!)

stickmanland
Автор

Nice! Thanks Matt! Looking forward to this one. Introducing the real, the one, the only, Skippy The Magnificent!

Josh-Casey
Автор

This is fascinating - all of your videos that I've seen so far are! Thank you so much for having a good fine-tuning video. I am very curious about two things that I am not seeing covered much... (1) The topic you mentioned - creating good prompts.. particularly from large bodies of unrefined data. For example 'all the works of Shakespeare' or 'the Guttenberg project'. Especially where those works have both dialog and non-dialog 'things' that happen as part of the writing style. (2) How to work entirely locally, assuming you have the memory / GPU for it - such as if you are working with a large body of local data and you don't want to keep trying to move it into the cloud during training, or you just want to use your own resources.

hypnokitten
Автор

Amazing thank you!
1. How much data did you use there? How much is needed?
2. Why did you choose that base model?

dolevmp
Автор

The man himself is back. I been looking forward to your uploads you always got so much dope information

spencerfunk
Автор

Your videos have risen in quality and sophistication. Brilliant.

TheReferrer
Автор

I use this through CHATGPT custom instructions and voice chat while I make dinner or work on code. I have Rick Sanchez roast me on everything like a Jerry! 🤣

NakedSageAstrology
Автор

Yes definitely interested in chatting with a Mathew AI .. just don't trick your family members! 😂

aldoyh
Автор

I used to do this with markov chains way back, and had an IRC channel full of different characters that would discuss social media posts. One plus of markov chains was they could learn, but couldn't get that big, I wonder if llama index can replace the need for training.

terbospeed
Автор

Can you clone yourself and ask the model questions that you have answered before and compare the accuracy?

dabdab