ULTIMATE TextGen WebUI Install! Run ALL LLM Models ERROR-FREE!

preview_player
Показать описание
The Oobabooga Text-generation WebUI is an awesome open-source Web interface that allows you to run any open-source AI LLM models on your local computer for absolutely free! So in this video, I will show you how to easily install the TextGen WebUI on your computer for both the GPU and CPU, as well as how to use the WebUI for free on any device! And I will also go through the most common errors that people had when trying to install this and how to easily fix them.

Have you managed to install the TextGen WebUI? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

--wbits 4 --groupsize 128

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►► My PC & Favorite Gear:
Recording Gear:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

Special thanks to Royal Emperor:
- Totoro

Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!

#GPT4 #GPT3 #ChatGPT #textgeneration
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - My "Stable Diffusion" Playlist:

RECOMMENDED WATCHING - My "Tutorial" Playlist:

Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.
Рекомендации по теме
Комментарии
Автор

I love how long it took me to fix this my self, to wake up the next day with a fifteen minute video giving me the explanation.

SpottedHares
Автор

Thank you for all your effort to make these videos both informative and fun.

unit
Автор

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx <3
"K" - Your Ai Overlord

Aitrepreneur
Автор

I got it all up and running!! Thanks for bringing this to a wide audience!! LLMs are the next SD!! 🎉🎉🎉

swannschilling
Автор

You are the man! thanks for taking time to explain things one more time I really appreciated this video.

madreric
Автор

Instant sub bro, you're a top-tier YouTuber. No doubt, this helped out a lot.

ZENZOKI
Автор

Watching you dance makes mr happy man. I had to read the comments to spot the injury, smoothly done after to not strain it but still finish the video. ❤

danisaksson
Автор

Excellent disclosure. It serves to demystify these models and get more people to use them not just mega corporations.

jersainpasaran
Автор

I was giving up on this AI chat thing because I keep getting errors to run locally and Google collaborate crashes after 10 minutes or so (even after I follow your previous videos step by step). Thankfully, this video help me a lot to understand what my problem was. It's working perfectly now! I'll send a couple of coffees as a thank you very much, sir!

gaberoch
Автор

Great video man ! I already had mine up b4 your video, but sooo much troubleshooting. Bitsandbytes amirite 😂. I'm at the point where I have my own custom AI assitant templates and I'm sending pictures and talkng with them about it, this is epic man ! Next step Stable diffusion integration 🎉 I love your videos man, keep up the work!

JollyDGiant
Автор

the --pre_layer part effectively made everything run better. and now its more clear what it does. Thanks.

zloyboy
Автор

Always excited to watch your vids bro 🍻

XaYaZaZa
Автор

Thank you for keep helping us with the errors that we encounter. Can you make another vídeo explaining how to run some of the AIs locally using an AMD GPU with Ubuntu too? I would love to have a guiding hand on that since its kind of hard to find information about this.

jhngk
Автор

Great video will help a lot of people. Thank you for making this. :)

impactframes
Автор

Thanks for re-doing the install video, reddit is full of users which can not get it to run. "Do not forget to save the file" haha, very good

cryptogaming
Автор

Thanks! The pre_layers start up command helped me load larger models. As always you do amazing work. Thanks!

JungzYT
Автор

For anyone having issues with lama inference on CPU I advice you to search for the same model on hugging face but the ggml version of the model then when loading the model you remove --wbits 4 from the command line it should definitely work

danpizzytm
Автор

Love you men for your dedicate work. I test it late. Hope its works! I hope we can train the model like lora kind of things... in the future.

josemasisvalverde
Автор

another banger coming from Aitrepreneur 💯

Zomad
Автор

I got the GUI to run yesterday, after some errors and where I had to do some things by hand. I could not load a model though, yet..out of memory error; 3090, 24GB.this evening I wanted to get the models to work, so hopefully this video will be helpful thanks! /EDIT: Yes, the problem was the virtual memory, I had it deactivated, which you shouldnt do anyway. Now the models work.

fixelheimer