RUN TextGen AI WebUI LLM On Runpod & Colab! Cloud Computing POWER!

Unlock the power of TextGen AI with NO GPU required! In this video, I will show you how to easily set up the latest version of the Oobabooga TextGen Ai WebUI and run any LLM models you want using Runpod & Google Colab. This requires zero hardware investment and a small to no budget. So now everyone should be able to use Ai Text generation to its full potential at home!

Have you managed to install the Oobabooga TextGen WebUI on the Cloud? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►► My PC & Favorite Gear:
Recording Gear:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Special thanks to Royal Emperor:
- Totoro
- TNSEE

Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!

#cloudcomputing #googlecolab #textgeneration #freeaitools
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - All LLM & ChatGPT Video:

RECOMMENDED WATCHING - My "Tutorial" Playlist:

Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.

[JohnDoe-egxf]

Congrats! Actually this should be the first video that anybody interested in AI watches. There is too much mambo jambo about 1000 models, but nobody is telling about methods of running these, costs and hardware requirements.

[Aitrepreneur]

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx <3
"K" - Your Ai Overlord

EDIT: I updated the Colab doc to allow public API connection to Sillytavern or TavernAi, enjoy ;)

[MonkeySimius]

I appreciate that you take the time to explain how to install and run these programs and LLMs. I wouldn't have been able to run webui with my knowledge level when I first installed it before watching your videos... As easy as it is to me now. But aside from you, most videos just assume you can figure these things out which really gate keeps people out of getting it to work the first time.

Man, especially that 65k token story teller model. I struggled with that and had given up until your video.

Keep it up.

[FFWestsider]

I am using the same method for a few weeks now. Note that you can already load your own docker files or you can just edit the template and put the correct huggingface path for the model you want to use. Then you don't even have to use the web console every time you start a new pod.
Also a small pro tip: You can lower the cost even more by using bidding prices. Only downside is that your runpod will be shut down immediately if somebody bits more. Anyway I was able to run Pods for multiple days for just 0.30 USD per hour that would cost 0.79 USD normally.

[GengoSenmon]

New subscriber here. Literally spent an entire week figuring this out. Installing things locally is hard enough. Installing them onto GPU cloud providers like Runpod makes it even harder with no instructions or support. Please do one of these guides for running Silero or other AI voice programs on Runpod through SillyTavern!

[OliNorwell]

Another great video, getting close to that 100K!

[banzai]

Great stuff as always. Useful walkthrough. I thought Lambda GPU was cheaper.

Man, 100K party coming up!

[DJWolfy]

Hi Aitrepeneur, I wanted to thank you for the continuous and up to date AI news. I particularly like the videos where you test all the new LLMs. Keep up the great work and thank you for the easy to follow videos!

[ianabrahams]

Followed your video, line by line and worked the first time without a hitch. Thank you so much for the effort in putting these great videos out for us. Much appreciated. :)

[CM-khzv]

This video was indeed needed! Thank you man <3

[cortexor]

Already registered!!! With this, I no longer need to even think about buying a powerful GPU! After all, apart from neurons, I don’t indulge in anything else! Thanks a lot for the recommendation!

[CommBot-rb]

Really very useful content for someone just getting started and who doesn't own the hardware needed to build bots. Thank you!

[mentalforge]

thank you deeply for everything you do we are making history here

[jimdelsol]

But... What about the privacy if this is a public url ?

[deanmerati]

thanks for your effort, always very useful videos! Great job!

[darkumaru]

Is it possible to somehow connect google colab to the tavern ai?

[flost]

Thanks for your work. Is there a possibility for a tutorial on langchain?

[yasunakaikumi]

VRAM is the hindrance of every AI acceleration right now, we seriously need a user upgradable method like CPU system ram, instead of Ngreedia taking all of the cake...

[Alex-]

can you tell any difference in the 65B models? ive tried a few of the 13B models and they are basically useless because they forget the context of previous messages after about 3 or 4 sentences

[CM-khzv]

A really good addition to this video would be to explain how to set up tavernAI on runpod. I am trying but I cant make it work. thanks