Self-Hosted LLM Chatbot with Ollama and Open WebUI (No GPU Required)

Показать описание

Explore the power of self-hosted language models with us on Easy Self Host! In this video, we demonstrate how to run Ollama with Open WebUI, creating a private server-based environment similar to ChatGPT. We'll guide you through setting up Ollama and Open WebUI using Docker Compose, delve into the configuration specifics, and show how these tools provide enhanced privacy and control over your data. Whether you're using a modest setup or more powerful hardware, see the performance firsthand. Don't miss out on our insights on potential applications beyond chat, like note summarization in Memos. Subscribe for more self-hosted solutions and find the configuration files on our GitHub, linked below!

00:04 Introduction
01:07 Tutorial to run Ollama and Open WebUI (Docker Compose)
03:18 Running Docker Compose on the Server
03:38 Start Chatting on Open WebUI
06:01 Integration with Memos (experimental)

🔗 Links:

Рекомендации по теме

Комментарии

This is great! Thanks for making it easy. Easy self-hosting!

steve-maheshsingh

Very cool! Please consider more videos where you integrate this into other apps like home assistant and others. Thanks!

goodcitizen

Excelente! En especial el utilizarlos junto a las notas

Edupc

Would you consider doing self-hosting for transcription to notes in memos? 😊 like faster-whisper, pyannote (or local alternative) to meeting minutes, to summarized notes?

nexuslux

Can you explain usage of softethervpn site-site configuration, , local to vps

MultiMmsh

Nice tutorial, Could you please tell me How can I add or find the tutorial or docker version that have LLM? Thanks

AFiB

I have creatednone chatbot on some pdf documents and using mistral but i try to hit multiple query at aame time it gives response in more than 2 to 5 minutes so can i deploy mistral with this methods without GPU and will get response fast?

naveenpandey

Hi may we know what is the hardware requirements to self host ollama and open webui with llama3?

tanyongsheng

Is it possible to set a folder to place our own pdfs with information so the chatbot can answer based in them?

y._.

Great video! Any links on how to utilize a gpu?

manprinsen

Self-Hosted LLM Chatbot with Ollama and Open WebUI (No GPU Required)

Self-Hosted LLM Chatbot with Ollama and Open WebUI (No GPU Required)

Run Your Own Local ChatGPT: Ollama WebUI

Using Ollama To Build a FULLY LOCAL 'ChatGPT Clone'

How To Install Any LLM Locally! Open WebUI (Ollama) - SUPER EASY!

host ALL your AI locally

This new AI is powerful and uncensored… Let’s run it

Run your own AI (but private)

Build a Large Language Model AI Chatbot using Retrieval Augmented Generation

How to run a local AI chatbot on Windows in 5 min, no cuts, no edits, with Ollama, LMStudio, OpenAI

Local LLM with Ollama, LLAMA3 and LM Studio // Private AI Server

Custom AI Chatbot for Websites using any LLM | No-Code | Open-Source

Free and Local AI in Home Assistant using Ollama

How to chat with your PDFs using local Large Language Models [Ollama RAG]

Run Your Own LLM Locally: LLaMa, Mistral & More

Python Advanced AI Agent Tutorial - LlamaIndex, Ollama and Multi-LLM!

FINALLY! Open-Source 'LLaMA Code' Coding Assistant (Tutorial)

Private Chat with your Documents with Ollama and PrivateGPT | Use Case | Easy Set up

I used LLaMA 2 70B to rebuild GPT Banker...and its AMAZING (LLM RAG)

API For Open-Source Models 🔥 Easily Build With ANY Open-Source LLM

Llama 3 8B: BIG Step for Local AI Agents! - Full Tutorial (Build Your Own Tools)

This Llama 3 is powerful and uncensored, let’s run it

All You Need To Know About Running LLMs Locally

Is AI really getting dumber? Llama2 vs GPT-4

Llama-3.1 (405B & 8B) + Groq + TogetherAI : FULLY FREE Copilot! (Coding Copilot with ContinueDev...