Ollama: Run LLMs Locally On Your Computer (Fast and Easy)

Показать описание

With Ollama, you can run local, open-source LLMs on your own computer easily and for free. This tutorial walks through how to install and use Ollama, how to access it via a local REST API, and how to use it in a Python app (using a client library like Langchain).

👉 Links

📚 Chapters
00:00 How To Run LLMs Locally
01:07 Install Ollama
02:45 Ollama Server and API
04:15 Using Ollama Via Langchain

Рекомендации по теме

Комментарии

Definitely would love to see more videos on training the models, finetunin and adding documents etc.

Larimuss

Love this channel, your content is clear explanation. Please do one video for fine tuning LLM for any specific task with one real-time use case

iamfine

You have a great knack of keeping things simple and understandable.

CalsProductions

First I would like to thank you, As a beginner you have provided a solid platform to me. I would also eagerly wait for your next video on how to train model locally and fine tune . Thank you so much once again .

mayankbhadauria

Sound quality is much better in this new setup. I just saw your FastApi video (if you are wondering why I am appreciating the sound of the video 😂)

malkitsingh

Love this channel, very clear and factual explanation of the topic

kacperwodarczyk

Thanks, the simple codes you showed helped me a lot!

matheussimonacivieira

Hi,
I really like all your lectures and examples. Just wonder if you could show an example of how to use RAG within a web Ruby-based REST_API architecture ( using, for instance, Llama and with as input a pdf representing a job posting as an example?)
Thanks a lot!

ap-rcpe

It's Good. Very nice explanation😀

mohamedjamaludeen

Diving a bit deeper into embeddings would be nice. And vector database. How to know the quality of your embeddings. What made you go to bedrock?

lesptitsoiseaux

It's interesting to train custom LLM instead of using RAG [2:45]

Screonizma

when he means locally, can anyone explain what that means? For example, let's say I want to use an LLM that I downloaded on my machine privately. Is this what that means? Not connected to the internet?

zacharycangemi

Can i install ai town with this. Other method was too complex for me as i am new to alot of this

Thelgren

can you do new episode combine with "Ollama: Run LLMs Locally On Your Computer (Fast and Easy)" and "Langchain Python Project: Easy AI/Chat For Your Docs"? Which you will just used local LLM to process the Docs

jimmylin

Super interesting! Do you know what are the RAM requirements to run this locally?

alexandrosanapolitanos-ewox

Ollama: Run LLMs Locally On Your Computer (Fast and Easy)

Ollama: Run LLMs Locally On Your Computer (Fast and Easy)

Ollama: The Easiest Way to RUN LLMs Locally

Ollama on Windows | Run LLMs locally 🔥

Ollama UI - Your NEW Go-To Local LLM

Ollama-Run large language models Locally-Run Llama 2, Code Llama, and other models

Using Ollama to Run Local LLMs on the Raspberry Pi 5

Running OLLAMA On Windows // Run LLMs locally on Windows W/ Ollama

Run LLMs locally using OLLAMA | Private Local LLM | OLLAMA Tutorial | Karndeep SIngh

Chat with your LLMs running locally using Ollama and perform RAG on the document in the active tab.

Ollama - Local Models on your machine

Ollama and Langchain || Run LLMs locally

FREE & PRIVATE ChatGPT: Run LLMs locally on your laptop with Ollama!

Using Ollama To Build a FULLY LOCAL 'ChatGPT Clone'

Ollama - Run LLMs Locally - Gemma, LLAMA 3 | Getting Started | Local LLMs

How To Install Any LLM Locally! Open WebUI (Ollama) - SUPER EASY!

Local LLM with Ollama, LLAMA3 and LM Studio // Private AI Server

LiteLLM with Ollama - Run 100+ LLMs Locally Without Changing Code

All You Need To Know About Running LLMs Locally

Ollama | Easiest way to run Local LLM on mac and linux

Run llm models locally on your computer without internet using ollama

Llama 3 Tutorial - Llama 3 on Windows 11 - Local LLM Model - Ollama Windows Install

Unleash the power of Local LLM's with Ollama x AnythingLLM

Run Your Own LLM Locally: LLaMa, Mistral & More

Power Each AI Agent With A Different LOCAL LLM (AutoGen + Ollama Tutorial)