How to Run LLM Locally on Your Mac

preview_player
Показать описание
This is your ultimate guide to running large language models locally, on your Mac. In this video we cover three products, from easy to more difficult and each of them can enable you to run large language models on your own laptop or computer.

We cover how to set them up and use them, and how to interact with the APIs for building your own AI applications.

---
  1. Jeremy Morgan
  2. tutorials
  3. ai
  4. local ai
  5. apple silicon
  6. local ai model
Рекомендации по теме
Run Your Own 0:06:55

Run Your Own LLM Locally: LLaMa, Mistral & More

All You Need 0:10:30

All You Need To Know About Running LLMs Locally

Running a Hugging 0:04:35

Running a Hugging Face LLM on your laptop

Run Local LLMs 0:15:05

Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!

Run your own 0:22:13

Run your own AI (but private)

This new AI 0:04:37

This new AI is powerful and uncensored… Let’s run it

Set up a 0:13:22

Set up a Local AI like ChatGPT on your own machine!

Run ANY Open-Source 0:14:11

Run ANY Open-Source LLM Locally (No-Code LMStudio Tutorial)

The 6 Best 0:14:24

The 6 Best LLM Tools To Run Models Locally

How To Run 0:06:53

How To Run LLM Locally on Any Computer With LM Studio (LLaMa, Mistral & More)

host ALL your 0:24:20

host ALL your AI locally

FREE Local LLMs 0:15:09

FREE Local LLMs on Apple Silicon | FAST!

Ollama: Run LLMs 0:06:06

Ollama: Run LLMs Locally On Your Computer (Fast and Easy)

I Analyzed My 0:17:51

I Analyzed My Finance With Local LLMs

Ollama-Run large language 0:20:58

Ollama-Run large language models Locally-Run Llama 2, Code Llama, and other models

How To Install 0:08:52

How To Install Any LLM Locally! Open WebUI (Ollama) - SUPER EASY!

Run ANY Open-Source 0:12:16

Run ANY Open-Source Model LOCALLY (LM Studio Tutorial)

Run a GOOD 0:15:16

Run a GOOD ChatGPT Alternative Locally! - LM Studio Overview

LLM System and 0:06:02

LLM System and Hardware Requirements - Running Large Language Models Locally #systemrequirements

How to Run 0:36:34

How to Run LLM Locally on Your Mac

'I want Llama3 0:24:02

'I want Llama3 to perform 10x with my private knowledge' - Local Agentic RAG w/ llama3

Ollama UI - 0:10:11

Ollama UI - Your NEW Go-To Local LLM

Comment utiliser un 0:04:11

Comment utiliser un LLM HuggingFace en Local ? (Mistral AI, LLama2, ...)

This Llama 3 0:14:58

This Llama 3 is powerful and uncensored, let’s run it

Комментарии
Автор

Hi, very nice video! Thank you! So do I understand that I wont be able to use LMstudio option with the following Mac: MacBook Pro 13.3 i5 1.4GHz/16GB/256GB SSD/INT/macOS ?

monikawodarczyk-dyrga
Автор

Hi Jeremy, love your content! I know its not a Mac but, I have an Alienware m18 R2 with an Intel i9-14900HX, NVIDIA RTX 4090 (24GB), 64GB RAM, and 8TB storage, but I struggle to run LLaMA 70B models. Could you create a video for users like me on optimizing setups (8-bit quantization, mixed precision, etc.) to run large models efficiently? Your help would be greatly appreciated. Many Thanks!

theuniversityofthemind