Local LLMs on Apple Mac - powered by MLX!

preview_player
Показать описание
In this short video, we walk through how to run large language models directly on your MacBook in 3 lines of code!

Powered by MLX & Hugging Face Hub! 🤗
  1. VB
Рекомендации по теме
LLMs with 8GB 0:11:09

LLMs with 8GB / 16GB

FREE Local LLMs 0:15:09

FREE Local LLMs on Apple Silicon | FAST!

Running LLM Clusters 0:11:50

Running LLM Clusters on ALL THIS 🚀

How Fast Will 0:09:33

How Fast Will Your New Mac Run LLMs?

Cheap mini runs 0:11:22

Cheap mini runs a 70B LLM 🤯

Local LLMs on 0:13:36

Local LLMs on Apple Mac - powered by MLX!

The ONLY Local 0:13:49

The ONLY Local LLM Tool for Mac (Apple Silicon)!!

Local LLM Challenge 0:16:25

Local LLM Challenge | Speed vs Efficiency

Local LLMs: Connecting 0:18:22

Local LLMs: Connecting Appsmith to Llama3 On an M1 Macbook 💻

Mac Mini M4 0:09:42

Mac Mini M4 takes on M3 Pro, AMD 6700XT, and 3080Ti! LLM Ollama generating side by side

Zero to Hero 0:17:00

Zero to Hero LLMs with M3 Max BEAST

Local LLM Fine-tuning 0:24:12

Local LLM Fine-tuning on Mac (M1 16GB)

Using Clusters to 0:13:00

Using Clusters to Boost LLMs 🚀

Run Local LLMs 0:15:05

Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!

M3 max 128GB 0:08:53

M3 max 128GB for AI running Llama2 7b 13b and 70b

How to Run 0:36:34

How to Run LLM Locally on Your Mac

All You Need 0:10:30

All You Need To Know About Running LLMs Locally

AI on Mac 0:17:46

AI on Mac Made Easy: How to run LLMs locally with OLLAMA in Swift/SwiftUI

Casually Run Falcon 0:05:10

Casually Run Falcon 180B LLM on Apple M2 Ultra! FASTER than nVidia?

Running LLMs on 0:03:47

Running LLMs on a Mac with llama.cpp

It’s over…my new 0:13:52

It’s over…my new LLM Rig

A multi-platform SwiftUI 0:00:19

A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework

M4 Mac Mini 0:10:08

M4 Mac Mini is a new REVOLUTION

Apple Mac mini 0:05:07

Apple Mac mini M1 RAM16GB ollama benchmark for running local LLMs

Комментарии
Автор

This is fantastic !!! Please keep doing MLX videos !! I'm not a programmer but I'm trying to learn how to use this stuff and this is the MOST INFORMATIVE MLX video I have found yet ! I would love to see more ways to use MLX (how can I see Token/s, etc)
Keep up the great work!

billybob
Автор

Great Video! I am having a hard time finding where the files are locally stored/cached

bachbouch
Автор

I want to know what are differences between ollama and MLX?

alibahrami
Автор

Lee Donna Hernandez Larry Thompson William

MariaThompson-dy
Автор

Hi, I downloaded the "mistralai/Mistral-7B-v0.1" model and tried generating a response. But it seems to take 20 mins to generate a response. Any idea why?

andres_junik