How to Run Large Language Models (LLM) on Your Laptop with LM Studio

preview_player
Показать описание
In this video, I'll show you how to run large language models (LLMs) right on your laptop using LM Studio—no need for expensive hardware like the RTX 4080 or 4090! LM Studio uses GPU offloading to break down complex AI models, allowing you to run them smoothly on almost any laptop. Whether you're generating text, summarizing documents, or asking questions, I'll guide you through the installation process, how to load and use models like Llama and Gemma, and even how to upload files for analysis—all while keeping your data secure on your PC. Perfect for those who want to explore AI without relying on cloud services!

Host: Kevin Stratvert

📚 RESOURCES

⌚ TIMESTAMPS
0:00 - Introduce LM Studio
0:41 - Download and Install LM Studio
1:41 - Download and Load Your First LLM (Llama 3.2 1B)
2:48 - Interact with AI in LM Studio (Chocolate Chip Cookie Example)
3:18 - Upload Documents and Interact with Them
3:50 - Explore Other LLMs in LM Studio (Mistral, Gemma)
5:36 - Wrap Up

📩 NEWSLETTER

🔽 CONNECT WITH ME

🎁 TOOLS AND DISCOUNTS

🎒 MY COURSES

🙏 REQUEST VIDEOS

🔔 SUBSCRIBE ON YOUTUBE

🙌 SUPPORT THE CHANNEL
- Hit the THANKS button in any video!

⚖ DISCLOSURE
Some links are affiliate links. Purchasing through these links gives me a small commission to support videos on this channel. The price to you is the same.

#stratvert #lmstudio
Рекомендации по теме
Комментарии
Автор

Many thanks Kevin. I'm an academic in Australia and always find your videos very useful 👌👍

engineeringmanagementacademy
Автор

Kevin king of tutorials. Period. You are the best!

sandro-nigris
Автор

Wow. This is game changing. Do they provide SDK for this. So that we can build different apps that are not chat workflow based? For example I will create an app that scans my online storage drive for some Excel files and then trigger LM for that Excel file to get insights. Wouldn't that be cool 😊.

nithinb
Автор

Kevin this is an absolutely amazing amazing amazing video. Thank you for making this.

himanshuvajani
Автор

Great clip Kevin. Now do one on Agents, coz thats where all the trippy stuff from MS/Google etc come in with their biases and all. Thanks

ade-ade
Автор

What about training on specific materials?

sep
Автор

The models chosen here seem absolutely tiny, so I am curious about how large a model one can realistically access and run on consumer grade hardware, e.g. 32 gb ram and 8-10 gb graphics card?

kbqvist
Автор

Thanks
Sir
how to download videos from any website ?

danielodeliro
Автор

Kevin, I teach high school mathematics. What is currently the "best" free Mathmodel?

Simonovits
Автор

Thanks Using LM studio can we replicate a webapp to desktop app?

atultanna