Run ANY Open-Source LLM Locally (No-Code LMStudio Tutorial)

LMStudio tutorial and walkthrough of their new features: multi-model support (parallel and serialized) and JSON outputs.

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? ✅

My Links 🔗

Rent a GPU (MassedCompute) 🚀
USE CODE "MatthewBerman" for 50% discount

Media/Sponsorship Inquiries 📈

Links:

Disclosures:
I'm an investor in LMStudio and CrewAI

[bonkywonky]

Project idea: create a bunch of agents that are experts in specific areas, like coding, Wikipedia, reasoning, law, etc, and then an orchestrating agent. The orchestrator will be the only one the user then interacts with. The orchestrator then figures out how to respond to user queries by finding all available agents available and selecting either one or multiple to produce the best answer possible.

Either the agents have descriptions of what it’s good at or if the orchestrator can see each agents metadata and even just recognize what they’re good at by just seeing how they’re setup, that would be even better.

[karankatke]

We need more usecase and practical guides with LM studio. Love your videos. ❤

[starblaiz]

I've been using LMStudio since your last tutorial on it, and I can attest that it's FANTASTIC to use and takes all of the headache out of setting up local AI's. TIP: In LMStudio's settings you can specify the folder to download AI models to. It's worth getting a small dedicated flash drive to store them on. That way you can play about with them without having to worry about hard drive space as the smallest models are about 5GB and the largest can get into tripple digits. Yes loading them up will take slightly longer, but inferrance won't be affected as that's done entirely from RAM (and if it's too big for the RAM then it will use your main hard drive for VRAM just like it would normally, so having it on external USB flash doesn't affect it).

[abdelhakkhalil]

Thank you for the video, and thank you for disclosing that you are an investor in both LMStudio and CrewAI. I wish you could mention it in the video for better transparency.

[OproDarius]

Such an awesome software, can't wait to see the local open source software delivering agent and llms in 5 years, will be such a ride!

[TheExcellentVideoChannel]

Thanks Mat, what would we do without you to guide us on this journey!! I started on ollama and ran into some issues that I don't want to solve just yet but it looks like LMStudio is what I need to move to to get around the issues. Nice and timely tutorial/overview.

[OzzyMotoK]

Great video, Matt - you have no longer jumped the shark. :)

[BudoReflex]

I love how you move through topics and keep a concise summary of what is happening without going down rabbit holes. I learn a lot very quickly.

[krisknap]

Thanks for sharing this update and demonstrating with the examples!

[lancemarchetti]

The system requirements are very helpful. Thanks

[morena-jackson]

Love this type of video, thanks so much for really going into LMStudio. I"ve had the program for a dew months now but never really played with.

[issiewizzie]

I'm hoping in the future, there will be a way to train an LLM or specialised model more easily for a beginner. Almost iPhone-friendly.

[riyadwahib]

Thanks Matt! Great video as usual :) Yes please would be nice to see you build something with powering agents!

[wakingdreamsroleplay]

I am not a coder so I love your videos. This agents stuff excites and terrifies me. I would love to see a project that involves writing complicated documents such as text-based games (for improvised drama type activities) where the character descriptions have clue info about other players. So, the writing agent creates setting and background and character descriptions but an editor needs to go through the full document and check and make sure clues found in one character file also show up in other files and send back to writer to reiterate until everything checks out. I can do part of this with prompting but it always needs a lot of manual editing and so a way to automate would be nice. If you can demonstrate some similar process, I would certainly be thrilled. ;-)

[eagleterry]

Looking forward to seeing you build a project .

[screamingiraffe]

best video so far, thank you for this

[panagiotisgalinos]

Man, i like your videos. Very informative.

[armans]

Yes, please. Also publish your endpoints for consumers 🎉❤

[jackflash]

YES to the agents locally.

Any interest in checking out Devika? Claim to be open source Devin.

[vibeymonk]

Loved this video, please make a playlist out of it! More inclined for people like me.