How To Use AutoGen With ANY Open-Source LLM FREE (Under 5 min!)

A short video on how to use any open-source model with AutoGen easily using LMStudio. I wanted to get this video out so you all can start playing with it, but I'm still figuring out how to get the best results using a non-GPT4 model.

Enjoy :)

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? ✅

Rent a GPU (MassedCompute) 🚀
USE CODE "MatthewBerman" for 50% discount

My Links 🔗

Media/Sponsorship Inquiries 📈
Links:

[matthew_berman]

Should I do a full review of LMStudio?

[DevonAIPublicSecurity]

All I can say is thank you for your videos, you give enough information to get things up and running without making it overkill. Please keep making more videos like these I am learning soooo much ...

[neoblackcyptron]

You are a lifesaver, you give so much top-notch content for free. I am about to start-out in a startup where we plan to use a mix of GenAI (driven by stuff like Autogen) and traditional ML models (I wonder if we will need these ever again in the future) with some RPA to spce things up. These videos of yours have given me full coverage of what I will need to do as far as the GenAi side of things is concerned, that is very new for me.

[mcusson]

Thank you for this timely video in my rough AI journey. I feel this is the boost I needed.

[ArianeQube]

I was waiting for this ever since Autogen came out. Thanks :)

[naytron]

Man, thanks! Can't believe how easy it is -- was a great idea to build LMStudio to mimic the OpenAI API. Definitely looking forward to seeing more content on your exploration of this!

[shannonhansen]

I have to say, I was struggling with this exact task...getting an open source model to load up and expose a openai API endpoint. Awesome content as usual!

[peralser]

Matthew, thanks for your time. You do an amazing job promoting these things in the way that you do. Thanks again.

[cristian]

Finally something local and totally free, amazing thanks, it's been a long wait!

[matthewstarek]

I'm so glad I found your channel. When I watch your videos, I feel confident that I know the latest info on AI and how to best utilize these tools. Thank you for doing what you do! You rock! 🤘🤘🤘

[leonwinkel]

Wow super nice stuff!! This is what I was waiting for! It makes it so easy to use llms basically anywhere, Amazing!! Thanks for sharing this ultra valueable content with us 🙏🏼🙏🏼🙏🏼

[fleshwound]

I tried to get this done myself so this will save me a lot of time lol thank you!

[dataprospect]

You are the best! You sometimes feed us directly what we need and sometimes you teach how to catch the fish. In this video, you did both.👏

[aliabdulla]

Believe it or not. I find myself in the first minute unconsciously pressing the like button. you are my hero. Please keep putting up beautiful content like this.

[peterc]

Amazing work, thank you so much for sharing this! Now let's make this a start of a new era of locally running autonomous assistants which are actually helpful and free to use.

[jonathanozik]

Thank You so much for showcasing this. I've been using LM Studio and GTP4All for a few months now and I really like them. One problem - I could not make LM Studio to use my GPU, tho other people are successful.

[the_CodingTraveller]

I love the way you teach and explain stuff. It is the right tone for me AND you look like Gale from Breaking Bad.

[TheJnmiah]

Thank you for this! WOW, this runs very well on my laptop. I'm playing with Mistral right now, and so far it's great!

[Dewclaws]

First off - Thanks for all the content and it is very evident that you put a lot of effort into research time for the each upload. That being said, there's one small suggestion I'd like to make, if you could include links to repositories and tools, brought up in your videos. Often, I find myself wanting to play around and learn more about a showcased tool, but without direct links, it can sometimes be a bit of a hunt. I understand that adding links might take a bit of extra time, but I believe it impove your channel reviews.

[manuelherrerahipnotista]

Thanks man. This open up a lot of very interesting stuff to try.