Unlimited AI Agents running locally with Ollama & AnythingLLM

Hey everyone,

Recently in AnythingLLM Desktop, we merged in AI Agents. AI Agents are basically LLMs that do something instead of just replying. We support both tool-call-enabled models like OpenAI but have even now have a no-code way to bring AI agents to every open-source LLMs like with Ollama or LMStudio.

Now, with no code required, you can take any LLM and get automatic web scraping, web-browsing, chart generation, RAG memory, and summarization all autonomously and running locally.

If the future of AI is agents, AnythingLLM is where it is going to happen!.

Chapters:
0:00 Introduction to adding agents to Ollama
0:45 What is Ollama?
1:08 What is LLM Quantization?
1:28 What is an AI Agent?
2:54 How to pick the right LLM on Ollama
5:11 Pulling Ollama models and running the server
5:45 Downloading AnythingLLM Desktop
6:17 AnythingLLM - Initial setup
7:21 Sending our first chat - no RAG
8:22 Uploading a document privately
8:43 Sending a chat again but with RAG
9:10 How to add agent capabilities to Ollama
10:45 Add live web-searching to Ollama LLMs (Free)
11:41 Using agents in AnythingLLM demonstration
13:24 Agent document summarization and long-term memory
14:35 Why you should use AnythingLLM x Ollama
15:00 Star on Github, please!
15:06 Thank you

[sergiofigueiredo]

@TimCarambat I had to pause the video just to leave a comment! I'm deeply impressed by the excellence and simplicity of the content presented here. It's truly remarkable to have access to such tools, created by a team that clearly demonstrates passion and a keen ear for what we all think and wish would be great to have, and at every update, distilling all p of these wishes into a few simple clicks within this amazing piece of technology! I'm immensely grateful for the opportunity to experienceh the brilliance of software engineering and development of Anything LLM, especially within the context of open-source communities. Participating in the advancement of genuine and incredible open tools is a privilege. Thank you Tim! I will be promoting this project to the moon and back, because this deserves to be known.

[Biskern]

You are a gift from god, TIm Carambat.
Thank you for your continous efforts to make these technologies available to the rest of us.
If this was 10.000 years ago, YOU're the guy teaching the rest of us how to make fire with flint and tinder.
May you and your loved ones be blessed for eternity!

[trsd]

AnythingLLM NEEDS to get more attention, because its simply great! I can’t wait to see custom agents in AnythingLLM! Well done!

[bro_truth]

Bro this has to be the most comprehensive, simple, engaging and all around entertaining video on AI I've ever watched. Your presentation, explanations, and exert level knowledge base are all 'S' tier! Bra-freakin'-vo! Subscriber well earned and deserved! 🏆👏🏽👏🏽

[surfkid]

You built an amazing piece of software. Thank god that I stumbled across this video.

[gordonwoo]

Thank you very much. As soon as I saw that RAG was built in and it was simple to use, I immediately started finding readme pdfs on various topics to ensure I could use this tool as efficiently as possible. After my targeted pdfs are found, I plan on grabbing data from how-to and wiki.

[jimg]

Been using for the past few months and is my go-to app for local RAG. Adding agents huge plus. Looking forward to being able to add my own AutoGen agents to the list with their own special tools. Thanks for the great work Tim.

[TheDrMusician]

This is by far the easiest and most powerful way to use LLMs locally, full support, like and sub. And many thanks for the amazing work, especially being open source.

[KK]

I have loved everything llm since the beginning.

[fxstation]

What I love about your tutorials is that you succinctly explain all the things that come across during the tutorial. Thanks!

[yusufaliyu]

Great this will make LLM more understandable for many ppl.

[liviuspinu]

Thank you for explaining quantisation in details for niebiews.

[jonathan]

Tim, thank you for making the world a better place with this awesome tool! :)

[lostmusichits]

Excellent video! Thank you for explaining things plainly and quickly. Valuable.

[SiliconSouthShow]

@TimCarambat
I'm excited to see the features you talked about work with the ollama like in the video for the agent, as of now, its same as before I updated, but it's exciting to think of the future.

[jakeparker]

This is so dope. Great no-code solution and it's awesome that it's open source.

[flusyrom]

Funny ! I heard yesterday for the first time about AnythingLLM during an AI-info event.... and discarded the idea of giving it more attention because it was presented as "just another local RAG support". And now I stumble across this video by chance - and the additional agent functionality changes everything ! BTW, very well presented, this feature !
My immediate idea & feedback: if there was ANY chance to model custom agents in Flowise and re-import the JSON exports of this Flowise flow as input for an AnythingLLM custom agent, you'd save yourself the trouble of designing your own agent editor AND would start with a comparably large installed base. OK, maybe that's just wishful but maybe I'm also not the only one with this wish to facilitate local agent building ;-)

[quinnlintott]

I had no idea you had a channel talking about your software. Im a big fan of your work!

[MaliciousCode-gwtq]

Damm, ... finally found the tools that i been looking for..MAN you save my day, i have been crazy stuck finding webui for my ollama remote server..your a gift from heaven keep it up your helping alot of people like us..thank you so much..❤❤❤😂😅😊😊

[fluffsquirrel]

This is absolutely absurd. Thank you so much, this is an incredible project and I hope it gets more attention. I'm sold!