Custom AI Chatbot for Websites using any LLM | No-Code | Open-Source

In a world of pay-per-token LLMs you probably have looked everywhere to get your Local or Cloud-hosted LLM model to act like an AI assistant on your website - well now with AnythingLLM it is free and open source!

Today, we are going to create an AI chatbot for our website trained on the data from our own website! All of this is built into the AnythingLLM cloud or our self-hosted version you can run anywhere.

The embed takes minutes to set up and is a single HTML snippet you can embed into your website and get a powerful chatbot to handle customer questions.

With AnythingLLM, you can now publish smarter chatbots using any LLM trained on your custom documents and show them on any webpage will all the controls and tools you need to make sure the questions are on topic and costs are controlled!

AnythingLLM supports link-scraping, PDFs, text documents, and so much more then you can throw at it!

Chapters
0:00 Introduction to AnythingLLM Embeds
0:34 AnythingLLM Cloud or Github setup
0:52 Chatbots are everywhere - intro to demo!
1:34 What is an AnythingLLM workspace?
2:19 Aside: How to use any LLM for your AI chatbot
2:45 Create the workspace
3:25 Add custom documents to a workspace for knowledge
3:42 AnythingLLM has a free embedder? WOW
4:15 Showing how much smarter our workspace is
4:49 Creating the embed & available controls and settings
7:07 How to copy the embed to paste into your site
7:21 How to do this with your site (or via Framer)
8:03 Success!
8:39 Customizations for your embed
9:31 Thank you!

[mathiasschrooten]

This is legendary. Thanks for your great work, you’re amazing!

[spalmgre]

It is unclear how to use or do the Cutomization to the Chatbot. I think you would benefit from showing also how to do this on WP. It can seam to you like the same way as on other platforms but to us users we hardly are able to do it on ower own (WP) platform. If you know then you can but if not then you dont know how to begin.
I like to use AnywereLMM as a backend to our website and CRM (our own dev) and need an api.

[CarloAnardu]

i can't find the option, it's because i'm on windows?

[kingdelo]

Hi Tim, I recently installed your software, and in my Set Up list, I cannot obtain the embedded code because the software does not have an icon for it.

[mochammadrevaldi]

How to config implementation for huggingface open source model? without openAI API.
thanks for the insight anyway

[sailasn]

Embedding option for publishing is not visible

[stanTrX]

hello tim. i dont see much info about the "agents" in anything llm. how can we use them? secondly, groq integration seems to work for only mixtral and new models like llama3 doesn't appear in the groq option inside anythingllm. thanks

[ArielYahni]

Great app, love it. Im not seeing the chat embed option in 1.5

[jiuvk]

I love it!, I already have it set up and it surprised me that it deduced from context something that I didn't explicitly mentioned in the document I'm testing (I'm using LM studio with a mistral model). But I don't know if I'm missing something or doing something wrong but I'm missing the "embedded chat" tab on the settings under "data connectors", also in the appearance tab I'm missing the option to change the branding the logo or pics for the chatbot or for my icon.

[googleSux]

I tried to use anythingLLM in chat mode thinking I could just interact with the LLM without any docs. Instead of going over to ChatGPT or whatever. 5:28 Did not work. Any solution ?

[kimaegaii]

Can you show how to do it with Ollama, I'm not sure what to put in for Base URL, or token numbers.

[manifunn]

do I need to buy a computer with the GPU power? what is the hardware specifications needed

[codelucky]

One more question, can I connect Claude 3 Opus API to AnythingLLM?

[dozieweon]

Can i create this chatbot for messaging services like Telegram and WhatsApp?

[arung]

Hi this is awesome and am newbie.. does this bot have voice to text functionality? Will it also help integrating streaming avatars such as heygen api?

[maxmuster]

I am waiting for an online version, no download&installation, no registration and no limit to use it for free.

[jsalgueiro]

Hi Tim - Question, is there any way to customize the 1000 token limit that we're seem to be encountering?

[Rafifkhalidpermana]

can you tell us the specs of your laptops or cpus to run this demo? thanks.

[deandresnago]

thanks, i dont seem to have the chat embed feature . do i have to activate it somewhere .