JAN: This 100% LOCAL AI ASSISTANT is better than ChatGPT (works w/ RAG, Local Models, Groq & OpenAI)

In this video, I'll be telling you about how a new 100% Local Desktop Chat Interface is better than ChatGPT in every manner. It is a fully free option for those who don't want to pay for ChatGPT and are looking for a free and better alternative to it. You can also use it with Mistral AI's Mixtral 8x22b, LLaMa, Gemini and OpenAI API.

[Key Takeaways]
😊 Easy Installation and Setup: Jan is a user-friendly desktop app that offers a one-click installation process, eliminating the need for coding or complex configurations.
🤖 Connect All Your AI Models: With Jan, you can connect and chat with various AI models, including Llama and Mistral, in one convenient place. It also supports remote models like OpenAI and Groq.

🔒 Enhanced Privacy with Local Models: Jan allows you to run AI models locally on your device, ensuring enhanced privacy for sensitive conversations. No internet connection is required.

🌐 Flexible Remote Model Access: If you prefer, you can connect to remote models like OpenAI, Groq, or Mistral API to access their capabilities without the need for advanced hardware.

💬 Conversations Stored Offline: All your conversations are stored offline, and Jan is cross-platform, available on Mac, Linux, and Windows, making it accessible to a wide range of users.

🤝 API Endpoints: Jan creates API endpoints for custom applications or other AI tools, and these endpoints are OpenAI-compatible, ensuring seamless integration.

🔌 Extensions and Customization: Jan offers extensions and customization options, allowing you to add plugins, integrate with other services, and set up features like RAG for document context understanding.

[clint]

I found this a month or so ago and installed it..played around a bit. I was hoping you would do a vid on Jan to confirm whether it was a good choice or not. As a beginner I feel it makes it easier then some of the other models you have shown. Thank you keep up the great work.

[codelucky]

Thanks for creating the video. Ollama web UI is better than Jan's, but it has Groq support, so I would give it a +1 for that.

[nareshtaneja]

iI was just looking for something like JAN, becuse being a non techie, I was getting stuck with VS Code studio and python. Will give it a try. Thank you so much.

[utsavgoswami]

is there a way to change the installation folder for jan in windows? it defaults to the c:\user folder

[AliKiani]

What private LLm open source model is good for cryptocurrency's onchain data?

[thespiritedarts]

i am getting weird replies in icons afer installing llama 3. But ya by ram did not have the support. just 8 gb

[WINTERMUTE_AI]

JAN doesnt work with my GPU, so I use LM STUDIO. But JAN made my favorite LLM, TRINITY 1.2 is the best chat bot.

[LifeTrekchannel]

Braina AI does the same thing - You can run all models at once place with speech to text and text to speech both.

[Centaurman]

Does Jan offer voice to voice functionality? Like ChatGPT voice mode?

[whattheshmitty]

I use MSTY, does Jan allow you to edit the output of the LLM?

[classical_gas]

All looks really good, although I cannot upload a PDF file yet (retrieval is on).

[kyunglee]

this and openui needs docker, is there any that don't need docker?/

[etherhealingvibes]

Thanks AICodeKing, i do prefer Msty for this it runs faster for me.