Private Chat with your Documents with Ollama and PrivateGPT | Use Case | Easy Set up

Important: I forgot to mention in the video . Please delete the db and __cache__ folder before putting in your document. Otherwise it will answer from my sample document.

In this video, we are going to chat with your documents using privateGPT powered by Local LLMs from Ollama.
PrivateGPT: Interact with your documents using the power of GPT, 100% privately, no data leaks
Learn step by step how to set this up on your own system.

I have set up a public github repository for all the Ollama Open Source models.
You can clone the repo and get started with any particular folder for testing out any feature of Ollama.

The code can be accesed from this link:

Let’s do this!
Join the AI Revolution!

#ai #privateGPT #ollama #webui #github #python #llm #largelanguagemodels

CHANNEL LINKS:
🤠Join this channel to get access to perks:

TIME STAMPS:
0:00 Intro
1:28 Install Ollama
2:23 Test Ollama
3:30 My GitHub Repos
5:21 Starting VS Code Editor
7:16 Setting up Virtual Environment
8:42 Install the requirements
10:18 Files for Chatting
10:58 Ingest the files
11:54 Run privateGPT
14:21 Summarize
15:24 Conclusion
15:40 Join Me

If you have any questions, comments or suggestions, feel free to comment below.
🔔 Don't forget to hit the bell icon to stay updated on our latest innovations and exciting developments in the world of AI!

[justhuman]

Just found out your channel and subbed after watching this video.
Very good quality video! Keep up the great content creation!
I am impressed with your motivation to answer the questions from your comment section.
Not every youtube channel cares about answering subscriber questions and doing content around what people comment, so very good job!

[enceladus]

You've saved me from going down my RAG rabbit hole. The code is extremely detailed, clean, and easy to understand too. God bless.

[mjackstewart]

Dude … This is AMAZING! I was just looking for pushes in the right direction, but this actually does exactly what I was attempting to do! Thank you!

[Paul-ggcr]

I've been looking for this for months. Thank you alot, dude! Subscribed :)

[AlexanderDeplov-sdpg]

Great tutorial, one of the best on the web!! Thanks for your time and effort! Upvoted 👍

[batzizou]

Good work!
I found your video well done!

[BeyondTheSide]

I will like to say that this works just as well even today. Much thanks to the prompt engineer, you have made my life and others a lot easier.

[davidpe]

Great video, took me a few tries getting Ubuntu configured (using wsl under windows) and updated before it would build the scripts, but I am very impressed. Thanks for all the effort you put into these videos 😁

[charlesbiggs]

Awesome effort!! Your code worked right off the bat. Thanks for saving me a LOT of time.

[donniealfonso]

Followed your instructions here and installed on Raspberry Pi4. Works but of course painfully slow and chip approach 145 degrees F which slows things down as well. But it works and may try on Pi5. Was using a pdf manual for Viking drill press for document. Have to try something with just text.

[jfranz]

Inspirational video, great work, subscribed. Could you look into integrating a web gui for requests and responses? I'm looking for a local LLM + Documents + URL for tailored and personalized chatbot knowledge store. I use perplexity right now but want to curate my own documents for tailored content. Keep up the amazing videos!

[wryltxw]

this is really high quality content, especially given the effort made in editing. the subtitle is a nice addition also.

[weihe]

Thank you very much, all the videos you have made are great! However, when I was building the local llm, I found that there are multiple frameworks, such as privateGPT, localGPT, langchain, etc. Similarly, I found that there are very many choices for the llm as well as the vector database (e.g., hugging face vs. ollama), which gave me a big headache, and I was wondering if you could make a I was wondering if you could make a video that explains your recommendations for each part of the process of building a rag-based personal local document chat llm?

[iclonethefirst]

Thank you a lot for your effort to create an easier way to get up and running. Could you make a video explaining what all of the parts of "requirements.txt" are needed for? I would like to understand how everything works in detail

[rickgeyer]

Really great video! This has saved me a ton of time as I am building an AI model to ingest thousands of documents and query them. Very straightforward.

What made you choose mistral as the model to use? What is the largest model that Ollama has?

I liked and subscribed! God bless you!

[pankajagarwal]

Well explained. Can you suggest if we want to pass a onenote how we can pass it.

[gabriel-gr]

This has been very instructive, thanks!
Is there an LLM that's better than Mistral at working with very technical documents, i.e. lengthy API implementation documents? I set up my environment exactly as instructed, got my docs indexes and could get some answers on them. But things get murky when I go very specific, with incorrect or incomplete answers.

[Paulo-utli]

Thanks, that’s a great video! I’m testing privategpt for some time and I would love to know if you’re experiencing hallucinations from the chat? And yes mistral seems to be a good model but Zephyr and Dolphin seems to give better answers with a little less performance, depending on the context. Therefore, I couldn’t Get rid of some hallucinations, I would say the reliability of information is 45-65%

[roaming]

Are you using the code from private gpt’s primordial version? What a great work! By the way, now they officially support integration with ollama. You probably wanna make a video about how to set this up.

[renierdelacruz]

Great video, thanks for sharing it.
Can you create a Video content talking about making work Cheshire cat on ollama ? Must be interesting.