How to install and use PrivateGPT - Privately Chat with your own documents

PrivateGPT is a really useful new project that you’ll find really useful.

You can basically load your private text files, PDF documents, powerpoint and use the power of Ai to interact with those documents. And it’s private and on your own computer.

It doesn’t have access to the internet and runs locally on your computer.

I’ll show you exactly how to set it up and use it and I’ll simplify it, so you can do this, even if you don’t know anything about computer programming.

First, you need a program called Visual Studio. You can download that here:

Then go to file, new window. Then, make sure you can see the terminal section on the bottom of the page.

Next, you need the code from Github. You can copy the URL of the Github repo here.

Go back to Visual Studio. Type cd desktop to access your computer desktop.

That should take a few seconds to install.

Then, go inside that folder by typing cd PrivateGPT

The install should take a few minutes. If you have issues, you can type pip3 to use a specific version of python. If you don’t have python installed, you’ll need to install that first.

Back in Github, download the LLM model.

Now, you can make a new folder called LLM models and move the downloads to it. You can use the finder window to make it easier.

You should see a folder called source-documents. This is where you will add your private documents. There is a test file there by default you can practice with.

You can check the Python version in your terminal or command prompt by using the following command: python --version
Or, for Python 3 specifically:python3 --version

To use it, use this command. python privateGPT.py
(Or python3 privateGPT.py)

The answer typically takes 20-30 seconds.

Remember to run the ingest prompt when you add new files to your folder.

[HernaniSamuel]

PS pip install -r requirements.txt
ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'requirements.txt'

[morris]

I developed and implemented a web-based version several months ago. Always amazed by all the changes we are experiencing. Where is your env?

[wolframdanielh.]

Hello, I am stuck at the "Enter a query" prompt, receiving this error message: "Index not found, please create an instance before querying". Can you please help?

[ysaleh]

How easy installation in Youtube BUT in real life its hard as hell

[hadeltuch]

the requirements.txt is no longer in the ZIP... :( What should i do know?

[ximwrxl]

this link don't match to what he has shown and there is no folder .txt so some errors pop up.

[ozanpress]

This is more complicated than that. You would need C++ complier, python, Visual Studio etc etc.

[davidaliaga]

Is this a tutorial about an old version of privateGPT? because not only the installation with pip is not supported anymore but now there are makefiles to run things it seems

[rosalindhb]

Definitely not beginner friendly. I'm getting all sorts of errors. 😂

[rileydunnaway]

@Howfinity I receive an error saying that "No sentence-transformers model found with name Creating a new one with MEAN pooling". It then times out because I need to run this offline. Any answers?

[motarek]

funny how it all seems so easy. In reality, this is a nightmare.

[ahmedkamal]

Can you guide me change llamacpp parameters to reduce time of query

[asherhaque]

this doesnt work. after installing multiple missing libraries it gets stuck at ValueError: You are using a deprecated configuration of Chroma.

[TheCommando]

Anyone have any suggestions for fixing the error I'm getting when running "pip install -r requirements.txt" (note: I've tried running "pip3 install -r requirements.txt" and get the same error)

ERROR: Failed building wheel for llama-cpp-python

[martysausville]

\privateGPT> pip install -r requirements.txt
ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'requirements.txt'

it looks like the 'requirements.txt' is not there.
Any thoughts on how to get past this?

[drkmtr]

Hi Authors, I have questions. during pip install -r requirements.txt, I'm unable to install the requirements file as it not available even I'm try to locate it. No luck. I run on Windows 11, the installation is similar to yours. Hope hearing news from you soon

[hikpras]

is it possible to "train" the private gpt by connection to own datasource/database of existing app, or document in own NAS ?
how?

[CostasSachpazis]

Great Guidance! Thank you! Btw: I got this message ==> UnicodeDecodeError: 'charmap' codec can't decode byte 0x9f in position 15350: character maps to <undefined>
Any help, please?

[Thee_such_place]

can you use wsl (windows subsystem for linux) for windows?

[cl]

Anyone can help please.!! I am not able to install it on local PC. (missing requiremetns.txt and examples.env)