How to Set up and Use PrivateGPT and LocalGPT

LLMs are great for analyzing long documents. But one downside is, you need to upload any file you want to analyze to a server for away. If you are working with documents that might have sensitive or private information, this would not be preferred.

In this video, we will see two options for setting up LLMs locally on your machine to analyze your files. You have the option to ask questions and interact with your files in a conversational manner.

The two options we will see are:

Let's dive in!

00:00 Introduction
01:15 LocalGPT
07:16 PrivateGPT

▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬▬

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

#MachineLearning #DeepLearning

[konstantinlozev]

These RAG solutions are basically chunking the contents into 2-3 paragraph long chunks, doing a semantic search and then putting out the results as a context for the chat function.
It's normal that they do not perform well on summarisation.

[sivasangaranv]

It's very much useful to me for my studies. Thank you ma'am

[John_Krone]

Perfect explainer. I have a mac also so this was golden. Thanks

[kshitijdesai]

I have tried it before, what you are using are raw models, however large you use, it needs to be finetuned for the task that you wish to perform which is in this case, the answer that you are expecting, otherwise they don't seem to be practical enough as of now.

[manu_ovg]

Which Mac you have ? M1 or M2 ?
Because this looks fast

[otomakannioc]

I like LLMs as long as they come along in such sympathic manner as presented in this video ;-)

[rrzz]

What are differences between PrivateGPT and Local GPT?

[lyytiuw]

"just install poetry" - do I have to integrate them or its done by install script of privateGPT?

[narendrakd]

Hi MAM, I want to know can i ingest multiple files and i have 1000 docuemts pdf, txt and docs & i want to create graphical user interface based chat bot, can i ? can you please guide me mam.

[MuhammadDanyalKhan]

Does private GPT or localGPT allow stacking of model? i.e. giving query to model that is best suited to answer?

[therohitdas_com]

Why did you skip the part where we need to build the llama.cpp with METAL support? It should have been included in this tutorial.

[vetonrushiti]

does localgpt work in a ubuntu machine without nvidia gpu?

[Derouz]

If AI is so advanced, couldn't they create installers similar to those in Windows to make it easier to install these programs without having to manipulate code?

[zrdwibd]

ERROR: Could not find a version that satisfies the requirement autoawq (from versions: none)
ERROR: No matching distribution found for autoawq

why do I get this error for localGPT

[mochammadrevaldi]

halo thankyou for the tutorial. can you explain how to use posgreSQL mode for vectorstore database privateGPT?

[kaistriban]

Great video. Thanks. On Mac giving the command git clone I got a xcrun error and apparently is not an uncommon error. I solved it by reinstalling xcode giving the command in the terminal: xcode-select --install

[browny]

localGPT does not work on Mac unfortunately

[kajalsharma]

Hello, anyone please help me i am getting error again and again

[DanielArnolf]

We call yaml extension "Yamel"

[ldandco]

The face of AssemblyAI is just gorgeous