Private GPT4All : Chat with PDF with Local & Free LLM using GPT4All, LangChain & HuggingFace

Join me in this video as we explore an alternative to the ChatGPT API called GPT4All. Discover how to seamlessly integrate GPT4All into a LangChain chain and start chatting with text extracted from financial statement PDF documents. With the help of HuggingFace and chromadb, we'll also delve into creating embeddings. Don't miss this opportunity to learn how to chat with your files locally and completely free of charge!

00:00 - Introduction
00:27 - GPT4All
04:10 - Load PDF File
07:45 - Create Embeddings
09:16 - Load GPT4All with LangChain
10:40 - Chat with the PDF File
13:07 - Conclusion

#chatgpt #langchain #promptengineering #gpt4 #artificialintelligence #python

[atanasmatev]

Добро е GPT4All и аз го тествах, но наистина е бавно. Според Gartner, близката година за технологиите ще е с фокус Edge AI, което ще значи, че тези модели би трябвало да се оптимизират да работят на embedded PC-та .. дори на телефони. Но "поживем - увидим" както се казва :). Браво за видеото. Супер е.

[RobMaurerMA]

This is an excellent and comprehensive demonstration. Thank you for being realistic. You have well described the performance limitations of this Experiment, But the privacy still makes it attractive.

[Romson]

Woah. This is so cool! Thanks for video

[a.amaker]

nice wutang shirt and great content. thanks

[DarkOceanShark]

Can you please make a video on using LangChain for Pandas DataFrame with GPT4All querying.

[elekktrikk_home_video]

It immediately asked for permission to read all sources of data (documents, desktop etc.) There is a workaround but that was chilling. (MacOS GUI)

[emanuelm]

Thank you so much! this is really awesome content!

[vandanasingh]

I am trying to do on server. I am getting issue
Using embedded DuckDB with persistence: data will be stored in: db
Illegal instruction (core dumped). can you help me out regarding this?

[nnsgogw]

your solution is superb i really enjoyed this but i want to ask one thing like in this code query time is too much how can we reduce this?

[vezydji]

I am trying this, but its not give output only give connection timeout. Why ? Could you help me in this

[Vladislav-oxuj]

It's normal +- 10 min on request?I think it's very long time. I have other methods for it task? I can run on GPU?

[okcelnaj]

I got the following answer:
"I do not have access to information regarding specific companies' financials or dividends paid in previous years due to data privacy concerns and restrictions imposed by laws such as GDPR (General Data Protection Regulation). However, you can find dividend amounts for a company's historical period on their website if available."
LOL, what am I miising?

[mohamedzekkiriya]

I am getting this error,
llama_model_load: loading model from - please wait ...
llama_init_from_file: failed to load model. Please help me to get this resolved.

[Videodecumple]

I'm a total beginner. Once all packages are locally saved, can I use this offline or do I need to be connected to Internet?

[aboudezoa]

Can I use the new model LLAMA 2 to chat with PDF ? Or this is good and better ?

[lionfederal]

How many files do you think this would be able to successfully query?

[davidcurious]

explained thoroughly, however quickly outdated, code can not run properly now.

[AwsmAnkit]

did you find any way to speed up the response?

[georgekokkinakis]

You video was really inspiring for me, many many thanks. I use a google colab environment with 35 GB RAM. When I ask a question for the second time it crashes due to RAM limits. Do you know why.? Also I would like your opinion in the following. I have a csv file where each row holds a mathematical definition (generally it holds some text) What would be the best way to return the text that is more relevant to the user's question?. Should I use gpt4all with langchain or there is a simpler way to do it? One problem I am facing is that I want it to work for the Greek language so far I can't find an LLM that works with Greek, only GPT from openAI, but I want an open source solution. I am struggling with this many years now. : (

[bhaskartripathi]

Excellent video but these free models r useless