Llama-3 🦙 with LocalGPT: Chat with YOUR Documents in Private

In this video we will look at how to start using llama-3 with localgpt to chat with your document locally and privately.

Signup for Advanced RAG:

LINKS:

TIMESTAMPS:
[00:00] LLAMA-3 with LocalGPT
[00:22] Setting Up the Environment
[02:01] Installing Required Packages
[03:22] Accessing Gated Models
[05:45] Ingesting Documents and Running LocalGPT

All Interesting Videos:

[soarthur]

This is very interesting and great work. There is the Mozilla project called llamafile which makes running local LLM with one simple executable file. It also can use CPU instead of GPU intensive. LLamafile makes running LLMs on older hardware possible. It has great performance improvement. It will be great if LocalGPT can work with LLamafile. Thank you.

[thegooddoctor]

By Far the LocalGPT is the most robust RAG system out there - Thank you - But I'm running it on a i9 13900/4090 GPU system - Is there any plans on making the RAG system a bit faster - It can take up to 5 minutes to come back with a Thanks again - Very Cool...

[EDRM-myrd]

I tested the ingest and query model with PDF edition of FINANCIAL ACCOUNTING International Financial Reporting Standards ELEVENTH EDITION using default parameters and answers were 80% wrong, particularly with sample journal entries from the context:
> Question:
provide example of VAT journal entries
> Answer
* The sales revenue is recorded as a debit to the "Sales Revenue" account, which increases the company's assets. <- Sales Revenue is credited if earned. The debit belongs to assets accounts.

* The sales tax collected is recorded as a credit to the "Sales Tax Collected" account, which also increases the company's assets." <- Sales tax collected decreases company assets because is money owed to the tax authorities.
I will make more tests but so far, this doesnt look reliable at all.

[azizjaffrey]

Please keep this code version for future use, if you update code and if people cannot find code from this video they skip, which i personally did on your old video on LocalGPT and started watching this but for my gpu old code was compatable but cannot clone, since that version doesnt exist

[NovPiseth]

Hello thanks for great video you help me alot about this. Could you help me to add Panda and PandaAI? it could help me to analys the data from the excel and/or csv file. Thanks

[zahidahmad]

I want a specific conversational chatbot with very few amount of data. How can I do it?

[kingfunny]

can use this offline
and
Can I save the conversation so that I can refer to it after a period of time or when creating a new conversation?

[TraveleroftheSoul]

there is a problem in the code. Even when I ingest new files it's still gives answer and make mess with the last file I deleted. How to handle this. I tried different prompts but it's not working for me?

[oecypher]

a .exe or a gui for windows would me nice gradio like stable diffusion please

[pablolbrown]

Any idea when support for Apple Silicon M3 is coming?

[lucrido_ase]

May i use llama3 with languages other then english?

[deepharia]

ok now see i have Windows and 6gb GPU VRAM and around 64gb normal RAM which LLM model could I run locally but I need a UI for the text prompt so I can chat easily with that chat bot with many functionalities such text to text, speech, video, ETC. so please tell me sir.

[Player-oznk]

Very interested in how to correctly ingest csv files and formats and limitations

[adityamishra]

I am getting this error: You are trying to offload the whole model to the disk

[vetonrushiti]

does localgpt work in an ubuntu machine without nvidia gpu?

[colosys]

Could you help me configure localGPT with pgvector embeddings? :$ I'm seriously struggling

[ai-folk-music]

Why use this over something like AnythingLLM?

[zahidahmad]

4gb gpu 16 gb ram. Will llama3 work fine?

[FranchGuy]

Hi, is there way to contact you for privet project ?

[kunalr_ai]

😂kuch samaj nahi aa raha .. kaha se start karna hai