Llama-2 with LocalGPT: Chat with YOUR Documents

In this video, I will show you how to use the newly released Llama-2 by Meta as part of the LocalGPT. LocalGPT let's you chat with your own documents. We will also go over some of the new updates to the project.

If you like the repo, don't forget to give it a ⭐

#localGPT #Llama-2 #langchain
▬▬▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
LINKS:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Timestamps:
Intro: [0:00]
Setup of LocalGPT: [01:20]
Updates to run_localGPT.py: [08:31]
Support for GGML, GPTQ & HF models: [09:20]
Adding Llama-2: [12:30]
Running Llama-2 in localGPT: [17:00]
Show Sources: [18:45]
How to Improve Answers: [19:25]
Updates: API & GUI: [20:40]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
All Interesting Videos:

[engineerprompt]

Want to connect?
|🔴 Join Patreon: Patreon.com/PromptEngineering

[electricsheep]

This is the most important Youtube video I have ever watched. Thank you and all the contributors. Looking forward to the prompt template video!

[synaestesia-bgew]

Love you, you the best YouTuber Ai expert. I am learning so much because you don't just talk, you are making things work.

[RabyRoah]

Awesome video! Would next love to see a video on how to install LLaMA2 + LocalGPT with GUI in the cloud (Azure). Thank you.

[swanidhi]

Great content! I look forward to your videos. Pleae also create a video to guide people who are new to the world of deep learning so that they know what to learn from where and things they need to learn to start contributing to projects such as localGPT. Also, another video on how to determine which quantized model can be run efficiently on a local system by specifying parameters for this assessment. Thanks again!

[simonmoyajimenez]

I found this video really compelling. I believe it would be incredibly fascinating to leverage a CSV connection to answer data-specific questions. It reminds me of the article I read titled 'Talk To Your CSV: How To Visualize Your Data With Langchain And Streamlit.

[isajoha]

Thanks for the overview explaining the differences between the models in the context. 👍

[richardjfinn]

Worth pointing out - you got it when you asked to show sources, but the presidentail term limit is NOT in Article 2. It's in the 22nd Ammendment, passed in 1951 after FDR was elected to a 3rd term.

[brianhauk]

I look forward to seeing your different prompt templates based on the chosen model. 🙂

[awu]

really like your video!! Looking forward for the video about the local GPT api😃

[ssvfx.]

after 10 hours straight...














WE GOT ENTER A QUERY:

[MikeEbrahimi]

A video with API access would be great

[SamirDamle]

Is there a way we can have a Docker image of this that I can run as a container with everything configured by default?

[InnovationDevInsider]

It would be great if these massive beast models could run on low-end machines so that we can increase contributions

[DarylatDarylCrouse]

The code shown in the video is not the same as what is at the repo right now. at 13:17 for example, I can't find any of that in the current repo. Pleaser help.

[intuitivej]

Hi
thankful for you, I am experimenting llama2 13b ggml in my notebook.
But a few days ago, I was realized that llama was not saved in my local but it was like.. i don't know.. snap shot...?I want to save the model and load it from my local path. I tried some codes but failed.. could you please guide me? Thank you again for your sharing ❤

[ypsehlig]

Same question as shogun-c, looking for hardware spec recommendations

[Shogun-C]

What would the optimum hardware set up be for all of this?

[adivramasalvayer]

Is it possible to use elastic as a vector database? If yes, may I get the tutorial link? Thank You

[skrandas]

@engineerprompt I would join in development, more on front end side, but at the moment seems this repo will mainly orient it self to be a doc reading tool, so idk. However, if this GPT could just be injesting files for knowledge, have access to internet to find out stuff, summarize. Sure id be up for it