Llama2 Chat with Multiple Documents Using LangChain

🦙Llama2 With 🦜️🔗 LangChain | Chat with Multiple Documents Using LangChain

In this video, I will show you, how you can chat with any document.  Let's say you have a folder and inside the folder, you have different file formats. Let's say you have PDF file. You have text file. You have read me file and others.  I will show you how you can take all of your data, split the data into different chunks, do the embeddings using the sentence transformers via Huggingface embeddings, store that into the Chroma vectorstore. Finally, you can just chat with your own documents and get insights out of it, similar to ChatGPT for with your own data.

What I noticed from the experiment is that Llama2 model is not that good compared to OpenAI model for QA Retrieval part. It might depend upon your machine / hardware. All the mentioned links are either in this description or in the readme file of the github repository.

Happy Learning 😎

👉🏼 Links:

------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------------
🔗 🎥 Other videos you might find helpful:

------------------------------------------------------------------------------------------
🤝 Connect with me:

#llama2 #llama #chainlit #langchain #llm #chatwithpdf #chromadb #datasciencebasics

[akentertainments]

it is working for image based pdfs but it is not working for text based pdfs why ??

[ai_enthusiastic_]

Amazing 🎉, I want to load the model that I downloaded and integrate that in flask api . When I ask questions it should respond.. pls give a way for it . Pls reply sir

[vishnusureshperumbavoor]

Is it possible to do this without downloading the 6 GB file

[sciencemail]

sir you dont explain clearly for beginners . it feels like you are in rush

[DemoGPT]

Your video is amazing, and I'm grateful for your effort. Are you thinking of making a video about DemoGPT?

[programmingprojects]

It is throwing an error :- No directory found at ./db

[queenartstudio]

I trying to use llama-2-13b-chat.ggmlv3.q8_0 model, but downloading it locally using wget give me an error: Stream too long.
So I downloaded the above model manually and copy-pasted the file in model folder. But getting this error: Failed to load model: No model file found at

Then tried the same process with "llama-2-7b-chat.ggmlv3.q8_0" but the chatbot shows exact same error as above (even changed the model in script)

[Hizar_]

is it possible to deploy it on some cloud platform??

[shashankpandey]

can i make the same if i download the model and use it ?

[SantK]

Sir, could you please use ollama to query PDF documents.
Please create video on it. Thanks

[kingfunny]

can you make video how can convert this modal to exe

[sampeter]

Help please i get : {"detail":"Not Found"}

[ROKKor-hstg]

The page opens in the browser, but the form does not load

[Rohithb]

I am getting errors on langchain and getting error as "AttributeError: 'Message' object has no attribute 'replace'" Can you please help me

[zijingtian]

Hi Sudarshan, as llama2 released, is there any way to apply llama2 chat 70-B on this application?

[ngyx]

It seems like the result of llm got a lot of redundant sentence, is there anyway to improve the result? Or llama2 7b conversation is consider buggy?

[anuragbhandari]

i noticed that you didnt download any embeddings model for this, does the llama2 model is the only one we need to download?

[c__spoorthi]

will it run properly for my laptop which is on;y 8gb ram

[TheManuforest]

Great video. I missed that part regarding RetrivalQA models, I guess... Which model should I use ? Thanks ! :)

[AritrAMukherjEEBIQ]

Very nice video. I am also building a LLM with a goal to build chatbot well versed in credit card information but LLama V2 7B is not giving me desired result. Unfortunately openai api charges a lot, so do you have any idea whether is there a better model?