Ollama Llama 3 - RAG: How to create a local RAG system with LLAMA 3 using OLLAMA

This video is about building a local RAG system with LLAMA 3 using OLLAMA.

Join this channel to get access to perks:

[kumarrao-gk]

Hi Siddhardhan, thank you, this is very useful. One has to do a lot of troubleshooting though. maybe you can update this to latest version. For example - UnstructuredFileLoader is no longer available and instead UnstructuredLoader is used. Also please include content on how to troubleshoot for libmagic, text splitter, any modules not found kind of errors. Will be very helpful.

[Donttouchthesnow]

The amount of troubleshooting ive had to do just to import the dependencies is insane, please fix this or update it in the description

[PAVANSIDEAS]

hi sir please complete the ml remaining modules we are waiting for your videos. We have completed watching all the modules and your way of plan to explain ml is quite different from others. So i prefer only your videos sir Please start making the ml modules

[javiecija]

I've trying to make a llama agent with tools. More precisely a custom version of the tavily search tool modifying the _run method to access all the API parameters. Can you do a video on that?

[revanthbhuvanagiri]

@Siddhardhan Hi Sid, I'm fan of your work, Could please create a video how to deploy the RAG System, It would be really great if you teach us this aspect. Once again your videos are informative, Thank you!

[amventures]

Can I load the model from locally or hugging face using Ollama? And complete the rest of what you done.
This is very important to my project.
Please answer me.

And thanks for help

[amventures]

Please also make a video about function calling using the same Ollama and model

[Ahmedsaber-vx]

HI sir, what should i do to insert more than 1 pdf?
thanks.

[mlTS]

Thanks for the tutorial
Even for a single page pdf, with chunk size 1000 and overlap 200
It is taking me more than a minute 1.25 minute to answer a single query, is this normal?
((sys config: Ryzen5 5600H 16gb RAM no GPU))

[KumR]

Thanks Sid.. Can you please help in expanding this with a streamlit UI and also include an listening and speaking ability?

[angela-tsai-cjt]

ValidationError Traceback (most recent call last)
Cell In[24], line 1
----> 1 llm = Ollama(
2 model = "llama3:latest",
3 temperatue=0
4 )

File ~/Applications/anaconda3/lib/python3.11/site-packages/pydantic/main.py:341, in

ValidationError: 1 validation error for Ollama
temperatue
extra fields not permitted (type=value_error.extra)

Hello, do you know how to fix this error?

[Arunak]

question = "What is the document about?"
response = qa_chain.invoke({"query": question})
print(response["result"])

ConnectionError: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/generate (Caused by object at 0x7e4eb85c6f80>: Failed to establish a new connection: [Errno 111] Connection refused'))

how to fix this error sir

[DBS-op]

hi mr sidharthan. i do appreciate your help to implement this via your video. But i have a small probelm. At the seventh (7th) cell of the jupyter notebook an error was raised as
" Could not import faiss python package. Please install it with `pip install faiss-gpu` (for CUDA supported GPU) or `pip install faiss-cpu` (depending on Python version)."
and i tried installing faiss gpu via pip but it said
"ERROR: Could not find a version that satisfies the requirement faiss-gpu (from versions: none)
ERROR: No matching distribution found for faiss-gpu"
by the way i have a rtx 3060 trying to take advantage of my if you dont mind can you help me. im just a fresher by the way so pls dont mind my scarce knowledge.