Llama 3 RAG: Create Chat with PDF App using PhiData, Here is how..

Показать описание

🚀 In this tutorial, we dive into the exciting world of building a Retrieval Augmented Generation (RAG) application that handles PDFs efficiently using Llama 3 powered by the Groq API with PhiData as the main Python package. Whether you're looking to create an app with Groq or prefer keeping your data 100% local with Ollama, this video covers it all!

👨‍💻 What We Cover:
Setting Up Your Environment: We start by setting up the necessary development environment.
Installing Packages: Next, we handle all the package installations required for our application.
Creating a Database: Follow along as we create a database using Docker for storing our data.
Running the Application: Finally, see how to run the application where you can upload PDFs, ask questions based on the uploaded content, and receive precise answers.

🔗 Resources:

📌 Stay tuned as I walk you through each step, from cloning the repository to launching the app, ensuring you know exactly how to replicate this setup on your own!

👍 Don't forget to LIKE, SHARE, and SUBSCRIBE for more tutorials on Artificial Intelligence and data management. Your support helps us create content that helps others!

Timestamps:
0:00 - Introduction to the Tutorial
0:02 - Creating the RAG Application Overview
1:01 - App Demonstration and Features
1:35 - Environment Setup and Package Installation
2:48 - Database Creation with Docker
3:36 - Running the Application
4:06 - Uploading PDFs and Query Interaction
5:41 - Alternative Local Setup with Ollama
6:20 - Running the Local Application and Uploading Files
7:01 - Live Question and Answer Test

#PhiData #PhiDataOpenSourceLLM #PhiDataOpenSource #PhiDataFunctionCalling #PhiDataOlama #AssistantsAPIFunction #CreateAIAssistants #AIAssistant #FunctionCalling #Function #PhiData #PipInstallPyData #PhiDataRAG #PhiDataRAGPDF #PhiDataRAGGroq #PhiDataRAGOlama #PhiDataGroq #PhiDataRAGApplication #PhiDataRAGApp #OlamaRAG #GroqRAG #OlamaPDFRAG #GroqPDFRAG #PDFRAG #RAGPDF

Рекомендации по теме

Комментарии

@Mervin Praison you are awesome. Can watch your videos all day!

phidata

Macha. Nee kalakura. Your content is so valuable. Keep them coming. Bless you!

cecilvictor

Your slides are clear and perfect to explain all thing for me. And it can be seen as a tool that it needs a PDF as input and then the user will get a answer related to it via giving a question to llama3. It looks like an interaction between chatgpt3.5/4.0, but it is in local. That's pretty good. If you can do a chatbot whose character can be customized, it can be better.

xuanzida

I always watch and love each and every single video. One video I'd like to request and I agree many would agree is how can we do multimodal RAG with PDFs that have images and tables and text. I've tried watching other videos and it's quite confusing + doesnt seem quite good or production level where we can tune it to our own needs or sometimes they do it separately by just providing image and asking the LLM to describe it. Please do a video about it

yazanrisheh

This is just phantastic ... I mean the tool, and your video as always top notch

svenandreas

Thank you for the video Mervin. But it is not newbie friendly. I am not interested in groq so skipped to the ollama chapter but I had to watch groq parts for python and docker installation etc. Would've been better if you split them in their own video.

trilogen

This is awesome. I'm trying to understand the fundamentals a bit better. Where are the pdf documents stored locally?

aisdhgaoiqea

amazing demonstration, thanks for sharing your expertize. Hope you could talk more about PKM.

WalidDingsdale

Hi Mervin i come across this channel. Very clear, concise and to the point. Can you mention minimum required hardware specification in each video?

renhit

Another great one @Mervin, thank you. Feasibly, how many pages of PDFs could we feed to PhiData with this method and get nuanced responses to questions? Could that include spreadsheets & financial analysis?

sustainitech

Hi, Mervin. Thank you for your excellent presentation and tutorial. Could you please perform the procedures in Docker Compose?

zamanganji

Your videos are excellent!! But i wanna do with Excel sheets instead of PDFs . Is thag possible?

TheClassicguy-yjth

How can I implement this project using OpenAI models ? Can anyone guide me with this?

SohanVenkatesh

hello, can you show a video where we can upload all the documents, then we can chat with it without needing to keep uploading / storing it to the database? meaning to chat with the vectorised db

williamwong

Thank you bro for this content!!!
This chatbot takes some time to process the pdf, So is there any way to increase the speed of it also takes time to give the answer.
Could you please suggest any way to solve this??

SumaTreesaThomas

2:37 direct set the GROQ_API_KEY in environment variable instead of 'export'

eunicefoo

Is there any way we can stop the default creation of the new run_ids ?

gowithgaurav

Hi Mervin, Can Groq API be used to create a RAG Chatbot with Private and Confidential data?

sahaj

Can you explain this, I tried uploading a pdf. The knowledge base only contain two pages.

Terminal output:
"INFO Committed 4 documents
INFO Loaded 364 documents to knowledge base"

Groq:
"The confusion arises from the difference between the number of documents committed (4) and the number of documents loaded into the knowledge base (364). The knowledge base, however, only contains information about 2 specific documents, which are excerpts from the book "Friction, Wear, Lubrication: A Textbook in Tribology" by Ludema and Ajayi.

It appears that the loading process involved 364 documents, but only a subset of those documents (4) were committed, and even fewer (2) are represented in the knowledge base. The discrepancy suggests that there might be additional information or documents that are not currently reflected in the knowledge base."

AntonBj

@Mervin thank you for your video. It works great. I have a question, some of the PDFs I am testing this with fail. Any suggestion of where I need to look for this?

JorgeGil-qfzy

Llama 3 RAG: Create Chat with PDF App using PhiData, Here is how..

Llama 3 RAG: Create Chat with PDF App using PhiData, Here is how..

I Built a LLama-3 RAG PDF Chatbot

Llama 3 RAG: How to Create AI App using Ollama?

Advanced RAG with Llama 3 in Langchain | Chat with PDF using Free Embeddings, Reranker & LlamaPa...

How I built a Multiple CSV Chat App using LLAMA 3+OLLAMA+PANDASAI|FULLY LOCAL RAG #ai #llm

'I want Llama3 to perform 10x with my private knowledge' - Local Agentic RAG w/ llama3

How to Build a Free ChatBot Using LLAMA-3 || Langchain || Python

Build a Talking Fully Local RAG with Llama 3, Ollama, LangChain, ChromaDB & ElevenLabs: Nvidia S...

RAG with Ollama and Bespoke-MiniCheck 7B Locally

Llama 3 Local RAG On Custom Documents Tutorial

How to do Local RAG with Ollama and Llama 3 in Chatbot

Local RAG with Llama 3.1 for PDFs | Private Chat with Your Documents using LangChain & Streamlit

Fine-Tuning Llama 3 on a Custom Dataset: Training LLM for a RAG Q&A Use Case on a Single GPU

Fully local RAG agents with Llama 3.1

How-To Run Llama 3 LOCALLY with RAG!!! (GPT4ALL Tutorial)

How to create a RAG tool with Llama 3, Langchain and Ollama

Reliable, fully local RAG agents with LLaMA3

Python RAG Tutorial (with Local LLMs): AI For Your PDFs

Chat with Document - Streamlit Chatbot with LLAMA 3.1. using Groq | RAG | Langchain | Generative AI

Llama 3 8B: BIG Step for Local AI Agents! - Full Tutorial (Build Your Own Tools)

'okay, but I want Llama 3 for my specific use case' - Here's how

Talk to Your Documents, Powered by Llama-Index

Build a Llama-3 based RAG pipeline to chat with your local files without single line of Python code

End-to-End RAG With Llama 3.1, Langchain, FAISS and OLlama #ai #llm #llama #huggingface