How This Vision-Based RAG System Could Save You Hours of Work!

preview_player
Показать описание
Learn how to deploy LLMs via On-Demand GPUs as well as Serverless API Endpoints on Runpod with vLLM.

LINKS:

💻 RAG Beyond Basics Course:

Let's Connect:

Signup for Newsletter, localgpt:

All Interesting Videos:

Рекомендации по теме
Комментарии
Автор

Colpali is an excellent technique for English documents.
When you try to use non-English documents, the retrieval doesn't work well because colapli uses the paligemma model which is a relatively small model trained mostly on an English data set

israelazarkovitch
Автор

Excellent. Exactly what I was looking for. A "fine-tuning" episode of such a VBRAG pipeline would be a great followup episode.

saranepalashok
Автор

Can you make an end to end project where instead of an index we throw the embedding to a vectorstore like chromadb or pinecone or something would be amazing

frag_it
Автор

may be if you pass an Image URL instead of the Image bytes you will consume less input tokens so less Cost?

tecnom
Автор

many thanks for this great video…I have a set of scanned pages saved as pdf. will this work?..thanks..

absar
Автор

I wonder if a VBRAG could perform math calculations extracted from an image table? 🤔 I suppose if the results are accurate they could then be passed to another agent capable of calculations on the result?

RedCloudServices
Автор

This does not run on local Nivida RTX 4x 16 RAM GPU ?

ukls
Автор

But this works only for pdf, what about docx, pptx, epub files? I want to work multimodal on those files too.

neatpaul
Автор

Man I love your videos and I'm a big fan. I just have one request and I wonder if everyone else agrees. I get very annoyed and distracted each time your video recording software zooms in and out of the the page or screen that you are showing. The problem is it's inconsistent and keeps jumping around. Please, please consider making it static, unless you are zooming in for a longer period of time, like writing a code in VS. Thank you and keep the amazing work.

skyplanet
Автор

White Deborah Jackson Anthony Johnson James

KrystalPinson-lk