LlamaIndex Webinar: Retrieval-Augmented Fine-Tuning (RAFT)

preview_player
Показать описание
RAFT - Retrieval Augmented Fine Tuning 🔥

​Retrieval-Augmented Fine-Tuning (RAFT) is a new technique to fine-tune pre-trained LLMs for specific domain RAG settings.

​Conventional RAG is like an open-book exam, retrieving documents from an index to provide context for answering queries. This makes it more effective than the closed-book exam setting where LLMs rely solely on their pre-training and fine-tuning to respond to prompts, but doesn't allow the LLM to learn the domain beforehand.

​In this webinar we feature Tianjun Zhang and Shishir Patil, the two lead co-authors of RAFT. They present an overview of RAFT and also engage in a discussion on fine-tuning and RAG.

**Extra**

Timeline:
00:00-26:48 RAFT Presentation
26:48-28:50 Short LlamaIndex + RAFT Demo
28:50 Q&A
Рекомендации по теме
Комментарии
Автор

Thanks for sharing this. I love your framework, been using it since you gave the presentation on it at my company

CMAZZONI