filmov
tv
LlamaIndex Webinar: Retrieval-Augmented Fine-Tuning (RAFT)
Показать описание
RAFT - Retrieval Augmented Fine Tuning 🔥
Retrieval-Augmented Fine-Tuning (RAFT) is a new technique to fine-tune pre-trained LLMs for specific domain RAG settings.
Conventional RAG is like an open-book exam, retrieving documents from an index to provide context for answering queries. This makes it more effective than the closed-book exam setting where LLMs rely solely on their pre-training and fine-tuning to respond to prompts, but doesn't allow the LLM to learn the domain beforehand.
In this webinar we feature Tianjun Zhang and Shishir Patil, the two lead co-authors of RAFT. They present an overview of RAFT and also engage in a discussion on fine-tuning and RAG.
**Extra**
Timeline:
00:00-26:48 RAFT Presentation
26:48-28:50 Short LlamaIndex + RAFT Demo
28:50 Q&A
Retrieval-Augmented Fine-Tuning (RAFT) is a new technique to fine-tune pre-trained LLMs for specific domain RAG settings.
Conventional RAG is like an open-book exam, retrieving documents from an index to provide context for answering queries. This makes it more effective than the closed-book exam setting where LLMs rely solely on their pre-training and fine-tuning to respond to prompts, but doesn't allow the LLM to learn the domain beforehand.
In this webinar we feature Tianjun Zhang and Shishir Patil, the two lead co-authors of RAFT. They present an overview of RAFT and also engage in a discussion on fine-tuning and RAG.
**Extra**
Timeline:
00:00-26:48 RAFT Presentation
26:48-28:50 Short LlamaIndex + RAFT Demo
28:50 Q&A
Комментарии