filmov
tv
Build Prompt Tuning & Prefix Tuning for LLMs: Soft Prompt Engineering Beats Fine Tuning
Показать описание
Learn to apply Prompt Tuning and Prefix Tuning, automate Prompt Engineering to improve LLMs.
I show you how Advanced Soft Prompt Engineering techniques, being Prompt Tuning and Prefix Tuning, automate Prompt Engineering and also are as good as or even better than fine tuning LLM ( large language models ).
This is the 2nd video in my LLM series. Watch this 9-minute video to Elevate your LLM models! I show you how to implement them with PyTorch so you can try them for your own LLM use case.
I'll also explain the LADDER of LLM models, from off-the-shelf options to completely pre-trained models, and the various interactions with LLMs, from hard prompt engineering to Retrieval-Augmented Generation ( RAG LLM ). By the end of this tutorial, you'll understand what Prompt Engineering is, why Prompt Tuning and Prefix Tuning are superior to hard prompts (Prompt Design) and Fine Tuning LLM, and how to implement these methods in your own data science projects.
︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾
︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽
⏰ Timecodes ⏰
0:00 Intro
0:27 LLMs Ladder - Model Source & Interaction
1:41 When to Use Fine Tuning or Prompt Engineering or RAG
2:23 Prompt Engineering - Hard Prompts (many shot prompting & meta prompting)
3:18 Prompt Drift
3:40 Prompt Tuning (Soft Prompting) and Comparison with Fine Tuning
4:33 Virtual Tokens
4:48 Pytorch Implementation of Prompt Tuning
5:47 FREE Data Science Guid with 100 Python Libraries
7:07 Prefix Tuning
7:47 Pytorch implementation of Prefix Tuning
8:43 DSPy, Langchain, Langgraph, Langsmith
#gpt #openai #ai #pytorch #prompting #huggingface #langchain #ollama #ai #llm #promptengineering #finetuning #rag
#largelanguagemodels #openai
I show you how Advanced Soft Prompt Engineering techniques, being Prompt Tuning and Prefix Tuning, automate Prompt Engineering and also are as good as or even better than fine tuning LLM ( large language models ).
This is the 2nd video in my LLM series. Watch this 9-minute video to Elevate your LLM models! I show you how to implement them with PyTorch so you can try them for your own LLM use case.
I'll also explain the LADDER of LLM models, from off-the-shelf options to completely pre-trained models, and the various interactions with LLMs, from hard prompt engineering to Retrieval-Augmented Generation ( RAG LLM ). By the end of this tutorial, you'll understand what Prompt Engineering is, why Prompt Tuning and Prefix Tuning are superior to hard prompts (Prompt Design) and Fine Tuning LLM, and how to implement these methods in your own data science projects.
︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾︾
︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽︽
⏰ Timecodes ⏰
0:00 Intro
0:27 LLMs Ladder - Model Source & Interaction
1:41 When to Use Fine Tuning or Prompt Engineering or RAG
2:23 Prompt Engineering - Hard Prompts (many shot prompting & meta prompting)
3:18 Prompt Drift
3:40 Prompt Tuning (Soft Prompting) and Comparison with Fine Tuning
4:33 Virtual Tokens
4:48 Pytorch Implementation of Prompt Tuning
5:47 FREE Data Science Guid with 100 Python Libraries
7:07 Prefix Tuning
7:47 Pytorch implementation of Prefix Tuning
8:43 DSPy, Langchain, Langgraph, Langsmith
#gpt #openai #ai #pytorch #prompting #huggingface #langchain #ollama #ai #llm #promptengineering #finetuning #rag
#largelanguagemodels #openai
0:09:19
Build Prompt Tuning & Prefix Tuning for LLMs: Soft Prompt Engineering Beats Fine Tuning
0:08:33
What is Prompt Tuning?
0:13:27
LLM2 Module 2 - Efficient Fine-Tuning | 2.3 PEFT and Soft Prompt
0:15:35
Fine-tuning LLMs with PEFT and LoRA
1:00:03
Prefix-Tuning: Optimizing Continuous Prompts for Generation
0:04:06
Prefix Tuning for Large Language Model (LLM) Explained
0:25:15
P-Tuning: A Parameter Efficient Tuning to Boost LLM Performance by Zenodia Charpy
0:07:56
Automatic Prompt Tuning for Large Language Models | RLPROMPT paper explained!
0:20:00
Research talk: Prompt tuning: What works and what's next
0:17:57
Towards Soft-Prompt Tuning with Large Language Models | Vector Applied Intern Talks
0:36:39
Fine-tune ChatGPT w/ in-context learning ICL - Chain of Thought, AMA, reasoning & acting: ReAct
0:05:40
Don’t skip Experimental items in Last Epoch. How to Craft Perfect Gear
0:01:46
How are training and tuning different?
0:23:13
Foundation Models Tutorial, and Why Not to Fine Tune Them
0:17:19
Prompt Engineering And LLM's With LangChain In One Shot-Generative AI
0:25:27
LLM Prompt FORMATS make or break your LLM and RAG
0:58:26
A Guide to Parameter-Efficient Fine-Tuning - Vlad Lialin | Munich NLP Hands-on 021
0:56:07
Generative AI Foundations on AWS | Part 3: Prompt engineering and fine-tuning
0:25:44
Fine-tune SDXL with Replicate
1:17:23
EfficientML.ai Lecture 20: Efficient Fine-tuning and Prompt Engineering (MIT 6.5940,Fall 2023,Zoom)
0:18:50
Is This the End of RAG? Anthropic's NEW Prompt Caching
0:00:53
Free Course: Training & Finetuning LLMs
0:45:56
LLM Crash Course Part 1 - Finetune Any LLM for your Custom Usecase End to End in under[1 hour]!!
0:05:50
Instruction Tuning (Natural Language Processing at UT Austin)
Комментарии