filmov
tv
Mitigating LLM Hallucinations with a Metrics-First Evaluation Framework
Показать описание
Join in on this workshop where we will showcase some powerful metrics to evaluate the quality of the inputs and outputs with a focus on both RAG and fine-tuning use cases. In the context of LLMs, “hallucination” refers to a phenomenon where the model generates text that is incorrect, nonsensical, or not real. Since LLMs are not databases or search engines, they would not cite where their response is based on. These models generate text as an extrapolation from the prompt you provided.
What attendees can expect to takeaway from the workshop:
-Deep dive into research-backed metrics to evaluate the quality of the inputs (data quality, RAG context quality, etc) and outputs (hallucinations) while building LLM powered applications.
-Evaluation and experimentation framework while prompt engineering with RAG, as well as while fine-tuning with your own data
-Demo led practical guide to building guardrails and mitigating hallucinations while building LLM powered applications
To access the slides, please click here:
To read the academic paper, please click here:
This event is inspired by DeepLearning.AI’s GenAI short courses, created in collaboration with AI companies across the globe. Our courses help you learn new skills, tools, and concepts efficiently within 1 hour.
About Galileo
At Galileo we are building the first algorithm-powered LLMOps Platform for the enterprise. Galileo provides ML teams with an intelligent ML data bench to collaboratively improve data quality across their model workflows – from pre-training, to post-production. Galileo is currently powering ML teams across the Fortune 500 as well as startups across multiple industries.
Speakers:
Vikram Chatterji, Co-founder and CEO at Galileo
Atindriyo Sanyal, Co-founder and CTO at Galileo
What attendees can expect to takeaway from the workshop:
-Deep dive into research-backed metrics to evaluate the quality of the inputs (data quality, RAG context quality, etc) and outputs (hallucinations) while building LLM powered applications.
-Evaluation and experimentation framework while prompt engineering with RAG, as well as while fine-tuning with your own data
-Demo led practical guide to building guardrails and mitigating hallucinations while building LLM powered applications
To access the slides, please click here:
To read the academic paper, please click here:
This event is inspired by DeepLearning.AI’s GenAI short courses, created in collaboration with AI companies across the globe. Our courses help you learn new skills, tools, and concepts efficiently within 1 hour.
About Galileo
At Galileo we are building the first algorithm-powered LLMOps Platform for the enterprise. Galileo provides ML teams with an intelligent ML data bench to collaboratively improve data quality across their model workflows – from pre-training, to post-production. Galileo is currently powering ML teams across the Fortune 500 as well as startups across multiple industries.
Speakers:
Vikram Chatterji, Co-founder and CEO at Galileo
Atindriyo Sanyal, Co-founder and CTO at Galileo
0:42:20
Mitigating LLM Hallucination Risk Through Research Backed Metrics
1:00:40
Mitigating LLM Hallucinations with a Metrics-First Evaluation Framework
0:09:38
Why Large Language Models Hallucinate
0:03:07
Mitigating LLM hallucinations paper breakdown
0:04:33
6 Powerful Techniques to Reduce LLM Hallucination with Examples | 5 Mins
0:09:26
My 7 Tricks to Reduce Hallucinations with ChatGPT (works with all LLMs) !
0:19:43
Mitigating LLM Hallucinations via Conformal Abstention
0:08:51
LLM Limitations and Hallucinations
1:02:56
LLM Hallucinations in RAG QA - Thomas Stadelmann, deepset.ai
0:00:31
Mitigating Large Language Model (LLM) Hallucinations
0:00:59
Three Strategies to Mitigate LLM Hallucinations
0:36:41
Hallucination-Free LLMs: Strategies for Monitoring and Mitigation
0:24:10
How to Mitigate Gen AI Hallucinations, Bias & Intellectual Property Risk in LLMs - Aug. 2023
0:00:16
Hallucination in Large Language Models (LLMs)
0:02:24
Mitigating hallucinations in LLM | Machine learning | Artificial intelligence | Nicholas Renotte
0:38:37
Hallucination-Free LLMs: Strategies for Monitoring and Mitigation - Wojtek Kuberski, NannyML
0:07:23
Ep 6. Conquer LLM Hallucinations with an Evaluation Framework
0:05:48
How to Use RAG for Pen Testing: Mitigating LLM Hallucinations in Cybersecurity
0:01:23
LLM Hallucinations
0:03:23
LLM hallucinations explained | Marc Andreessen and Lex Fridman
![[QA] Mitigating LLM](https://i.ytimg.com/vi/ufRGIrNhvcI/hqdefault.jpg)
0:09:02
[QA] Mitigating LLM Hallucinations via Conformal Abstention
0:00:49
🤯 Reduce Hallucination in LLMs with this Method
0:08:26
Risks of Large Language Models (LLM)
0:01:25
Grounding AI Explained: How to stop AI hallucinations
Комментарии