Testing an LLM | LLM Evaluating LLMs

preview_player
Показать описание
Welcome to AI Testing Quest! 🚀

During the exploration of DeepEval and Evidently, it became obvious to me that it is common to use an LLM (usually the most recent OpenAI model) as a judge for test cases. But how trustworthy is our newly explored oracle? 🤖 💡👀

Can we measure that?

***SPOILER ALERT!***

Here is the resources links mentioned in the video:

📢 Stay Connected: We build a community! Connect with me on social media to stay updated on the learning process, and as we dig deeper together!

🔔 Don't Forget to Subscribe: Hit the bell icon to get notified whenever we go live or upload new content!

#aitestingquest #learning #testing #llm #ai #llmasajudge #oracle
  1. AI Testing Quest
Рекомендации по теме
What are Large 0:06:21

What are Large Language Model (LLM) Benchmarks?

Testing an LLM 0:23:13

Testing an LLM | LLM Evaluating LLMs

LLM Explained | 0:04:17

LLM Explained | What is LLM

How to evaluate 0:03:17

How to evaluate and choose a Large Language Model (LLM)

Meta drops new 0:32:28

Meta drops new LLM based testing

How to evaluate 0:50:42

How to evaluate an LLM-powered RAG application automatically.

Evaluating LLMs using 0:11:25

Evaluating LLMs using Langchain

Evaluating the Output 0:01:42

Evaluating the Output of Your LLM (Large Language Models): Insights from Microsoft & LangChain

LLM Response Time 0:00:37

LLM Response Time Nvidia RTX 3090 vs 4090 GPU

A Survey of 0:45:32

A Survey of Techniques for Maximizing LLM Performance

Testing AI Models 0:11:00

Testing AI Models with Bench LLM - See Which One's Best!

Evaluating LLM-based Applications 0:33:50

Evaluating LLM-based Applications

How to test 0:06:15

How to test language models with LLM Bench

LLM Attention That 0:14:25

LLM Attention That Expands At Inference? Test Time Training Explained

LocalAI LLM Testing: 0:21:40

LocalAI LLM Testing: How many 16GB 4060TI's does it take to run Llama 3 70B Q4

Test #LLM app, 0:41:16

Test #LLM app, RAG app using #promptfoo | Speed up testing & evaluation.

Testing Framework Giskard 0:40:35

Testing Framework Giskard for LLM and RAG Evaluation (Bias, Hallucination, and More)

Breaking Down & 0:36:39

Breaking Down & Testing FIVE LLM Agent Architectures - (Reflexion, LATs, P&E, ReWOO, LLMComp...

How to Choose 0:21:48

How to Choose an LLM

Unit Testing LLM-Based 0:26:12

Unit Testing LLM-Based Features for Full-Stack Engineers

LIVE Recording | 1:39:47

LIVE Recording | Testing an LLM | How are we supposed to even start this?!

LIVE Recording | 1:35:51

LIVE Recording | Testing an LLM | Exploring Tools for Testing LLMs | Part 3 - Evidently AI

LocalAI LLM Single 0:20:31

LocalAI LLM Single vs Multi GPU Testing scaling to 6x 4060TI 16GB GPUS

Landmark paper from 0:07:20

Landmark paper from GoogleDeepMind - Scaling LLM Test-Time Compute Optimally can be More Effective&a...