Langchain: Auto evaluate llms and Agents. OpenAI Gpt 3 evaluation using Langchain and custom prompts

preview_player
Показать описание
Learn how to evaluate performance of llms such as OpenAI gpt-3 using langchain evaluation using custom prompts and datasets from huggingface.

Timeline:
00:00 intro and demo
03:11 Creating environment and pip installs
04:51 Code review for llm QA
08:30 Custom prompt for llm eval
10:07 Code review for Agent with tool eval
15:39 Final Code review

#langchain #langchaintutorial #gpt3 #gpt #gpt3tutorial #openai
  1. echohive
  2. langchain
  3. gpt 3
Рекомендации по теме
Langchain: Auto evaluate 0:16:07

Langchain: Auto evaluate llms and Agents. OpenAI Gpt 3 evaluation using Langchain and custom prompts

Langchain: QA Evaluation 0:08:34

Langchain: QA Evaluation

Evaluating LLMs using 0:11:25

Evaluating LLMs using Langchain

Evaluating the Output 0:01:42

Evaluating the Output of Your LLM (Large Language Models): Insights from Microsoft & LangChain

LangSmith Tutorial - 0:36:10

LangSmith Tutorial - LLM Evaluation for Beginners

LangChain 'RAG Evaluation' 0:56:21

LangChain 'RAG Evaluation' Webinar

LLM Evaluation Basics: 0:05:18

LLM Evaluation Basics: Datasets & Metrics

What is LangChain? 0:08:08

What is LangChain?

How to evaluate 0:50:42

How to evaluate an LLM-powered RAG application automatically.

Langchain & LLMs 0:20:36

Langchain & LLMs for automating software testing

LangChain Explained in 0:12:44

LangChain Explained in 13 Minutes | QuickStart Tutorial for Beginners

Prompt Engineering And 0:17:19

Prompt Engineering And LLM's With LangChain In One Shot-Generative AI

Evaluate LLMs - 0:08:45

Evaluate LLMs - RAG

Benchmarking LLM performance 0:08:25

Benchmarking LLM performance with LangChain Auto-Evaluator // Lance Martin //LLMs in Prod Con Part 2

Thinking Agents In 0:45:26

Thinking Agents In Langchain Using LLMs for Intelligent Decision Making New Era of AI and Automation

Evaluate Agents & 0:20:04

Evaluate Agents & Chains with Langchain Tracing:Comprehensive Guide on Tracing server in Langcha...

How Large Language 0:05:34

How Large Language Models Work

LLM Explained | 0:04:17

LLM Explained | What is LLM

Different Text Summarization 0:33:30

Different Text Summarization Techniques Using Langchain #generativeai

LangGraph: Multi-Agent Workflows 0:24:02

LangGraph: Multi-Agent Workflows

Master LLMs: Top 0:08:42

Master LLMs: Top Strategies to Evaluate LLM Performance

LangSmith Highlights: Evaluation 0:10:22

LangSmith Highlights: Evaluation

LLM Module 4: 0:09:16

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.11 Guest Lecture Harrison Chase, LangChain Creator

Evaluating LLM-based Applications 0:33:50

Evaluating LLM-based Applications

Комментарии
Автор

I hope you will find this video helpful. Please let me know if you have any questions :)

echohive
Автор

Echohive - You are doing a very good Job. Keep up.

ArijitBandyopadhyayCA
Автор

I am trying to find where OpenAI is hiding its training videos/content for running the langchain eval tools. :) Otherwise, great job on this video. I subscribed. Thank you!

investigativeinterviewing
Автор

i want to try out this but couldn’t find the code properly, so i hope you could provide me your code, m a student and trying to research on it and it would help me for the llm evaluation which i am studying ." could you provide for free.

sushmapokharel