How to Use Open Source LLMs in AutoGen Powered by vLLM

preview_player
Показать описание
In this video, I would like to talk about creating agents in AutoGen with Open Source LLMs.

USEFUL LINKS:

MY CONNECT:
  1. Yeyu Lab
  2. AutoGen
  3. Chatbot
  4. OpenAI
  5. GPT-4
  6. Python
Рекомендации по теме
Open Source Explained 0:06:11

Open Source Explained

Contributing to Open 0:03:18

Contributing to Open Source Can Change Your Life - Here’s How to Do It

How to Open 0:08:41

How to Open Source Like a Pro

Complete Guide to 0:41:53

Complete Guide to Open Source - How to Contribute

How To Get 0:13:03

How To Get Started With Open Source

What is Open 0:03:22

What is Open Source Software

How to contribute 0:11:49

How to contribute to open source projects (our community project walkthrough)

The Free and 0:28:31

The Free and Open Source Software I Use in 2024 - Part 1

FREE: Open Devin 0:14:32

FREE: Open Devin Coding AI GUI Tool🤖 Open-Source Devin Alternative! 👨‍💻 (Ollama Available)...

Llama 3.1 is 0:07:05

Llama 3.1 is ACTUALLY really good! (and open source)

Should You Use 0:06:40

Should You Use Open Source Large Language Models?

Don't Contribute to 0:09:55

Don't Contribute to Open Source

Why Are Open 0:13:06

Why Are Open Source Alternatives So Bad?

Contributing to Open 0:07:20

Contributing to Open Source will change your Life | How to Start? | Ali Solanki

How to Get 0:14:40

How to Get Started with Contributing to Open Source

What is Open 0:04:47

What is Open Source and How Does It Work?

Vibe is a 0:08:10

Vibe is a Free, Open Source, Offline Multi-Platform Transcription App!

Open Source Crash 0:33:25

Open Source Crash Course - Beginner Guide to Open Source

All about Open 0:19:57

All about Open Source Project | How is it beneficial for students | Stipends

The Rise Of 0:13:51

The Rise Of Open-Source Software

Tech Talk: From 0:06:12

Tech Talk: From Open Source Project to Product

How To Install 0:07:04

How To Install Fabric - Open-Source AI Framework That Can Automate Your Life

How to Understand 0:07:33

How to Understand Large Codebases in Open Source?

Beginner's Guide to 0:13:00

Beginner's Guide to Open Source Contribution 🖥️

Комментарии
Автор

This is spot on. Thank you for making the video and explaining so well.

JDWilsonJr
Автор

Great ! You are really good at what you do!

Beenee_AI
Автор

Terrific video! Thank you for sharing your knowledge.

jaoltr
Автор

Unreal video! Looking forward to testing various models instead of GPT!

joeclacher
Автор

I don’t believe you have it in your youtube tag’s but you should fill our your youtube tags with things like “ vLLM tutorial” as k looked for one and came up very very short, and this would’ve been much mote useful. Thanks for the vid!

Nick_With_A_Stick
Автор

Is it possible to use powerinfer instead of vllm? If possible which one would be faster ? Perhaps a good video to make by comparing those two inference tools

KodandocomFaria
Автор

Hey, thanks for the in depth explanation. While its great that we can use Autogen along with open source models using vLLM, is there any chance we could use Gemini API along with autogen?

shubhamgarg
Автор

thanks for sharing. Can vLLM be installed on Mac? Please help if it can as Max Studio has all the musles needed to do the heavylifting 🙂

current.undone
Автор

How to use autogen with aws bedrock models ?

truliapro