Meta's Llama 3.1, Mistral Large 2 and big interest in small models

preview_player
Показать описание

Meta strikes back with the launch of Llama 3.1! In Episode 13 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Shobhit Varshney, and Maryam Ashoori. Today, the experts analyze the business of AI in relation to the launch of Llama 3.1, including Llama 405B. Then, Mistral Large 2 sparks conversation about the open source wave. Finally, the experts talk GPT 4o-mini and the model price war. Are little models having their moment? Tune-in to find out.

0:00 — Intro
1:33 — Llama 3.1 and Mistral Large 2
10:08 — Are Little Models Having a Moment?

The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Рекомендации по теме
Комментарии
Автор

For now Mistral is quite constrained with it's features. They do not offer Voice-To-Text, Text-To-Speech, Vision and Image Generation as OpenAI does. So for now, OpenAI rules for me in case of AI, but I still follow, wheather some new AI-model will be compareable and cheaper, I would go for it. Additionally, Llama 3.1 is now accessible only in the US, or at least is not available in Europe.

Luftjunkie
Автор

Am I wrong in saying that Mistral (go France🇫🇷) will benefit from the infamous EU restrictions and regulations on other models ?

florentromanet
Автор

I know this when you were doing the price comparison for summarizing transcriptions you didn't mention how much it would cost to do it using Watson x. What's up with that? 😁

jjjccc
Автор

The larger the model, the more subtle the hallucination.

norlesh
Автор

Do we have to much intelligence now?
Just look around.
No, we don't have too much. We need more. Lots more.
Both artificial and natural.
And considering how many mistakes still make the big models, we definitely need them to improve, even if we don't use all their power all the time.

ronilevarez
Автор

11 billion for 4o mini beating llama 3.1 405b?

shApYT