Mixture of Agents (MoA) BEATS GPT4o With Open-Source (Fully Tested)

Full test of Mixture of Experts implementation.

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? 📈

My Links 🔗

Media/Sponsorship Inquiries ✅

Links:

[matthew_berman]

Should MoA be the default for Open Source now?

[joe_limon]

I can't wait for MOA to be smart enough to pull specific models based on what they are good at rather then prompting every single model. This would bring wayy more value toward training narrower specialized models that outperform at specific tasks.

[klaushermann]

Every enterprise now knows anyone is going to ask for the snake game. That is already something so slick that it's not even worth asking anymore.

[seanmcgu]

Yes, would love to see MoA working together for coding! Thanks for your consideration.

[njorgard]

When are you testing Claude Sonnet 3.5?

[dbishnoi]

You delivered Matt. And quickly too. Thank you. This is amazing.

[asastudios]

GPT-4o nails the apple test

1. Dude the metaphysical implications of quantum entanglement challenge our understanding of causality dude.
2. Dude the dialectical synthesis of thesis and antithesis reveals the evolution of human thought dude.
3. Dude the existential dilemma of free will versus determinism remains an enigma dude.
4. Dude the ontological argument for the existence of a higher power transcends empirical evidence dude.
5. Dude the phenomenology of consciousness illuminates the subjective nature of reality dude.
6. Dude the epistemological pursuit of knowledge questions the limits of human understanding dude.
7. Dude the ethical relativism in cultural contexts underscores the complexity of moral philosophy dude.
8. Dude the teleological perspective on the universe suggests an inherent purpose to existence dude.
9. Dude the interplay between chaos and order is fundamental to the fabric of the cosmos dude.
10. Dude the hermeneutics of interpreting ancient texts unveils the timelessness of human wisdom dude.

[bosthebozo]

Can't wait for the Sonnet video Matt! So far, I've created about 6 basic games like a simple RTS, strategy card game, jpg puzzle generator, asteroids, endless racer and of course snake... often in one shot. This model is insane in terms of progress.

With crewaI you can build similar setup and also give it instructions to test code of each iteration.

[tvwithtiffani]

The Killers and Marble answers seem so good that it seem the models might be training on you test questions now.

[Quinceybibbs]

Thank you for this😊 can you please create a follow-up video using code models

[mediacenter]

Claude 3, 5

Let's think through this step-by-step:

The person takes a marble.
They put the marble inside a cup.
They put the cup upside down on the table.
They take the cup and put it in the microwave.
The key point here is step 3: when the cup was turned upside down on the table, the marble would have fallen out onto the table.

Therefore, the marble is still on the table where the cup was initially placed upside down.

The cup is now in the microwave, but it's empty - the marble is not in the cup anymore.

[TheAlastairBrown]

I'd love to see a collab between Claud 3.5 and GTP4o, especially with multiple agents that are set to different temperatures, with the final agent being set to low creativity making the final decision. The mixing of temperatures is extremely important, you want the models to be as creative as possible so they come up with amazing solutions, but you also need strict rational enforcers to keep the crazy in check.

[KC_]

The combination of 4 models is 452B, and I can't even run a 72B model. I guess I will continue to use large models from big companies.

[Timotheeee]

11:40 it just wrote random sentences and added ", apple" at the end of them

[MonkeyBars]

Finally the ball didn't end up in the microwave!! 🎉

[shubharthaksangharsha]

why are you not doing video of Sonnet 3.5 bro?

[qbjnzhi]

In a standard situation, where the temperature is set from 0 to 1, setting the temperature to 0.7 means getting a fierce delirium generator out of anything. If the temperature in this “mixture” is determined differently, it is worth talking about this in detail.

[BarryMcBangerz]

Great vid, would definitely love to see more MoA videos trying out different models and tasks

[jonmichaelgalindo]

It just randomly added the word "apple" to the end of the sentences. :-P Well-played, AI.