Google Releases AI AGENT BUILDER! 🤖 Worth The Wait?

Google announced Google Agent Builder through its Vertex AI product. Let's examine it and other announcements from Google Cloud Next.

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? ✅

My Links 🔗

Media/Sponsorship Inquiries 📈

Links:

[show-me-the-data]

Hey Matt.

When you select "function", you're responsible for writing the code and driving the conversation via API calls. The flow goes a little like this. You submit a message and you check the status and it tells you you need to run the function with these inputs. YOU then submit the output back to vertex via the API, where it uses the function output to generate the next message. You can implement the function wherever you're DRIVING the convo. Makes sense?

This is a very similar flow to the assistants API which I have a video about on my channel if you're interested

[DailyTuna]

Matt on it! Thanks for going over this. Nobody else is really going into it like you.!👍👏

[aiamfree]

@19:25 you set your Tool Type to OpenAPI, and the endpoints in the instructions will work. I imagine it's 1 function per tool for modularity. It's more or less exactly the same setup as the Custom GPTs configuration.

[xerxel]

Some of Matt’s videos were a bit lightweight in the past, but he really nailed this one. 👍 good analysis, brought in external knowledge and not just AI fanboy content. Nice job. Will be subscribing to this channel now!

[rkRaP]

Hey Matt, with all of these models and apps along with their updates, it would be nice to see a real time list of your favorites. For example you said Gemma wasn't to impressive but it may be now with its new update. Maybe like a place where you can rank the best models or frameworks and update the source as things change. For example crew Ai, autogen, Gemma, , Devin, Devin alternatives, and all the different llms. It be nice to see an up to date list of your rankings in each category. Or does something like this already exist?

[Maisonier]

I've been eagerly awaiting a local AI solution to sort through our family's extensive collection of decades-old photos. This AI should be capable of identifying and eliminating duplicate or blurry images, learning to recognize faces, and categorizing photos by individual. Moreover, it should have the ability to estimate the age range of each person depicted. Ideally, this solution would allow for easy exportation of organized data so that Stable Diffusion models could learn from it. Additionally, integrating facial recognition capabilities into home security cameras would streamline access control, eliminating the need for physical keys.

[dafunkyzee]

i heard the keynote before, and I really appreciate your insights and commentary to make it more "real." There is often a strong corporate biase when we hear these kinds of releases. Great video very informative. Love your stuff

[DailyTuna]

You’re so right Matt on that agents in the Mercedes. There’s this weird movement of bells and whistles, and what we can do rather than true functionality that is efficient. Especially when it’s not level five self driving, we still have to drive and less distraction equals more attention to the road and thus is safer driver.

[MrStevemur]

I think you're spot on about Google "playing it safe." They've got this super-global brand; as soon as they make an agent that says or does something questionable, it's huge news. Microsoft figured out how to solve this problem decades ago: let small companies do innovative things, then buy the successful ones.

[GarrettGalloway]

I'll be ready for Google to put that kind of tech to use on youtube. No more trap videos where the title, description, and thumbnail don't match the content. Youtube could auto-down-vote videos that don't match their title, description, and thumbnail. I can imagine that Google will be the king of multi-modality due to YouTube.

[Sandheip]

Exciting release from Google! Can't wait to see what the AI Agent Builder can do. #GoogleAI #AIAgentBuilder #Innovation

[EccleezyAvicii]

Agent > Example > create example

The example is a dummy dialogue.
You need to actually mockup a weather convo. Each prompt/return is an ‘action’ in the example convo. There are other actions, like tool. Tool is where you put the code

[nikolaimanek]

Nice video! Will you cover Mixtral 8*22b soon? That would be great to see. The 8*7b was already great.

[aosamai]

Thanks Matt for the review, as always you have perfect timing and bring a common sense perspective.

[steefvanwinkel]

Would love for you to do an in depth video in Gemini 1.5 pro 🙏

[kothapetvarun]

It's designed specifically to help tackle those challenges by enabling collaborative AI agents. This means teams can seamlessly work together rather than reinventing the wheel every time! I believe integrating tools that foster this kind of collaboration can hugely impact overall efficiency and innovation.

[ghcbs]

LMAO the new Mercedes looking like a sentra

[MrVohveli]

Considering Google ought to be a solid year or so behind OpenAI, despite their best efforts, what kind of monster is OpenAI planning to release that beats all this?

[jeisenstein]

Hey Matt. Have you seen platforms like Kisai that do a lot of the heavy lifting with getting from design to production code? Lots of Gen work in there that makes this seem a bit rudimentary.

[theycallmethesoandso]

the Mercedes missed opportunity is probably an insurance issue. They'd need to long term test of it's safe because they don't want to get sued if someone expects the ai to read their mind and then goes road rage and blames it on them