Vertex AI Agent Builder

In this recording, i show how to use Vertex AI Agent builder

[EmotiLogAI]

Thanks for the video on this topic. Can you also make a video to call the agent via apis?

[EccleezyAvicii]

So I've been tinkering with it also to figure out how it works.
Some issues ive encounterd are similar to yours. I'll post a second comment with some feedback on your experiment.

One agent starts a convo, then when the subagent is invoked I can get the dialogue working but there isnt a seemless way to return to the default agent. I tried a basic dice roll agent with a Dice Roll Steering agent, and two sub agents for 1d4 and 1d20 dice.

I tried various things and the best results i got were building out conversation examples in subagents (1d20). When I would ask to switch from one dice to another, the subagent would just run the operation correctly--ie. the 1d20 dice agent would roll a 1d4 agent. I would prefer it to just return the dice result but it sorta took over, neither the 1d4 subagent or default Dice Steering agent could return.

I tried adding instructions in the subagents to return to the Default agent, but this results in an loop error.

You can't have the LLM input text in sequential cases, so its challenging using this interface to jump from one agent to another. Ie. an example i would want would look like this:

person: Hi
dice steering agent: Hello would you like to roll a 1d4 or 1d20
person: 1d20
- 1d20 subagent: <uses code interpreter>
- 1d20 subagent: The dice landed on 3! Would you like to roll again?
person: No
<here is the part in the conversation i cant figure out, the 1d20 agent will not release control back to the dice steering agent>
<sometimes i get this as result:>
- 1d20 subagent: Ok thanks for rolling
dice steering agent: Would you like to roll again?

[EccleezyAvicii]

So I noticed your default agent was the Answer Checker, the default is the agent that has a star in the list. That should be the initial agent that the user starts talking to. The Error you got at 16:08 was due to having your Quiz Master not set as the default.

Maybe im wrong but it seems like maybe this could work?
the example should start with a user prompt: Hi!
then the QuizMaster saying hello would you like to play
then yes or no
then I would invoke maybe a question asker subagent to ask a question since the default agents:
- doesn't receive a summary of preceding conversation turns.
- can't define or receive input parameters.
then the user answers
<here im not sure if you can even have another subagent evoked to check the answer since the input would need to be both the question and the user input, which im not sure how to do, so maybe its better to let the question asker subagent do all the work>
- the question asker subagent checks the answer and replies to the user, also asking if they want to play again
- if the user says no
- the subagent state needs to be set to OK, which transer back to parent agent
< i dont understand how to get the states to work, the interface seems bugged>
- the default agent then says: thanks for playing

[justtlenin]

can you please also include tools in your upcoming videos. it could be very simple scenario like, user provide city and agent should call a rest api using OpenAPI tools and finally show the result to user (api could any dummy restapi).
thank you