Introduction to Function Calling with Gemini GSP1227

Overview
Gemini is a family of generative AI models developed by Google DeepMind that is designed for multimodal use cases. The Gemini API gives you access to the Gemini Pro Vision and Gemini Pro models. In this lab, you learn how to use the Vertex AI Gemini API to generate function calls from text prompts.

Calling functions from Gemini
Function calling lets developers create a description of a function in their code, then pass that description to a language model in a request. The response from the model includes the name of a function that matches the description and the arguments to call it with.

Function calling is similar to Vertex AI Extensions in that they both generate information about functions. The difference between them is that function calling returns JSON data with the name of a function and the arguments to use in your code, whereas Vertex AI Extensions returns the function and calls it for you.

Objectives
In this lab, you learn how to:
- Install the Vertex AI SDK for Python.
- Use the Vertex AI Gemini API to interact with the Gemini Pro (gemini-pro) model:
- Generate function calls from a text prompt to get the weather for a given location.
- Generate function calls from a text prompt and call an external API to geocode addresses.
- Generate function calls from a chat prompt to help retail users.
#gcp #googlecloud #qwiklabs #learntoearn