Integrate Ollama's Tool Support with LlamaIndex : How to call External API ?

preview_player
Показать описание
In this video, we will cover how to integrate LlamaIndex with Ollama's Tool Support / Function calling and use it to call External API ? We will also explore how to make parallel Function calls and utilize GroqCloud to run the open source models (Llama3.1) run faster on our local machine.

Agents in LlamaIndex : Part 01 :
********************************************************************

How to setup and use Ollama and Groq ?:
********************************************************************

Please check below link to go through the LlamaIndex course from scratch:
*********************************************************************

Chapters :
************************************
0:00 Overview of Ollama's Tool Support
0:26 What are we going to build ?
4:04 How to connect to external API using Ollama's Llama3.1 model ?
8:34 How to connect and access Llama3.1 models using GroqCloud ?
10:51 How to pass multiple Functions and make parallel function calls ?

Please refer the code here [ReActAgent + FunctionCallingAgentWorker ]
*************************************************************************

Please do check other GEN AI videos in our LlamaIndex series:
******************************************************************

Looking for interview guide on Kafka ?
************************************************
If you are planning for interview on real time process and looking for tech questions on Kafka and Spring Kafka, look no further and grab your copy of "75 Interview Questions on Kafka and Spring Kafka".

Рекомендации по теме
Комментарии
Автор

I have used ReAct agent here but if you are specifically want to test the Function calling/Tool support capabilities, please use FunctionCallingAgentWorker instead of ReAct agent. FunctionCallingAgentWorker is designed to work with models that support function calling/tool support whereas ReActAgent, on the other hand, is designed to work with any model that supports the ReAct protocol and not just those that support function calling/tool support.

TechyTacos
Автор

ReActAgent mode no use the API for tools of llama 3.1

ok-wkgx