Build Agents from Scratch (Building Advanced RAG, Part 3)

In this third video of this series we teach you how to build LLM-powered agentic pipelines - specifically we teach you how to build a ReAct agent (Yao et al.) from scratch!

We do this in two parts:
1. First define a single execution step using LlamaIndex query pipelines to define an agentic DAG. We use special components to maintain mutable state; this state can be carried over to the next step of execution.

2. We can then wrap this DAG in an agent worker that can execute this DAG step-by-step or e2e until complete.

Timeline:
00:00-10:42 Intro
10:42-13:04 Setup Data + SQL Tool
13:04-23:06 Define Agent Modules
23:06-26:27 Define Links between Modules
26:27 Setup and Run Agent

[seanbergman]

Great video! This entire three-part series is exactly what I needed. Can't wait for the next video you mentioned that will take user feedback into account.

[amansingh.ai.]

awesome! Thank you Jerry. Absolutely love tutorials like these.

[orhandag]

Hi Guys.. This was a great video. But I have a question. Is it possible to build this agent with Huggigface LLMs ?

[explorer]

Will this give flexibility to use any model or tight coupling on how OpenAI models respond? Choices etc?

[AngusLou]

Suggestion: Place your avatar on the right side of the screen so that it doesn't block the text as much. Thank you.

[austinmw]

Shouldn't `parse_react_output_fn` also append the `reasoning_step` (e.g. a `ActionReasoningStep` or `ResponseReasoningStep`) and `agent_input_fn` only append `reasoning_step` on the first run, so you'd get the following as the chat history:

```
user: ObservationReasoningStep (original query)
assistant: ActionReasoningStep
user: ObservationReasoningStep (tool output)
assistant: ResponseReasoningStep
```

Instead of the current:

```
user: ObservationReasoningStep (original query)
user: ObservationReasoningStep (tool output)
user: ObservationReasoningStep (original query)
```

Where currently no assistant messages are mixed in, and the original query appears twice?

[vittoriohalfon]

Amazing video. However please make some video tutorials in node.js / typescript!! Not only python devs out there😇

[renaudgg]

Did i understand well at the end that we can just write agent.chat instead of writing all those 800 lines of code?

also is all this good with gpt-3.5-turbo? will that agent help to get better answers

[joaooliveira]

Great!
Is the version 0.10.5 already available?

[fintech]

How is it different from autogen or crewai