Llama 3 8B: BIG Step for Local AI Agents! - Full Tutorial (Build Your Own Tools)

Llama 3 8B: BIG Step for Local AI Agents! - Full Tutorial (Build Your Own Tools)

👊 Become a member and get access to GitHub and Code:

🤖 Great AI Engineer Course:

🦙 Easy Local RAG Ollama:

📧 Join the newsletter:

🌐 My website:

Links:

In this video I create a AI Agent that can controll tools using APIs and internal functions. Leveraging local llms like llama 3 with function calling can be very powerful and highly customable. Full tutorial on how to create local llm tool calling.

00:00 Llama 3 Agent Intro
01:47 Llama 3 Function Call Code
04:52 How the function calls works
11:22 Llama 3 Agent Test 1
13:46 Creating a llama 3 tool / function
16:08 Llama 3 Agent Test 2
16:47 Conclusion

[ozancatalorman]

Incredible tutorial. I have realized that I have never seen a full tutorial that is full like this one

[VOLatile_MiX]

Playing with Llama 3 on Ollama and it is bonkers good

[davidtindell]

Thank you again for this very thorough and informative review!

[suzhfxx]

thank you for the break down it will help us to create our own specialized agents

[arthuralvespsy]

Something that is not clear for me is why we should use the open ia API in the agent, was it not possible to only run the entire model locally ?

[ABK]

Outstanding demonstration, thank you. I would like to make it possible to add new tools using a yaml or json configuration file so you don't need to hard-code anything. It would also be nice to have the answer returned immediately instead of having to prompt it to check the retrieved context. But all in all this one of the best and most practical open source AI demos I've seen.

[UserB_tm]

Great video I am super excited about being able to use function calling with a smaller model.

[Potomekopice]

Impressive, very nice. And speed of this is insane.

[entropy]

Full tutorial but code is pay walled, reminds me of "open"ai

[gumshoe]

I love the content. I have an idea for a video and this is something a lot of people could use. I’m terrible at taking meeting notes. A local model that could listen using the laptop mic and summarize in person meetings would be amazing.

[FayeSabre]

This might sound like a really dumb question, but how would one approach this when using Jan and the interface? Is that at all possible?

[TheHistoryCode]

🤖 (00:00) **Intro to Llama 3 8B and its capabilities** 🧠
- Demonstrates the agent's ability to search Google, extract information, and send emails. 📧
- Highlights the impressive instruction-following abilities of the model.

🛠 (02:00) **Code Deep Dive - Setting Up Functions**
- Explains the functions used in the system, including search Google, send email, and check context.
- Shows how to add custom functions, like write to notes. 📝

🧠 (04:21) **Understanding Function Calls** 🤔
- Breaks down the process of how the AI agent interprets user input and triggers function calls.
- Explains the role of secret instruction notes and the parse function call function.

🕵‍♀ (07:18) **Surveillance System** 👀
- Discusses the surveillance part of the system that monitors the AI's output for function call tags.

💻 (11:21) **Showcasing the System**
- Demonstrates the system in action by performing tasks such as searching Google for AMA models and extracting information from context.

📝 (13:33) **Adding a Custom Function (Write to Notes)**
- Walks through the steps of creating and integrating a new function that writes content to a text file.

✅ **Benefits**
✅ Shows the potential of local AI agents with Llama 3 8B.
✅ Provides a detailed explanation of the code and logic behind the system.
✅ Offers a tutorial on how to set up and customize your own functions.

❌ **Cons**
❌ The video is quite long and technical.
❌ Assumes some prior knowledge of AI and coding concepts.
❌ The explanation can be a bit verbose at times.

**Key Takeaways** 🔑
- Llama 3 8B is a powerful language model that can be used to build local AI agents.
- The system uses a combination of functions and instructions to perform tasks.
- Users can customize the system by adding their own functions.

**Summary**
The video provides a comprehensive tutorial on building a local AI agent using Llama 3 8B. It covers the code, logic, and functionality of the system, as well as how to add custom functions. While the video is technical and assumes some prior knowledge, it offers valuable insights into the potential of local AI agents.

**Verdict: Like 👍** (Despite the cons, the video's educational value and insights make it worth a like.)

[phargobikcin]

Is the model fine tuned in anyway to use the function calling convention (tags + json), or is it solely based off the system prompt? If the later, I am mighty impressed for a 8B model.

[Ridho]

That's amazing! What is the difference between using LangChain and not using it? Thanks!

[BORCHLEO]

one of the best videos ive seen on this topic maybe the best! keep it up broski! <3

[nassosdimou]

could you show us how we can use the Modular Accelerator Executable for reduction in latency of models?

[HugoMonteirohmmonteiro]

Great video! Thank you very much for the explanation.

[annakodama]

Thank you for sharing, where can I see the full code?

[bennie_pie]

How does it compare to the likes of Dolphin-Mistral which has the bigger context window/code training?

[morielpereira]

at first. btw I'm still at first. it's cos I'm dumb. but have you code on lamma 3 a python file to make it be able to create a google search engine? like who doesn't have google search tool? I don't see the point!