Spring AI with Ollama - Use Spring AI to integrate locally running LLM.

Показать описание

In this video, I have explained, how to use Spring AI - one of the newest framework, with locally running LLM using Ollama.
The integration is clean and we can use the existing Spring ecosystem for our use cases.

Download Ollama from:-

While downloading the model in local, please ensure you have sufficient RAM for the model.
You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models.

GitHub link for the examples explained in the video:-

#spring-ai #ollama #llm #largelanguagemodels #llama3

00:00 Introduction - Spring AI
00:45 Ollama
01:40 Ollama setup
05:45 Project setup
07:45 Endpoint for local LLM
14:00 Streaming response

Рекомендации по теме

Комментарии

There are many videos showing how to use Spring AI with OpenAI's GPT-3 or GPT-4, which require an API key and involve costs. It’s great to see you leveraging Ollama and open-source models without any associated costs!

dhavasanth

after importing your code when i start server it is up and running when i hit rag api from postman it is thouging 500
why
all me end pointa are currect
can you help me here

NaveenPrasadKarnam

Spring AI with Ollama - Use Spring AI to integrate locally running LLM.

Getting Started with Ollama, Llama 3.1 and Spring AI

Spring AI - Run Meta's LLaMA 2 Locally with Ollama 🦙 | Hands-on Guide | @Javatechie

Hands-on: Spring AI with Ollama and Microsoft Phi-3 🚀 🦙 | Run LLMs locally and connect from Java...

Spring AI With Ollama: Secure, Fast, Local Integration Made Easy

Build AI Applications FAST with Spring Boot and LLM Models! (Ollama)

08. Spring AI : How to Integrate Open Source Models using Ollama (Llama 3.1) ?

14. Spring AI : RAG using Open Source Models using Ollama !

Spring AI Ollama | LLM | llama3 | Create Your Own Chat App using Spring AI Ollama | EnggAdda

run AI on your laptop....it's PRIVATE!!

Spring AI Series 5: Run With a Local LLM With Ollama

Spring AI with Ollama | Use AI models for free | Chatboat | Setup local server with AI model

Discover the Secrets of Spring AI 1.0, SpringBoot, Java, Ollama/Llama3, API Creation and RAG Basics

How to setup Ollama and run AI language models locally - Java Brains

Spring AI with Ollama - Use Spring AI to integrate locally running LLM.

A tiny taste of Spring AI with Ollama

Getting started with Ollama Llama 3.1 and Spring AI

Getting started with (Retrieval Augmented Generation) RAG in Java & Spring AI

Build Intelligent Spring Boot Apps using Spring AI and Ollama | Trip Planner App

Run your own Copilot with Ollama and Spring AI

Smart Investment Portfolio Advisor App with Java, Spring, Langchain4j, and OpenAI/Ollama

Uncensored Java AI: Running AI Models using Ollama and Spring AI

Spring AI Ollama Demo

Spring AI - Manage Conversation History with ChatMemory in Spring AI #ollama #llm #ai

Levelling up with LLMs Locally: Spring AI with Ollama & RAG Architecture Integration