Hands-on: Spring AI with Ollama and Microsoft Phi-3 🚀 🦙 | Run LLMs locally and connect from Java

This video covers how to run LLMs locally using Ollama and Spring AI with hands on example in Spring Boot and Ollama libraries.

Join this channel by contributing to the community:

📌 Related Playlist
================

🎬 Video Editing: FCP

---------------------------------------------------------------
🔥 Disclaimer/Policy:
The content/views/opinions posted here are solely mine and the code samples created by me are open sourced.
You are free to use the code samples in Github after forking and you can modify it for your own use.
All the videos posted here are copyrighted. You cannot re-distribute videos on this channel in other channels or platforms.
#SpringAI #Ollama #TechPrimers

[ramkarlapudi]

Thank you, I am looking forward to learning more from your channel, much appreciated, keep going, we java lovers are with you :)

[mudassarh]

You are a key contributor in the java space, pls continuing doing awesome work. Requesting you to extend this video with some sample trained data. Data that could be fed to this llm eg we can store in our repository like top destination as per the time of the year / events/ weather etc,

[shivprakashy]

Informative as usual, I think python & its framework would be more suitable for AI content at least for quick PoC. Definitely this video will help Java fans😊

[janakiramireddikoki]

Thanks for the another great video as usual. Yes if possible please make video on azure openAI which is one of trending AI interface.

[manojBadam]

Thanks for the video, few things are unclear from the demo, does the Spring AI talk to your local ollama ? What happens if ollama is not installed or running that model at that point of time ?

[rajkumaraddu]

thank you Ajay. you made my day.. one query, is it possible to upload a resume file and get the required details like, name, contact, skills etc..

[rajeshbongurala]

Gr8 info buddy for beginners. I want to use microsoft azure openai with custom data and rag too. Also need a custom chatbotot (own). Can you help me with desing?
How to build my app in python, call 3rd party api, how to use RAG, how to expose API to custom chatbot etc ?

[liqwis]

Good one, but imagine my backend is supporting a application, and my offline running ai model is as connected to my backend springboot, now how can I train the offline running ai model about the application and create a chat bot which gives response to the request only about the trained data i.e the application