Spring AI Introduction: Building AI Applications in Java with Spring

For the longest time if you wanted to work with Machine Learning you were using Python. That was because python had a lot a really great set of tools for working in this space. Now that we have LLMs like Open AI’s GPT-4 where the P stands for pre-trained we can simply call them like we would any other API. Java is everywhere in the enterprise and we need to start thinking about how to integrate these capabilities into our applications.

In today’s tutorial I want to talk about communicating with an LLM like GPT-4 (or any other LLM) and some of the challenges you might come across. From there I’ll introduce you Spring AI which is going to help us build AI powered applications by solving some of these challenges.

Spring AI 1.0 Updates

The syntax for some of the features we went through in this video might have changed a little bit with the release of 1.0. Please check out this video I did on the changes in 1.0.0 M1

🔗Resources & Links mentioned in this video:

👋🏻Connect with me:

[fibfranco]

Such an amazing coincidence haha
I started looking at the Spring AI project for the first time a couple hours ago and thought: "wonder if vega has posted something about it" and you just did :)
thank you, man!

[WisomofHal]

Oh my goodness. In my current Springboot project I've created a complete "Python Engine", using Java's process builder, to create embedding, parse embeddings, run all the required python scripts, error handling and output to create and run RAG Chains. It was quite fun, but this will help tremendously to take that load off. Thanks for sharing will be looking deeper into this. Cheers!

[grrlgd]

great stuff Dan... please do more . cant wait to see the next content. keep up the good work

[dnnmiey]

Awesome @Dan Vega!! Keeping it simple but effective. Gave me the needed high level overview that I needed

[MohamedDernoun]

How clear is your explanation, best address for people who scare from java!

[TobilobaOwolabi-wycq]

Hi Dan. Thank you for the subtle intro to Spring AI. I know you will be looking to do more videos on this topic and I would like to just point out some topics you can look into.

1. RAG with multiple documents instead of one
2. How to use more than one LLM and switch between them(maybe with dynamic configuration properties)

[sohamsarkar]

Dan loved your session. Please upload a detailed video on RAG

[CodeBank-rwbq]

Exactly this is what I was looking for ❤

[walterpalladino]

Great video. Can Spring AI interact with a local LLM? If can do it, will be great to se an example. Thanks.

[scitechplusexplorer]

Hey Dan, hello, Good Evening! Please make a full video on GraphQL including Pagination with latest Spring Boot version. It would be very helpful.

[stephaneislistening]

On SpringBoot 3.3.0 here and the OpenAI API seems to have changed quite a bit already in a month since this video was published.

[Bibhaw]

Well explained, Thanks vega :)
Can't we directly autowired ChatClient ?

[sagarbhat]

Thanks for taking time to make this video Dan.
I’m building a RAG based application and have tried LangChain4j and Spring AI, and at this stage LangChain4j seems to have more features (Chat Memory, Hybrid semantic search with Azure AI search vector store) compared to Spring AI. But at the rate at which Spring AI is being developed, I’m sure it will catch up.
Quick question - is there an easy way to log the requests and responses to/from the Open AI service in Spring AI? In Langchain4j it’s as simple as adding a property.

[terrabys]

Is there support for agentic workflow?

[adityasinghrajput]

Sir please upload a full spring boot beginner to advanced series and after that spring security then spring cloud then micro servise then full project with spring boot integration of spring AI

[crampanelarutzi]

please make a video about weka framework.

[BananBananski]

Looks like the ChatClient is synchronous and some models take a long time to respond - that would be a bottleneck in many use cases. Is there an asynchronous implementation as well?

[muslehhaj]

Hello Spring Boss 💪, I have a course idea but no one in "Udemy" did it yet K I've tried few course in Udemy, but none of them completed... I'm looking for a full-stack project wise course using spring boot as backend & Vaadin for front end .... but not sure if Vaadin is the right choice to build a real-life application .... please Advise me Boss ⚠

[kafkaesqued]

Hello Sir, could you provide a reference for SVN to GitHub migration with the help of Spring Java + GenAI tech

[nikhilrathi]

Hey @Danvega Can we not build these applications without using open Ai . ?
Cause that costs. I was thinking to build a audio generation platform where users can build the songs based on different genres.