LangChain in Production - Microservice Architecture (incl. FastAPI and Docker)

Ever thought about build a real world application with LangChain, with multiple microservices, a real Frontend Framework and RestAPIs to handle conversations? Then this video is for you!

0:00 Microservice Architecture Chatbot
2:45 Quick tipps for LangChain Ecosystem in Production
3:45 Code Walkthrough
10:37 Checkout the App!

[romanklyuchnikov-ymul]

i always see these comments under like every tutorial video even the ones that give no really useful info, so any praise under any educational video kinda devalued to me which i suppose might be the case for the creator themselves too.
ive never written such comment partly for that reason and MAN i just want you to know that this video is the most appreciated of the ones about langchain to me, i literally cant begin to describe how useful for me it is, been searching for it for a really long time. you deserve the happiest life a human can imagine and i just hope some day i'll run into you to buy you a beer or two. thank you.

[jayglookr]

You did a containerized, modular deployment of a LangChain implementation. Very nice! Man here made me smash that 'like'. He made me.

[robertmazurowski]

This makes sense for very large projects, a monolith for most use cases is 100 percent fine. Microservices is for an app that is used constantly by many users and the app makes a lot of money. Also why would a restaurant pay monthly for so many containers? If it is a chain it is fine, for small business this is very impractical. Following best practices for the sake of it when it does not provide a benefit, and from the business perspective does not make sense is not a good idea.

BTW the design is good, and the tutorial was presented very well, just don't tell people to use microservices for a restaurant app.

[vj]

excellent ! production readiness score 8/10

[maxstrootmann]

This is absolute gold! You are helping me make my dream project right now, thanks so much!

[FabianPedreros-xggt]

Excellent work, it's great to see another approach more oriented to a real application, I wonder if you could make a video of the deployment in web services like AWS and GCP, there are many tools and I don't know which one to choose in these cases, it would help a lot to see how you execute it. Greetings from Colombia.

[lukem]

This is very cool! Would be keep to see more of this!

[ivansebastiancordovarivero]

You are the best my man! Such a great video

[mariusorani]

Great Work! Finally a Real World App on youtube

[jorgecantero]

Nice work!!! there are a lot of notebook but no so much information for real world. its really valuable!!!

[timtensor]

nice video. I can echo the sentiment of others. Most videos miss out on important things or basics for a non experienced beginner. Do you think you could add a video in actual production (live production). Second thing just a feedback, the data flow and handshake of services if it is shown in numbers and different colors ( the flow basically ) would be great.

[sanyk]

Subscribed you channel, waiting for more full project based tutorial on AI, Langchain, Python, Data science. Keep up the good work ❤👍❤

[naim]

Outstanding work! This is one of the best tutorial I've found on how to build real-world LLM apps.I think it's really cool how you use Redis for preserving conversation history. However, I'm wondering if there might be issues exceeding the OpenAI token limit? Do you have any ideas to overcome this issue? Keep up the good work!

[ofir]

Thanks a lot! Quick question - where did you install pydantic, langchain, and the other libraries that are not in the Dockerfile?

[MuhammadTaha-pi]

Could you make an updated version with LCEL especially how to implement memory

[henkhbit]

Great video, but it woud be nice if you replace openai to an open as source llm.

[sbacon]

Good video.
I'm already going down this path.
Except I'm forced to use local model.

[SudhakarVyas]

Is there any risk of PII leakage in this implementation if I am using other hugging face llm instead of OpenAI ?

[hdhdushsvsyshshshs]

what is I want to use a model like Llama2, how can I change OpenAI API for Llama2?

[Almopt]

Once again, excellent work with this super-detailed tutorial. If you were to create a similar system for several restaurants, what would the architecture be like? Or would you simply create an instance for each restaurant?