Deploy LLM App as API Using Langserve Langchain

LangServe helps developers deploy LangChain runnables and chains as a REST API.This library is integrated with FastAPI and uses pydantic for data validation.
--------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
-----------------------------------------------------------------------------------

►Data Science Projects:

►Learn In One Tutorials

End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's

►Learn In a Week Playlist

---------------------------------------------------------------------------------------------------
My Recording Gear

[krishnaik]

Lot of efforts is required in these kind of videos. Make sure to subscribe, like and share with all your friends :)

[palashjyotiborah]

Ad at 11:52, you have asked us to mention for any mid-roll ads. Here is one ! thanks.

[ypolqcr]

Krish Naik is literally the Harsha Sai for Machine Learning, Ai and Data Science Stuff. A great Salute for you sir 🙋‍♂

[wtbshth]

really loved your explaination is just amazing

[MrSajjadathar]

Thank you so much krish, there is one request can you make a detailed video on crew AI and autogen AI, please

[AasherKamal]

Sir how to deploy Open source LLMs and use them as API? (Free)

[dereckjos]

This video is amazing but here we are having dependency on openAI is there any way to deploy custom llm models as an api and eliminate dependency of openAI

[shashankshekhar]

Hey thanks for the video. One question: So what benefit exactly does Langserve provide? I could have created a flask end point and inside that just accepted the message and called Langchain LLM with that message. So what is exactly the benefit of using langserve over vanilla fast/flask?

[taazkareem]

Hey, what are some prerequisites to learning this? When you say “Deploy LLM App” you’re not actually building the app in Langserve right?

[cricketalwys]

What is the type of these apis, is there any way to create post method apis?? Like we could define routes and then whether the function will be of get or post type - something like this??

[devloper.hs]

Recently you doing a lot of videos on langchain, cool

The only problem i face is not having access to open ai apis. Minor so I can't buy it, and parents think I am doing trash things instead of studying.

Can you provide some altermatives

[xfzohpx]

Its a very informative video but can we deploy these API with help of streamlit or something else ?

[pgobiui]

Make an video on cloud computing & which cloud mostly used by mnc

[akshatkant]

How to do the same thing for an OSS llm model, lets say a mistral? can i do the exact thing with mistral and how?

[TsioritianaRyanRakotoahijohn]

Hello Krish Naik, I really like your videos tutorials about langchain, langserve. But actually, I really want to ask you if you could make a video tutorial about langchain, langserve to make an application like askyourpdf that allowed users to upload their own file.

[ChanduAki-htxv]

Hi Krish,

Can you pleaadd the usecases of lang graph and practical applications in industry

[nischitkr]

Using gradio also I can create api right ?

[agahyucel]

Hello @krishnaik06. Do you plan to make the Gemini Pro Fine Tuning video that has been recently published by Google?

[andaiai]

after using openai api, making another api end point ?, most of these tricks never serve the production setup scenarios

[AIWalaBro-Bharatbhushan]

I tried hard but giving the 404 error, can anyone help me out into this to resolve