Azure OpenAI in LangChain: Getting Started

Getting started with Azure's OpenAI offering. In this video, we explore Azure OpenAI and how to integrate it with the LangChain library. We'll build a chatbot by first deploying the OpenAI model in Azure OpenAI Studio, and then see how to use it via the AzureChatOpenAI class in LangChain.

📌 Code:

🌲 Subscribe for Latest Articles and Videos:

👋🏼 AI Consulting:

👾 Discord:

00:00 Azure OpenAI in LangChain
00:27 OpenAI in Azure Portal
03:54 Creating Deployments in Azure OpenAI Studio
05:17 Connecting LangChain with AzureChatOpenAI

#langchain #artificialintelligence #nlp #ai #openai

[Kelly-yyij]

Thank you for your detailed demo and the langchain version! It helps a lot!

[mtrentman]

Thank you, your videos are always very helpful! Do you happen to have any video where you use LangChain and AzureOpenAIEmbeddings to parse PDFs?

[AlonAvramson]

Thank you for your detailed demo and the langchain version! Do you have a video with a chain implemented with AzureOpenAI?

[greenhoodie]

Thanks - Appreciate your tutorials 👍
I'm inpatiently waiting for azure openai in Australia 😢

[jimmynguyen]

You’re just flexing that you have access to GPT-4 in Azure! Been waiting for months

[wangbei]

may I know what tricks you did when hovering around the texts and some prompts pop up?

[tristanmorris]

Do you have any resources about how to fine-tune embeddings models like Instructor-XL?

[xiaoyuyang]

wondering whether you can also show how to use LLama 2 in Azure

[tseojle]

how can i use azure's cognitive search rather than langchain to create the chat app for Q&A over local data?

[SebEric-vhzu]

Hey James,

If you use a unique end point for Azure OpenAI, does that mean a 3rd party cannot see your data (such as OpenAI)?

Secondly, are you able to use embeddings from Azure with Langchain?

Im looking to use gpt3.5/4 and embeddings for RAG on private data.

Thanks again for your videos. I've learnt a lot over the last 7 months!

[rogerroan]

Hey james,

Can you find fine-tune model at azure openai studio ? I cannot find any more . etc:East US, north central US, West Europe..., thank you

[micbab-vgmu]

Could you show as how to use Llama 2 in Azure if possible. Thank you.

[hvbris_]

Hey James - is Azure OpenAI faster than the vanilla OpenAI endpoints? Thanks!

[MatheusGamer]

james, you have some experiment/experience with request fail rate in azure requests compared to directly open ai calls?
i have a application with a lot of requests per hour, my team are looking for Azure to bypass this situation because openai have a lot of fails.

[mmarodr]

When I use Azure with openai API, without langchain I need to specify a certificate

http_client =
client = AzureOpenAI(
api_version=api_version,
base_url=azure_url,
http_client=http_client)

But using from langchain_openai import AzureChatOpenAI I do not know how to specify that.
Could you tell?

[ashwinmanickam]

I get this error
ValidationError: 1 validation error for AzureChatOpenAI
__root__
base_url and azure_endpoint are mutually exclusive (type=value_error)

when i run the code
llm = AzureChatOpenAI(
deployment_name="gpt-4-32k",
model_name="gpt-4-32k"
)
Can you kindly help

[iddqd_]

🎯 Key Takeaways for quick navigation:

00:00 📝 Learn how to use LangChain with OpenAI in Azure.
02:47 🔑 Integrate OpenAI in Azure by creating a new deployment and copying the endpoint and API key from Azure Open AI.
05:21 🤖 Deployments for each model are necessary in Azure Open AI, unlike the default version.
07:13 🔄 Get meaningful answers from the chat model by relating queries to previous messages.
08:45 🧠 Azure's OpenAI offering allows interaction with models through unique endpoints.

Made with HARPA AI

[genib]

How did you get access to Azure OpenAI?
It seems like you need to apply for the access and even then they only approve enterprises and partners currently.

[ronelgem]

does anyone have the link to the latest notebook?

[wryltxw]

What’s the benefit of going through Azure?