How to Run OpenAI Models Privately (Azure OpenAI)

Unlock private OpenAI on Azure & chat with docs 🚀📄💬 #AzureAI #nocode

Intro-0:00
Benefits of Azure OAI - 0:21
Running OpenAI Privately on Azure - 1:01
Private Chat with Your Docs Web App - 3:49
Conclusion - 6:50

About: Learn how to run OpenAI models privately on Microsoft Azure with our step-by-step tutorial. Discover the advantages of Azure OpenAI, set up your own private model instance, and build a custom RAG web application for document chat, all without coding. Plus, get insights into integrating AI in businesses. Don't miss out; subscribe for more AI insights!

[kocjebn]

I am taking a course from Microsoft on Azure Open AI and this was video better than the 100 hours of info they give you. Appreciate the straightforward tutorial. Can you make a azure openai series? I would pay for that content.

[iandrake]

Perfect! Thank you! Also, I like the format of this video. I think you're improving as a youtuber!

[PelleGrosso]

Lovely! Wish I had found you earlier! 👍👍👍 Thanks! 🙏

[VikasVyas]

Thanks for this video really helpful. As a next step I would like to understand if I can integrate it with internet to get information where no information is available from documents uploaded or share point at the same time maintaining privacy of my data?

[humayounkhan]

Hi, thanks alot for this video! Its amazing. May i know if once all those services are deployed, will you also have a callable endpoint instead of a webapp link? So that perhap this could be used to power a customer service chatbot on a website. Appreciate your time and response!

[magicismagic]

Thanks for the share!

I'm wondering what camera, microphone and lights are you using? Would appreciate your time and effort answering! Love your content!

[tlubben]

Can you use the assistant APi in azure?

[nsoe]

After uploading a doc and following your steps, I got error during the ingesting process. The error is "We couldn't connect yoru data, one or more preprocessing jobs failed". any idea? thanks for a great video

[jacoblagana]

Thanks for the video, I am trying to apply for azure openai however theres a form and from looking at reddit some people have been waiting up to months to gain access. are there any tips or tricks to get your application approved faster?

[Evox]

Hey @vrsen,
will you make a video about the OpenAI DevDay and all the features they introduced? I'd also be interested if you could give some inside on how this could affect tips and guidelines from your previous videos (skills/tools to learn etc.) and how it may affect your daily work.
Especially the GPTs sounded interesting or do you think they again lack customizability like the frameworks do?

[Evox]

Hey, again awesome video :)
This approach sounds very interesting. How does it fit into your daily work as you told before you prefer code solutions over no-code solutions because of better control.
What I didn't get from the video was the actual pricing, do you pay monthly for the Azure services, do you still need an OpenAi subscription and pay them for token consumption?

[mumpecydrone]

thanks for the video, man...learned alot. how can i add an upload feature to that webapp so that users can upload and analyze their own documents with that initial knowledge base in the ai? is it possible?

[rishavmishra]

thanx vrsen, very helpful.. I would Like to know if you
1. use opensource models for clients for data security, I have a project where I am using opensource models.
2. use Langchain in production. If you don't I'd like to know where I can learn the coding resource for complex tasks that can be replaced with langchain.

I prefer to do things in code, this gives me independence and room for creativity.
thank you very much, your content has always been good guidance.

[lipasfriends]

Hey man, I'm trying to get access to azure openai but it requires a company email.. You could have mentioned this in your video :(

[magicismagic]

I have one question. By the way, great video, man! I'm not a professional developer, but I know the basics of coding from different sources (with the help of AI). I can create some usable code. The Azure example is simple, so even a non-developer could do it. Since AI development is the future, I'm wondering what the best steps would be to learn AI development? Test every single chatbot platform?

[francisokech]

Sorry but this is too fast. Clearly you've mastered this stuff but I'm struggling to keep up. Please release another video with a more realistic pace.

[isaac]

For those who are getting an error because of the api update, here's an example of what the new code looks like.
Note I'm running this in vscode and not the notebook.


import os
from openai import OpenAI
OpenAI.api_type = "azure"
OpenAI.api_version = "2023-05-15"
OpenAI.api_base = os.getenv("your key name here")
OpenAI.api_key = os.getenv("your key name here 2")

client = OpenAI()

completion =
model="gpt-3.5-turbo",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello!"}
]
)