Streaming completions from GPT 3 API. Chat gpt like streaming text with Streamlit web app UI

We will learn about getting streaming responses from GPT-3 API instead of waiting for the entire completion. We will use Streamlit to build a quick user interface for this.

Timeline:
00:00 Demo
00:33 Setting streaming to "True"
01:22 Code review
04:10 Full code and examples

#gpt3 #gpt #chatgpt #chatgpt3 #chatgpttutorial #openai #gpt3.5 #streamlit #streamlittutorial

[MariushAI]

I like your videos, keep it up! Good job.

[leirtac]

Awesome video thanks. What about clearning the input box after entering and keeping the previous responses saved on screen. Similar to ChatGPT interface. Is there a simple way to do that with Streamlit, ?

[sharjeel_mazhar]

i want this kind of response from my deep learing model, any idea how can i achieve it using streamlit, i am not using chatGPT api or anything, i just want the output of my model to be shown on streamlit frontend word by word like this.

[vesper]

Is there a video that explains how to do exactly this but using a JS UI instead of Streamlit?

[adumont]

ANy idea how to achieve this with LangChain (and StreamLit)?

[marianajaramilloacero]

What protocol did you use to send the responses to the front?
I find it hard to do this streaming with HTTP protocol

[DANIEL-zhwh]

Could you do a video for the qa with document in langchain