How ChatGPT Finds Answers To Your Questions

Many people wander how ChatGPT gets answers to their questions if it’s not connected to Google. Does it search the answers in its own database, well not really. As we know ChatGPT doesn’t have direct connection to database. Although OpenAI trained it on massive amounts of data about code and information from the internet, including sources like Reddit discussions, to help ChatGPT learn dialogue and attain a human style of responding.

So how does it know where to look for answers if we don’t give ChatGPT even a link or document that may contain the answer we are looking for? The answer to that is “Closed-book question answering”, hm. Okay, so imagine you're playing a trivia game with your friends and you ask each other questions. But in this game, you can't use Google or any other tools to help you answer the questions. You can only use what you already know. That's what "closed-book" means in this case. People have made "models" that can play this game too! They can answer questions you ask them, but they can only use what they already know too. This is called "closed-book question answering". Making these models is hard because they need to know a lot about many different things to answer all the questions you might ask them. So, people have to teach them a lot before they can start answering questions. Recently, people have made really good models that can answer a lot of different questions really well. For example GPT-3 and BERT.

You probably still wandering but where this information is stored. If we are talking about humans, our knowledge as far as I know in our heads. To answer this question we need a basic understanding of how neural networks work. ...

#ai #chatgpt #languagemodel #deeplearning #machinelearning #datascience

[gennahlopov]

Thanks for simplifying, very helpful explanation

[placidnick]

how did you create the amazing visuals?