Design ChatGPT - System Design Mock Interview (with eBay EM)

An eBay engineering manager, builds ChatGPT during a system design mock interview. He identifies the requirements and constraints for building a robust chatbot system that can handle millions of users and transactions.

Chapters (Powered by ChapterMe) -
00:00 - Design ChatGPT with Functional Requirements
00:53 - ChatGPT operation feedback for good functional requirements
01:24 - Nonfunctional requirements for chat architecture
03:26 - Server receives 200 million messages per day
03:53 - Server, storage, scalability requirements
04:51 - High level design with consistent user experience
07:14 - Machine learning model for obscenity detection
08:24 - API ChatGPT model, database, messages
10:14 - Rough design for messaging simplicity
11:14 - Multiple ways to ask thumbs down
11:51 - Sending model to GPT for training, avoiding malicious users
13:32 - Operations and APIs in conversation service
14:09 - Create, view, delete, send messages
15:33 - Retrieval of messages in conversations
16:17 - Sending and receiving messages in Messenger
17:08 - Grid-based messages with ID generators
20:29 - Multimessage conversation model with parent
22:09 - GPT model with variety of questions and answers
22:55 - System design uses and examples
27:34 - Databased AI training with questions and answers
29:05 - Reinforcement learning in system design training
33:14 - Reward model continuously trains
33:42 - GBT building overview, final thoughts

Watch more system design videos here:

ABOUT US:
Did you enjoy this interview question and answer? Want to land your dream career? Exponent is an online community, course, and coaching platform to help you ace your upcoming interview. Exponent has helped people land their dream careers at companies like Google, Microsoft, Amazon, and high-growth startups. Exponent is currently licensed by Stanford, Yale, UW, and others.

Our courses include interview lessons, questions, and complete answers with video walkthroughs. Access hours of real interview videos, where we analyze what went right or wrong, and our 1000+ community of expert coaches and industry professionals, to help you get your dream job and more!

[zeroflame]

I think this is missing the most important and definitely most difficult part of this model design. How do you scale the ChatGPT model for inference?

[johnhobe]

Its interesting that the first thing he thinks about is how to do sensorship. I was about to go off, but they won me over by talking about the chatgpt model int the last 12min 😂

[tylersnard]

A question: when you send a message, you return a message ID, but you don't talk about what happens to ChatGPT's response to the user's question. Does it get shown to the user at some point?

[pavanpandya]

Amazing Video. I got to learn a lot. Looking forward to more such mock interviews.

[hariharan-svfj]

If we design the AI model as what will the researchers at Stanford and Oxford do 🤣🤣

[subhashismohanty]

Wondering if the interviewee came prepared for this question or its spontaneous :) just kidding. great content and great share. Kudos

[thesumitsingh]

He went deep into the ML part as well. Is that also required for Sys Design interviews? What if I am not familiar with the ML concepts like reward model, supervised fine tuning etc?

[andiyhuandy]

Very helpful video! I was wondering which platform did you use to create the mindmap?

[Kate-pvcv]

Why does thumbsupthumbsdown use the message ID that is sent by a user? Shouldn’t it apply to the chatGPT’s response? Am I missing where the “answer” is? At some point we should GET a message too? 🤔

[animal-haven-fv]

Wow! awesome topic and realy deep dive explanation

[Ravikumar-jubg]

What was the tool used to draw in the video ?

[guryashsingh]

Which software are you using for diagrams?

[afraz-khan]

awesome video, I have never worked with ML, no idea of any piece in the last section where he explained the ChatGPT models setup. Just wondering how to tackle such blank areas in an interview?

[InvincibleMan]

I ddn't know that, Puneet super star became EM and knows system design