Ace A/B Testing Interview Question: A Data-driven Approach for Data Scientists

In this video, we'll look at the top A/B testing interview questions for data scientists, and how to tackle them using my data-driven approach. Using the most common type of A/B testing question as an example, I'll walk you through the steps to convince hiring managers of your knowledge and abilities in dealing with these problems.

🟢Get all my free data science interview resources

// Comment
Got any questions? Something to add?
Write a comment below to chat.

// Let's connect on LinkedIn:

====================
Contents of this video:
====================
00:00 Introduction
00:52 A/B Testing Cheatsheet
01:13 Challenges You Might Face
02:36 My Videos on A/B Testing
02:55 How to Practice
03:23 Data-Driven Method
04:08 Top A/B Testing Interview Questions
06:08 The Design Question
07:49 Refresher
08:08 How to Answer Design Questions
09:59 Recap

[杨玄-vk]

The total length of the video is 10 minutes, but it's not until the fourth minute that it starts to cut to business...

[pikakac]

Thanks for the video Emma. As someone who’s learned AB testing on the side (thanks to your video and some courses I took) but haven’t done it in a job, I’ve encountered job applications that asked if I had real-world A/B testing experience. I believe answering no would lead to automatic rejection. How should we deal with this type of questions?

[brunovieira]

I get the point that anyone can learn A/B test stuff by themselves, but It is such an awkward situation when the interviewer asks to tell some real situation and you just can't because you have never come across this problem. what do you recommend in these situations? Is it something that people can add to their portfolio with a toy problem? What do you think?

[EmilyHoughKovacs]

What is the link to the Data Science Interview 2023: How To Prepare When Time Is Tight video explain data-driven methods? I can't seem to find the exact video on Youtube. Thanks.

[yuanzhang_mia]

Hi, I like this video! But the A/B Testing Cheatsheet link doesn't work. Could you please update the links, thanks!

[JJZhou-el]

Hi, Emma, thanks a lot for sharing the information, as i observed you categorized your videos into different playlist, for example, this one under A/B testing, inside the playlist, is there any order we need to follow to better gain the insights?

[operagreen]

想给emma提醒一下小红书上有人把你总结的材料到处发 不知道算不算侵权 ‘jasper老师-ds求职’

[dikshitapadte]

I am not able to get access to the cheatsheet after visiting the website. Can you please guide me how to do that?

[austinhoag]

If we are A/B testing a referral program, like you suggested, and the metric is the rate at which new users sign up, the idea of a control group is somewhat confusing to me. If the treatment group is some users to whom we give the ability to refer users, then the control group must be a group of users to whom we do not give the ability to refer. Let's say we run the test for 2 weeks and measure a rate of X new user sign ups per hour with the referral program active, we could just compare that to the baseline new user sign ups per hour before we ran the test. But this does not use the control group at all. I don't see how to turn this scenario into an A/B test.

[rudroroy]

A/B testing seams like a resource consuming testing. Are there any alternatives? maybe something more automated?

[mandeepgulati]

It feels more like a promotional video for the channel. no real content

[Kheekhee_khakha]

Really bad video. Keeps iterating the same thing.