A/B Testing in Data Science Interviews by a Google Data Scientist | DataInterview

====== ✅ Details ======

🤔 Ever wondered how to ace the A/B testing questions in data science interviews?

Explained by Dan, a former data scientist at Google, explains how to design an A/B test based on a real-life example. The procedure and tips covered in the video are insightful for data science interviews at top companies such as Google and Meta.

====== ⏱️ Timestamps ======

0:00 Intro
1:02 7 Steps in AB Testing
3:02 Step 1 - Problem Statement
4:44 User Funnel
6:09 Success Metric
8:06 Step 2 - Hypothesis Testing
9:41 Step 3 - Design the Experiment
11:34 Step 4 - Run the Experiment
12:32 Step 5 - Validity Check
15:13 Step 6 - Interpret Results
16:13 Step 7 - Launch Decision

====== 📚 Other Useful Contents ======

1. Principles and Frameworks of Product Metrics | YouTube Case Study

2. How to Crack the Data Scientist Case Interview

3. How to Crack the Amazon Data Scientist Interview

====== Connect ======

[SM-gfux]

Dan - watching your videos helped me land a data scientist position at a FAANG company. So grateful for your knowledge and your ability to share it with a wide audience :)

[adazhu]

This is the best video I’ve seen about A/B testing. This is exactly a day to day DS work in tech companies. I very appreciate your sharing and looking forward for your new videos. Wishes you all the best!

[HussainShamsu]

The best video on A/B i have whatched so far, Thank you Sir❤.

[ml-]

This is a great video step-by-step explanation and logics through the A/B testing setup! I am a recent DS bootcamp graduate and was struggling with this topic and this video helped tons! Thanks Dan

[TadBitGains]

I was asked a similar A/B testing question on a Data Science interview with LinkedIn. Had I seen this video a week prior, I would’ve made it to the 3rd round. Better late than never. Great content! I just subscribed.

[blueberryblue]

Your English pronunciation is the most comfortable and tolerable throughout YouTube. Thank you so much for that. You saved my life.

[grabngoinfo]

This is one of the best videos about AB testing interview prep on YouTube. Great job and thanks for sharing!

[kangel]

Hmmm, revenue per day per user. That seems much more variable than conversions per user sessions, which is binomial with bounded variance. Especially for clothing on an ecommerce site that isn't Amazon. Can you help me understand why you chose this as the primary success metric?

[navkaransinghbrar]

🎯 Key Takeaways for quick navigation:

00:00 *🎯 AB testing is vital for data science interviews at top companies.*
01:09 *🛠️ Seven steps of AB testing: Understand problem, define hypotheses, design experiment.*
03:00 *🛍️ Example: Designing experiment for an online store, clarify success metrics.*
05:31 *📊 Success metrics must be measurable, sensitive, and timely.*
08:00 *🧪 Establish hypotheses, set significance level, plan experiment.*
09:38 *📐 Design experiment: Determine sample size, run for 1-2 weeks.*
11:30 *🕵️ Check validity: Perform sanity checks, ensure randomization balance.*
14:44 *📈 Interpret results: Analyze metric direction, P-value, and confidence interval.*
17:23 *💡 Make decisions: Evaluate scenarios based on lift and confidence intervals.*

Made with HARPA AI

[hemalitanna]

I am a product designer, and this is so great to learn. Thanks for explaining it in detail in a simple to understand way!

[phamvinguyen]

This is the best video about A/B testing in practice I've ever seen. Thank you for sharing

[TheYashRathi]

This is such a great video. This video is enough when you are preparing for analytics experimentation interviews

[surekhakatreddy]

A very detailed explanation to get started on A/B Testing. Thank you so much.

[ayushsengar]

Which statistical test did you use to get the p-value while interpreting the results

[shivanshugupta]

Can you explain same concept using jupyter notebook where you are following all the concepts that you talk in this video.?

[Pinkgal]

Incredible video !!!! Presented clearly and takes you through the entire process

[vaibhavgedigeri]

This video literally made me subscribe to you channel Dan! I have gone through countless materials and research papers on experimentation and by this is one of the best summary of the steps! Great work and I am excited to see more videos from you(especially around pitfalls for multiple metrics and more)!

[iLoveTurtlesHaha]

Bro I have an interview in the morning and your video is giving me the confidence I need to go through with it. 😅

[OlgaKarpukhova]

The best video about A/B testing, definitely!

[ustckewen]

Thank you very much, Dan! Very Helpful.