A/B testing - Statistical significance for beginners

preview_player
Показать описание
In this video, I explain Statistical Significance in very simple terms.
I also make a numeric example to give you a better grasp of this concept.
  1. ABoptimization
  2. A/B testing statistical significance for dummies
  3. statistical significance
  4. a/b testing
  5. statistical significance explained
  6. statistical significance a/b test
Рекомендации по теме
A/B testing - 0:02:56

A/B testing - Statistical significance for beginners

A/B Testing Course 0:04:38

A/B Testing Course 014: Statistical significance, confidence level and the certainty of your results

A/B Testing Statistical 0:01:30

A/B Testing Statistical Significance Explained!

Statistical Significance and 0:08:57

Statistical Significance and p-Values Explained Intuitively

What is A/B 0:03:43

What is A/B Testing? | Data Science in Minutes

A/B Testing & 0:11:08

A/B Testing & Statistical Significance - 4 Steps to Know How to Call a Winning Test

Simple explanation of 0:05:49

Simple explanation of A/B Testing

What is statistical 0:05:59

What is statistical significance in an A/B test? (w/ Calculator)

Attention Economics Explained 0:51:46

Attention Economics Explained 101 (A/B testing) part 8- by Akshita Bindal

How to MEASURE 0:01:01

How to MEASURE an A/B TEST

You Ask, I 0:08:00

You Ask, I Answer: Statistical Significance in A/B Testing?

Understanding A/B test 0:33:49

Understanding A/B test analysis by simulating data - Dennis O'Brien - SF Python Meetup - Feb ...

A/B Testing in 0:20:14

A/B Testing in Data Science Interviews by a Google Data Scientist | DataInterview

A/B testing: How 0:02:23

A/B testing: How to determine the P-value - Chad Sanderson at CXL Live

What is Statistical 0:01:20

What is Statistical Significance in an A/B Experiment?

AB Testing For 0:07:11

AB Testing For Designers - 12 - Statistical Significance

Is statistical significance 0:04:31

Is statistical significance important when A/B testing?

Advanced A/B Testing 0:45:40

Advanced A/B Testing with Dima Popov | Tomi.ai | Statistical Significance | Messaging

Calculating Statistical Significance 0:03:04

Calculating Statistical Significance for Your A/B Tests

p-values: What they 0:11:21

p-values: What they are and how to interpret them

P-values and significance 0:07:58

P-values and significance tests | AP Statistics | Khan Academy

A/B Testing 0:02:51

A/B Testing

Statistical significance: 80%? 0:07:06

Statistical significance: 80%? 95%? 99%? What's the right confidence level? (A/B Testing Statis...

How Can You 0:03:58

How Can You Ensure Statistically Significant Results in A/B Testing? - TheEmailToolbox.com

Комментарии
Автор

I have 2 tests i ran on the same "change" one AB test with a broad goal criteria (ex all devices) and another AB test with anarrow criteria (ex. tablet traffic) - the broad had 10.000 conversions and a slightly lower CVR. (70% significance) The narrow had a bit higher CVR. (95% significance) but also much fewer samples. What would you then conclude is winning? 1000 (95% signif.) vs 10.000 (70% signif.) ? It seems like the formula is not bulletproof when very low sample sizes can get very high significance just because they show more extreme results.

PhilipThonbo
Автор

This is really nice explanation, thank you

MarvinTokhai
Автор

Could you please explain multivariate statistical A/B test?

DillipRout-hmjk
Автор

Very nice and clear explanation on how to use the tool. However, they have a sample size calculator that for the same experiment you're doing, says you need way bigger samples... What should we do?

Guilopes
Автор

A/B test idea: Just change the word in the title from 'dummies' to 'beginners.

GaganKPolska