How Long Should You Run Your A/B Tests For?

preview_player
Показать описание
If you want to improve your conversions you have to run A/B tests. But how long should you run them for?

The first thing you have to look at is statistically significant. If you are using tools like Crazy Egg, it will tell you which variation of your tests is performing better and by how much.

Once you have a 99% statistical significance, you can then make the winning variation the default.

The second thing you have to do is run your tests for at least a week. Traffic that you get after working hours or on weekends isn't the same as peak hour traffic. For that reason, you need your tests to be live for at least a week.

Lastly, you need at minimum of 100 conversions per variation before you decide which one you are going to declare the winner.

Now, when following these tips you can't just follow one, you have to follow them all of them if you really want your conversions to go up.
Рекомендации по теме
Комментарии
Автор

Wonderful advice as always. Thanks Neil!

IrfanBaqui
Автор

Hello Neil my company run sell house business and i think it's hard to get 100 conversion like e-commerce or shopping

Can you advise me something. like reduce expect conversion or the day I should test ab or anything . Thank you

tailOverly
Автор

Situation: After I get the result for an A/B Test and I want to test something new based on the winning ads.


Question: should I just let the winning ads keep running and make a new ad against the current winning ads or do I kill these winning ads and make new ads for A/B testing even one of the ads is the same as the winning ads?


I am asking because I don't know if I let the winning ads keeping running and make a new ad against the current winning ads will have accurate data. thank you

Chris-smqo
Автор

Neil, silly question but does a higher da naturally raise traffic? I always see da 40 plus sites that rank for my keywords with very little to no backlinks :/

xxTheBorgstaxx
Автор

Hi Neil, good video, what is your take on a/b tests if it's a small site with low traffic volume / really niche. Still wait it out for the data?

milco
Автор

Hey Neil, why don't you club Hello Bar & Crazy Egg as a single product? :)

freshmindideas
Автор

Lol.... most misleading video ever.... this guy has no idea about ab testing and somehow he has a book about it

oliverpaton
visit shbcf.ru