Three Common Problems with A/B Testing, for Ecommerce

Three Common Problems with A/B Testing, for Ecommerce

Always be up to Date subscribe to updates - February 17, 2015

This post by Armando Roggio explores the most common problems with A/B testing, as it relates to Ecommerce. The article also shows us why marketers should really wait for the results of their A/B testing tool, before making any drastic changes.

It touches on patience in online marketing. Despite our eagerness to make the new changes to our website as soon as possible, it is still wise to wait one buying cycle before deciding to make a change. This ensures us that you have all the relevant data from the test to make an informed decision. So even if the standard suggestion would say 7 days, if your buying cycle is 40 days, you still have to wait 40 days if you want to measure the impact on revenue, and how to apply the results for changes to your site, whatever standard practices say.

Armando touches three very important topics:

  1. Random Fluctuation
  2. Not Examining the Data for Unexpected Differences
  3. Testing Too Many Variables

Check out the full article in PracticalEcommerce


Signup to our monthly newsletter to get the best of our content with the latest
Conversion and A/B Testing resources right in your inbox.

  • 17 Feb, 2015
  • Posted by Lemuel Galpo
  • 1 Tags
Lemuel Galpo

Written by Lemuel Galpo

As Customer Content Manager, Lem is responsible for bringing learnings in conversion optimization and testing to the world. He is part of's growth team and coordinates all writers, editors and illustrators.

CATEGORIES Articles Blogs

[hclightbox id='5' text='Anchor text']