Three Common Problems with A/B Testing, for Ecommerce

Three Common Problems with A/B Testing, for Ecommerce

Lemuel Galpo
Written by Lemuel Galpo
February 17, 2015

This post by Armando Roggio explores the most common problems with A/B testing, as it relates to Ecommerce. The article also shows us why marketers should really wait for the results of their A/B testing tool, before making any drastic changes.

It touches on patience in online marketing. Despite our eagerness to make the new changes to our website as soon as possible, it is still wise to wait one buying cycle before deciding to make a change. This ensures us that you have all the relevant data from the test to make an informed decision. So even if the standard suggestion would say 7 days, if your buying cycle is 40 days, you still have to wait 40 days if you want to measure the impact on revenue, and how to apply the results for changes to your site, whatever standard practices say.

Armando touches three very important topics:Practical Ecommerce

  1. Random Fluctuation
  2. Not Examining the Data for Unexpected Differences
  3. Testing Too Many Variables

Check out the full article in PracticalEcommerce

Originally published February 17, 2015 - Updated April 15, 2019
Lemuel Galpo
As Customer Content Manager, Lem is responsible for bringing learnings in conversion optimization and testing to the world. He is part of's growth team and coordinates all writers, editors and illustrators.
Guest Post Form

We have brought thought leaders, influencers, visionaries and veterans to our tribe. Now it’s your turn. If you have something worthwhile to share with a large community of savvy testers, go ahead and pitch your post idea. We’re listening.



[hclightbox id='5' text='Anchor text']