Qualaroo A/B Testing Intuit and Groupon Against Uber and Shopify

Qualaroo A/B Testing Intuit and Groupon Against Uber and Shopify

A/B testing blinking

Running A/B tests that users can see are not helpful as we already proven in 2012 when we detected an 18% drop in conversion rate when users were able to see the changes happen right in front of their eyes. Today I noticed that Qualaroo was testing, since I noticed a strange blink on the customer logo section. When I did a hard-refresh I noticed Intuit and Groupon were replaced with Uber and Shopify logos. We know some A/B testing software tools make changes slower but it’s important to point out that this should be part of your Q&A.

Back in 2012 we noticed that hard-coding tests on the client site brought us 18% more conversions compared to our Convert Experiment Javascript at that time.  Since it takes 13 milliseconds for a person to process images and 180 milliseconds before a person is really focusing on any element we know that the speed of making the changes is super important and that is why we started using our pending patented technology to make changes before the DOM-ready event.

See here the video on what happens at the website and why you should be doing good quality checks before putting the A/B tests live. In short use great A/B testing software that does not have this problem.

Originally published January 14, 2015 - Updated September 25, 2015
Dennis van der Heijden
Co-founder and CEO of Convert.com, Dennis is a passionate community builder and out of the box thinker. He spends his time innovating to make Convert Experiences better. Learn about his journey as an entrepreneur and leader on the SaaS Club podcast.
Guest Post Form

We have brought thought leaders, influencers, visionaries and veterans to our tribe. Now it’s your turn. If you have something worthwhile to share with a large community of savvy testers, go ahead and pitch your post idea. We’re listening.



[hclightbox id='5' text='Anchor text']