Qualaroo A/B Testing Intuit and Groupon Against Uber and Shopify

Qualaroo A/B Testing Intuit and Groupon Against Uber and Shopify

Always be up to Date subscribe to updates - January 14, 2015

Running A/B tests that users can see are not helpful as we already proven in 2012 when we detected an 18% drop in conversion rate when users were able to see the changes happen right in front of their eyes. Today I noticed that Qualaroo was testing, since I noticed a strange blink on the customer logo section. When I did a hard-refresh I noticed Intuit and Groupon were replaced with Uber and Shopify logos. We know some A/B testing software tools make changes slower but it’s important to point out that this should be part of your Q&A.

Back in 2012 we noticed that hard-coding tests on the client site brought us 18% more conversions compared to our Convert Experiment Javascript at that time.  Since it takes 13 milliseconds for a person to process images and 180 milliseconds before a person is really focusing on any element we know that the speed of making the changes is super important and that is why we started using our pending patented technology to make changes before the DOM-ready event.

See here the video on what happens at the website and why you should be doing good quality checks before putting the A/B tests live. In short use great A/B testing software that does not have this problem.

Originally published January 14, 2015 - Updated September 25, 2015


Signup to our monthly newsletter to get the best of our content with the latest
Conversion and A/B Testing resources right in your inbox.

Written by Dennis van der Heijden

Co-founder and CEO of Convert.com passionate in building communities that care. Trying to make that happen inside and outside Convert. I love working with my team to make our A/B testing software better for agencies and e-commerce clients.
Guest Post Form

We have brought thought leaders, influencers, visionaries and veterans to our tribe. Now it’s your turn. If you have something worthwhile to share with a large community of savvy testers, go ahead and pitch your post idea. We’re listening.

Fill out our guest post form


[hclightbox id='5' text='Anchor text']