Time your A/B tests to get best results

Time your A/B tests to get best results

Always be up to Date subscribe to updates - August 12, 2014

Every time you run a test, think about things you can do to reduce noise- or uncontrollable effects on your data. One thing that is often overlooked is fluctuations caused by the day of the week. Think about it. Many sites enjoy significantly more traffic and more sales on weekdays, while others perform best on the weekends.

<a title= Web site visitors tend to be very different on the weekends and evening, than mid day during the work week. I have seen a lot of activity and responses come from senior management of very large companies. Rarely during the day. Weekends are when these time-stressed executives get to surf.

Say you run a test starting on Monday. By Thursday, you could have a substantial amount of data, pointing to a clear “winner.” The inexperienced tester would begin celebrating prematurely. Along comes the weekend, and what you thought was the winner could end up falling behind. How to avoid this? Always run your tests by the calendar week (yes you can schedule tests in Convert’s A/B testing software). This essentially removes the weekday/weekend fluctuations from affecting your end results.

SUBSCRIBE TO OUR NEWSLETTER

Signup to our monthly newsletter to get the best of our content with the latest
Conversion and A/B Testing resources right in your inbox.

  • 12 Aug, 2014
  • Posted by Dennis van der Heijden
  • 1 Tags
  • 2 Comments

Written by Dennis van der Heijden

Co-founder and CEO of Convert.com passionate in building communities that care. Trying to make that happen inside and outside Convert. I love working with my team to make our A/B testing software better for agencies and e-commerce clients.

CATEGORIES Articles Blogs

[hclightbox id='5' text='Anchor text']