November 2008

Optimizing your site is as easy as A/Bby Steve Lionais
A/B testing is simply comparing one page design (A) against another page design (B) on your web site. Below are the steps to conduct an A/B test.

  1. Identify metrics, what is success to you?
    Typically this is the conversion rate of the page but it can be any relevant metric such as the average visit duration, number of items in a shopping cart, or average order value.
  2. Choose an element on the page to change
    This could include a ‘Contact Us’ form, submit button, text, the headline, images, or colours. However, only choose one element to test in each series.
  3. Change one element in each new page
    Create a number of pages with only one change on each page. Change only one element for each test series. On a Contact Us page,  try changing the number of fields in the form, the layout of the form, the size of the boxes, or pre-populating data, and even the style and size of the submit button.
  4. Deploy the test pages
    Launch the pages and direct traffic from the site randomly to each test page. You’ll need some help from your IT department here to ensure that the user experience isn’t affected and you get a statistically relevant sample on each test page.
  5. Measure the results
    Using your web analytics software measure which variation had the highest conversion rate. This is the winning element.
  6. Repeat with different elements
    Now, you want to repeat the process with different page elements. Eventually you’ll build a highly optimized page.

I bet you’re thinking, isn't this is a lot of work?  Well, it is. That’s why there’s commercial testing solutions that automate much of this process. My favorite is Google Website Optimizer because it offers a robust solution, and it’s free to Google Analytics users. Other paid solutions include Test & Target from Omniture and Personalization from Sitebrand.

These solutions use both multivariate testing and A/B testing methods as well as handling the random page serving process. The multivariate testing method allows you to test multiple page elements at once to figure out which combination is the most effective.

Testing important pages on your web site can have a significant impact on profitability without spending any marketing dollars. Be sure to consider it in your product planning & design strategy.

Bookmark and Share Sphinn
back to issue homepage button
ArchiveD Issues 
November 2011: Tips for choosing an eCommerce solution, LinkedIn company pages, Events as goals
July 2011: What are QR codes, In-Page Analytics, SEO and social media
October 2010: business objectives & emarketing, choosing web content, websites & social media
July 2010: value of website experience, CANSPAM Act, PPC vs. SEO
April 2010: website versioning, anatomy of an email, hold your emarketing campaigns responsible
Winter 2010:
ungoogle yourself, new goal setting in Google Analytics, cleaning up your website
November 2009: wading into Internet marketing, get LinkedIn, greater intelligence from Google Analytics
Fall 2009: Facebook for your business, website analytics, social media trends
August 2009: YouTube for your business, Intranets, benchmarking in Google Analytics
July 2009: choosing a web provider, photo selection, how to use site search
June 2009: hyperlinks, SEO basics, web governance
May 2009: monthly commitment, online business models, designing for scroll
March 2009: internet junkie, dropdown menus, benefits of online measurement
Winter 2009: website resolutions, facebook etiquette, visitor stats
December 2008: social media, campaign performance, PPC ads
November 2008: web marketing, keywords, A/B testing
October 2008: usability, bounce rate, website performance
September 2008: ROI, link building, PPC campaign
August 2008: mobile friendly, top content, corporate blog
July 2008: website = asset, emarketing, can-spam
June 2008: web 2.0, google analytics, landing page