The Macrosite for News, Analysis and Opinion about the Future of the Internet
David Strom

Websites Simplify A/B Testing

Written by David Strom
11/21/2012 23 comments
no ratings
DISCUSS     Email This

It used to be that running two separate home page designs (called A/B testing) was expensive and time consuming, but thanks to sites such as ABtests.com, Optimizely.com, and others, you can submit your site designs almost automatically and inexpensively. Why do this? Because it works. Those who do A/B tests have found ways to simplify their designs, increase click-through and conversions rates, and get more business and satisfied customers.

While it's a simple concept, the execution isn't. According to the folks at A/B testing service Maxymiser:

This is often because any form of testing is wrongly assumed to be very technical, time consuming and difficult to implement; however this is just not the case. When you consider what a key part of the sales equation conversion rate is and how valuable customer insight can be it is surprising that so many people ignore such a simple form of testing.

Some A/B tests show the best way to improve response rates is to just reduce clutter. User experience expert Danielle Cooley has plenty of examples on her blog about how less content is actually a better strategy. She points to many successful examples, such as a redesign of the Norwegian telecommunications company Telenor where it took its site from 4,000 pages to 500 pages and doubled conversions.

At another site for an Irish wine shop, by using Google Analytics and some savvy moves, the store was able to more than double its checkout completions with a simple page design that cut down the number of steps, didn't ask for account creation, and removed other distractions from the shopping experience.

Sometimes A/B testing will reveal radical ideas. In a test for Vendio, ABtests found that including a sign-up form on the home page was actually a bad idea. Once they moved the signups to a button, Vendio saw an increase of 60 percent (see image below).

Before and After
In these pictures, you can see the results of A/B testing done for Vendio.
In these pictures, you can see the results of A/B testing done for Vendio.

So let's get started. You first need a clear picture of what is wrong and what you want to change on your site. Is your home page too cluttered? Does it take your online visitors too many clicks and menu choices to get to your most popular content or products? Are too many purchases being abandoned before people pay for them?

Once you figure this out, you then need to properly test your A/B to ensure you can understand the effect of your changes. You also have to change just one aspect of your site at a time; otherwise you can't really track the causes of the resulting page view numbers. You'll find a good explanation of the steps involved at SearchEngineWatch.

And while we have just looked at Website design, there are lots of other areas of opportunity for A/B testing, including testing email campaigns. A good place to start learning about this concept is a tutorial from MailChimp.

ABtests.com is free, but you must agree to share your results in public. Optimizely.com has a basic monthly plan for less than $20. Good luck with your tests.

David Strom is a world-known expert on networking and communications technologies. He has worked extensively in the IT end-user computing industry and has managed editorial operations for trade publications in the network computing, electronics components, computer enthusiast, reseller channel, and security markets.

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 3   Next >
nimantha.de
IQ Crew
Friday February 15, 2013 10:58:05 PM
no ratings

Very true Usman and that is why it is always been asked to keep design simple as much as possible. Most of us try to load heaps of data to make things more visible in a single page but that is wrong.

Alison Diana
Thinkernetter
Friday January 18, 2013 10:03:13 AM
no ratings

I wonder how many businesses conduct tests, percentage-wise. When I ask IT execs this question, many say their company didn't do it before they came on board, leading me to believe that it's a large number that don't invest in this technology and time. When I interviewed Michael Hart of Bonobos about testing, he said it added about a week to the process and that was for a major redesign. Think about the time you'd lose if the site kept crashing or users couldn't find the shopping cart, couldn't complete their order, the credit card information wasn't secure, or some other nightmare scenario. In addition to losing time, you could -- far worse -- lose customers forever. And when Bonobos' site crashed on Cyber Monday 2011, ask the former CTO (not Hart) whether testing might have been worthwhile! I'm sure he'd say, "Yes!" Hart implemented testing. The result: Cyber Monday 2012 had zero downtime.

sarahp
IQ Crew
Friday November 30, 2012 11:57:47 PM
no ratings
Very interesting! I always wondered how websites did that, but it now appears not to be secret! However, with that being said I do agree with Alison on the simple fact that websites do that way too often. If it ain't broke, why fix it then?

 

nimantha.de
IQ Crew
Friday November 30, 2012 3:50:10 AM
no ratings

I guess everything depends on the tools you use. If the tools have the standards clearly defined plus implemented, then you win.

smkinoshita
Thinkernetter
Friday November 30, 2012 12:35:25 AM
no ratings

I agree that simple is good, but don't forget to focus on testing!  Testing is fantastic, and with intelligent use of analytics and event tracking one can really ensure users have a great web experience while generating the most conversions possible.

Alison Diana
Thinkernetter
Tuesday November 27, 2012 10:22:15 AM
no ratings

One problem I've found is the tendency by some companies to almost weekly change their Websites. Now, that might be a slight exaggeration--but it's not much of one. That's something commonsense, not any amount of testing, can restrain.

slfisher
Thinkernetter
Monday November 26, 2012 3:07:55 PM
no ratings

It's not whether the site should be more complex or more simple or whatever, but that you should be testing it with *your* users to see what works for *them*.

I had the opportunity to interview Greg Linden, who was involved in some major sites such as Amazon, and he swears by A/B testing -- and not just that, but giving everyone in the company the opportunity to set up quick and dirty A/B tests and doing them all the time.

DavidSilversmith
Thinkernetter
Sunday November 25, 2012 7:37:39 PM
no ratings

I first ran A/B tests on a fairly high traffic (60 million unique a year) website in the last century and it was hard and it was expensive in terms of development hours.  

It has certainly changes in the last 15 years.  Today I am using Optimizely and I continue to be amazed by the ease of use.  Omniture has some expensive and hard to implement tools that pale by comparison to Optimizely.

Today you truly have affordable, easy to use and powerful A/B testing options - there is no excuse not to run A/B tests!

syedzunair
IQ Crew
Sunday November 25, 2012 9:35:09 AM
no ratings

kiranIE:

The interface should be designed to allow users to do the routine tasks from the home screen while advanced functions should be available on the next screens. 

Giving users the options of personalizing (in terms of menu's and options) is great. It will help them manifolds. Though I think that only the option of changing colors and layout would not help that much. 

jabailo
IQ Crew
Saturday November 24, 2012 8:47:29 PM
no ratings

But often it is not complex design, but too simple design.

Again, look at the best used portal websites...the ones that host millions of users per day.  Craigs List.   Yahoo.   Google News.   Facebook.  Twitter.  They are both clean, clear, and yet intricate and chock full of clickable links, database sorting.

What is it they don't have?  A huge block image that fills the screen!   Or else, a few paultry links that a user soon grows tired of!

Page 1 of 3   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from David Strom
David Strom
David Strom   3/13/2013   18 comments
These days, 3D printers seem to be everywhere. You can build your own, go to one of the TechShops around the country, and maybe even find a pop-up store like the one that came to midtown Manhattan in December and offered dozens of objects for sale, along with the opportunity to watch several printers in action creating them.
David Strom
David Strom   3/8/2013   22 comments
Entrepreneurs recently flocked to Kansas City for an experimental implementation of Google gigabit fiber. The Kansas City Startup Village (KCSV) is using that fiber, and Techstars co-founder Brad Feld is getting into the act by buying a home where entrepreneurs can live and work.
David Strom
David Strom   2/12/2013   13 comments
Last week, NBC shuttered the hyperlocal news portal EveryBlock.com, and laid off its few full-time staffers. The decision was a poor one, and a blow for civic activists all over. It's a shame, given how many examples of great civic science there are.
David Strom
David Strom   1/29/2013   36 comments
Has this happened to you? I was staying at a hotel where the WiFi creates one flat network, and, of course, there are numerous people who don't know the first thing about basic security practice. Why do I know this? Because I could see several of them who had file sharing turned on for their PCs. They were listed by name in my Mac's Finder (John Jones Computer, Sally Jenkins Computer, and so on), and it was a bit scary.
David Strom
David Strom   1/18/2013   48 comments
Over the holiday break, my wife and I had two memorable experiences when we went to Morton's and the Olive Garden for dinner. These chain restaurants sit at different ends of the market, and we had very different experiences -- but not in the way you might expect.
5
of
Mitch Wagner
TweetDeck Gets a Second Life

11|5|12   |   9:54   |   13 comments


A recent release of the popular TweetDeck app for Twitter power-users gives new life to software that had previously taken a wrong turn. Here's a quick walk-through of the new TweetDeck, to show you why it should be at the top of your Twitter toolkit.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Alison Diana
Striking a Balance for Website Upgrades

1|24|13   |   1:59   |   3 comments


Companies need to take advantage of new technologies to simplify interfaces, improve capabilities, and enhance back-office processes. But they can't upgrade their Websites too often.
Wisdom of the Big Chair
Price, Not Features, Driving Smartphone Sales

11|29|12   |   2:01   |   7 comments


A survey by JD Powers found that customer interest in product features is lessening as phones evolve. Rather than features, price is driving purchases, and that change could have a dramatic impact on how IT departments secure these devices.
Reiter's Block
IT Should Evaluate On-Screen Keyboards

7|19|12   |   3:01   |   9 comments


On-screen keyboards are getting a lot more complicated, and IT departments should consider evaluating them.
Marketing Takes
Picturing the Next Digital Marketing Wave

6|27|12   |   4:25   |   7 comments


Bob Lisbonne, CEO of Luminate, discusses the rise of images on the Web and the opportunities they afford publishers and digital marketers.
Reiter's Block
The New Looks of Cellphone Operating Systems

12|3|09   |   2:49   |   3 comments


Companies used to be confident they'd know exactly what a cellular OS would look like out of the box. Today, that confidence should be fading. Reiter discusses how a cellphone OS's looks could be deceiving, and why businesses need to understand it.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE