When your e-tail site crashes on Cyber Monday, it's as if your bricks-and-mortar store locked its doors and told employees to stay home: No one can enter, no one can shop, no one can spend money on your goods.
So when Bonobos, an online purveyor of men's tailored clothing and accessories, suffered through unexpected -- and definitely unwanted -- downtime on what's touted as the biggest online sales season of 2011, newly appointed CTO Michael Hart knew something had to change. Fast.
Having come on board only three weeks prior to Cyber Monday 2011, Hart had limited time to prepare for that year's virtual onslaught. But he knew the site had to perform flawlessly in 2012, and he immediately began fine-tuning the e-tailer's system. However, Bonobos had no way to simulate the hundreds of thousands of simultaneous shoppers expected to visit its site during the hectic holiday season.
That is, until Hart turned to Soasta, developer of mobile and web testing solutions, which was recently awarded a patent for Cross-Cloud Grid Provisioning, which enables access to 500,000 servers across the world, simulating hundreds of thousands of users accessing a single app or website simultaneously.
The result? On Cyber Monday 2012: "We handled record sales that day without having any performance issues," Hart told me.
On that day, Bonobos handled 15 times its normal volume of business, said Hart. It's apparent why performance is so crucial.
That's just one day. In the days following you've got the big Christmas buying rush so there's a lot of money on the line.
Hart knew of Soasta based on prior experience with the solution at a prior employer.
We definitely considered looking at alternatives, but there wasn't anybody out there. It was the only option available to us. I haven't surveyed the landscape recently to be honest, but in a lot of ways I don't have a lot of reasons to do so. The ability to easily create test cases and execute them at a reasonable price makes it a no brainer for us.
Of course, every day isn't a crisis, but that doesn't mean Bonobos doesn't turn to Soasta year-round. The company relies on the technology to test its website each time it makes any kind of revision, Hart said. He spends about two to three man-weeks annually improving, maintaining, and running stress tests on the site, he told me.
We get great performance stats out of the system. That's useful for identifying general bottlenecks. It's worth noting if we can assure we're up on our biggest day of the year it's highly likely we're up for the rest of the sales days. The nice thing, too, is we do make a lot of system changes throughout the year and being able to confirm we haven't hurt the system is great.
Surprisingly, many e-tailers don't test their sites after adding new features or launching a new URL, said Hart, whose background is at technology organizations. Bonobos, for example, didn't do this before he joined the company, he said. In some cases, businesses may be overly confident in their sites' capabilities, Hart surmised.
I come from a world where you always assume failure. It's a different mindset. A lot of it could be simply misunderstanding how much load you're going to get. Even we were a little off in our projections. In our case we went beyond what our estimates were, just to be safe. It comes down to your sense of precaution, how accurate your projections are.
Testing doesn't add much longer to the process: In Bonobos' case, it made some "fairly extensive" changes and it took about a week to test the enhancements, Hart said. That extra few days surely paid off in satisfied customers and full shopping carts.
Three weeks into the job, it's Cyber Monday, and the site is down? That's a real trial by ordeal! It's to Bonobos credit that they saw it wasn't his fault and kept him on.
Bonobos didn't have any of the necessary tools in place, from the sound of it. He brought in testing tools and was able to do some of that before Cyber Monday 2011, but physically just didn't have the time to go beyond that. I believe (although he didn't say this) the site's lack of preparedness was one reason for a change of IT management!
And I thought this article might be about monkeys. Bonobos isn't the first to be caught by errors when changes are made. And won't be the last. It's testing testing testing that will keep people on their toes while keeping clients and customers happy.
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
Enterprises are embracing open-source to avoid vendor lock-in, get better-quality software, and gain access to larger libraries of applications. In return, they may be putting themselves at risk for higher, more complex support costs.
Whereas some businesses search externally when they need a CIO, Choice Hotels had to look only at its CTO for someone with the necessary expertise, industry knowledge, and technological know-how to continue leading the company's embrace of enabling technologies.
Local social media can be powerful marketing tools, but they can't just be add-ons. They need to be tightly integrated into the corporate culture, according to Whole Foods social marketers.
Sequestration has only highlighted the financial stranglehold that many federal IT executives are forced to address, yet some agency leaders are using these budget-strapped times to jump-start innovation.
A recent release of the popular TweetDeck app for Twitter power-users gives new life to software that had previously taken a wrong turn. Here's a quick walk-through of the new TweetDeck, to show you why it should be at the top of your Twitter toolkit.
Companies need to take advantage of new technologies to simplify interfaces, improve capabilities, and enhance back-office processes. But they can't upgrade their Websites too often.
Facebook's Graph Search may face some profound challenges and risks, first, because Facebook users haven't been thinking of their posts as product reviews; and second, because Facebook will now have to contend with the social-network equivalent of SEO "gaming" of results.
A survey by JD Powers found that customer interest in product features is lessening as phones evolve. Rather than features, price is driving purchases, and that change could have a dramatic impact on how IT departments secure these devices.
"Social Enterprise" is an increasingly trendy term, and Salesforce.com has been leading the way. At its Dreamforce conference last week, the theme was clear: From here on, enterprise applications must have social capabilities built in.
As enterprises leap into the Web 2.0 world of blogging, commenting, and social networking, just 'being there' won't deliver ROI. You may want a 'Web Evangelist' to systematically harvest the feedback in order to polish your product or service.
More companies are trolling social networks to find and vet potential job candidates. Beware the pitfalls of blurring the line between personal and professional lives.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Subsidized handsets, rather than locked handsets, should be the focus of regulators. We're not getting good deals, not fostering innovation, and weakening our power as buyers.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.