As Hurricane Sandy blew its way up the Eastern seaboard, it knocked out Datagram, the New York company that hosts Buzzfeed, the Huffington Post, and Gawker sites, among others. The Huffington Post and Buzzfeed appear to be back to business as usual, but Gawker's banner proclaims that it's a "backup" site.
Meanwhile, the big cloud providers weathered the storm with little or no downtime.
Apple, Amazon Web Services, and Rackspace prepared for Sandy's wrath, and it showed. According to its status page, Apple's iCloud went down on Tuesday, bringing down the game center for all users and FaceTime and iMessage for some. However, services came back up again quickly. Amazon Web Services experienced short disruptions to two of its services, CloudFront and EC2, but those disruptions were resolved in a matter of hours. Rackspace had a chat outage, some latency with Cloud DBaaS, and a few problems with Cloud Sites -- also resolved in a matter of hours.
Google escaped unscathed. It was even able to provide Sandy-related resources, such as a crisis map advising where to find hospitals and shelters in the wake of the storm. The Google Apps status dashboard lists no outages, even though one of Google's datacenters is in North Carolina, right in Sandy's path.
Google posted public alerts on Google Search and Maps during Hurricane Sandy. (Source: Google screenshot)
As for Datagram, it did have emergency systems, according to the official statement on its Website. However, those systems weren't enough protection from the basement flooding, which required Datagram to shut down all systems to avoid permanently damaging its equipment and possibly burning down the building. The Datagram Website says there wasn't any infrastructure damage. As of Oct. 31 at 1:55 p.m., Datagram was waiting for an update from Con Edison. It is providing backup services to customers from its Connecticut facility.
We could play Monday morning quarterback and say Datagram should have had its failover ready to go if the New York site went down. It can't use a rollup generator until Con Ed says it's OK. That is hampering its efforts to bring service back. And in New York, the situation is pretty disastrous: flooded subways, widespread power outages, lines several blocks deep just so residents can charge their cellphones in cafes. In a CNBC report,
Buzzfeed CEO Jonah Peretti didn't blame Datagram for the outage. "They are good people and are working very hard to deal with this once in a hundred years situation," he said.
I sent Gawker an email, but so far I have gotten no response. Since the company is based in New York, its executives are probably among the people queued around a Starbucks waiting for a power outlet.
Overall, the cloud service providers kept their datacenters from failing. Customers who relied on their service providers experienced minimal service disruptions, if any, because the providers were prepared for the storm. There is no doubt that Datagram did its best to prevent an outage, but there is no way it could have predicted the kind of havoc Sandy wreaked.
The final lesson: There is no such thing as too much preparation. Apple, AWS, Rackspace, and Google were all ready for Sandy; the Boy Scouts would be proud. Datagram planned to use its Connecticut facility but wasn't anticipating just how bad Sandy would be. It was prepared -- but not for the worst.
Did you experience outages with your cloud providers during Sandy's rampage? How long did it take for you to get back up?
I wonder how much providers' problems might be due to just bad luck vs. bad preparatons. It's pretty difficult to predict unprectibible situations. No matter how much you think you're ready, something is bound to defy your best intentions.
That's right, even the best prepared can face unpredictable situations. However, in this case of Sandy and the cloud, it was well predicted. The only problem was that some didn't think it was going to be as big as it was.
An alternate view: 100% uptime sometimes isn't worth it. It does you no good to be online if your customers and partners can't get online and your employees can't get in to work.
Meanwhile, the big cloud providers weathered the storm with little or no downtime.
@Christine, Thanks for the post. Good to know that all the big cloud providers weathered the storm with little downtime. This will definitely encourage more and more enterprises to adopt Cloud.
No matter how much you think you're ready, something is bound to defy your best intentions.
@kq4ym, true. Sometimes its hard to predict the outcome of uncertain event but we can always learn from past events. Similarly cloud providers might have faced new challenges this time around. I hope they will implement solutions for those shortcoming's so that they can be better prepared to fight uncertain events in future.
Cloud seems to have passed the test. IT infrastructure, perhaps not quite so much.
One of our Managed Services clients had numerous sites go down. Not unexpected. Several in Illinois. There was wind, but nothing to suggest that was a significant effect.
They used one ISP across all the affected sites, and the ISP claimed a data center outage in the NY Area that took down routing. Or that's how the customer relayed it to us. I saw no announcement of this on the ISP's Web site.
So that's an uncorroborated account. If true, though, it's also a major failure to provide updates on the part of that ISP.
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
Last week's official US release of the BlackBerry Z10, the BlackBerry 10 touchscreen device, on the AT&T network marked the official entry of BlackBerry as a player in the formidable US smartphone market. While most consumers may not be swayed from their shiny, sleek iPhones and Android devices, businesses may still have a compelling reason to deploy BlackBerry 10. However, BlackBerry needs to do a few things before businesses will jump on the bandwagon, including opening up their management API and luring consumers to their device.
Whenever I whip out my BlackBerry Bold in public, someone will undoubtedly say, "Oh, how cute. You still use a BlackBerry." Yes, I do, and I'll use it until the day I die.
As legacy applications outlive their usefulness, companies look toward the cloud for maximum efficiency and minimum expense. But nothing is as simple or easy as just “moving to the cloud.” Legacy applications need to be modernized, and data has to be migrated. It’s the kind of headache that makes any seasoned IT pro reach for the coffee maker -- and a fistful of Advil.
Social integration, mobility, and the cloud -- with a side dish of social media -- are becoming evermore critical elements of enterprise content management (ECM).
Many enterprises view high-speed broadband connections as ubiquitous. Yet in about 20 percent of the country, businesses and their employees do not have access to even DSL connections. This shortcoming diminishes enterprises' ability to support their employees.
The decision could discourage innovators looking to the past, and require companies to build from the ground up, leading to a new generation of stagnation in the IT world.
Cisco's rumored sale of Linksys suggests we may have problem with innovation and profit at the edge of our Internet, and that could be critical to the evolution of many Internet-delivered services.
A survey by JD Powers found that customer interest in product features is lessening as phones evolve. Rather than features, price is driving purchases, and that change could have a dramatic impact on how IT departments secure these devices.
Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Businesses helped neighbors with Internet access and mobile device charge-ups during Sandra. Following that example, enterprises should consider preparing Internet disaster plans to help the public during disasters.
Enterprises are discovering that using social networking within the secure setting of a SaaS provider's network gives them an unusual opportunity to freely collaborate with partners, suppliers, and even competitors.
All the recent hoopla about cloud security overlooks an important point, which is that it's not strictly a cloud problem. The linkage of online services into cooperative chains creates the risk, and only biometrics and federation of providers can save us.
Microsoft's recent decision to bundle its Office software with business partner offerings indicates that cloud software may be in the news, but licensed packages are still in demand for failover.
The Amazon smartphone rumor and the Apple mini-iPad rumor show that the mobile device giants think they have to be in all the device spaces to win. Why? Because the cloud can create an ecosystem where every device can cooperate to support the user, and if you don't supply all the devices you miss out on the total value.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.