The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mary Jander

Nasdaq's Under a Cloud, but Clouds Aren't to Blame

Written by Mary Jander
5/21/2012 16 comments
no ratings
DISCUSS     Email This

Nasdaq is in deep trouble with traders and investors over a couple of application glitches in its OMX trading system.

But clouds are not to blame.

While Nasdaq OMX uses cloud services from Amazon, those services pertain to the exchange's Market Replay apps, not to the Halt Cross and IPO apps that caused trouble on Friday.

The Nasdaq OMX trading system is enormous, complex, and spread around the world. Reportedly, the offending apps hiccuped over order cancellations made during the rush that occurred when shares started trading Friday at 11:30 a.m. Once that delayed the system, a rash of cancellations occurred because investors weren't sure what was really going on with the shares.

Nasdaq OMX CEO Robert Greifeld told The Wall Street Journal yesterday that the exchange "is humbly embarrassed." Nasdaq had competed against NYSE Euronext to handle the IPO. Further, the company prides itself on the volume and speed of its transaction handling. "Our INET platform processes trades at sub-millisecond transaction speeds with close to 100% system reliability," boasts Nasdaq OMX's latest 10-K SEC report.

"This was not our finest hour," Greifeld lamented.

Robert Greifeld, CEO, Nasdaq OMX  (C) 2012, The NASDAQ OMX Group Inc.
Robert Greifeld, CEO, Nasdaq OMX
© 2012, The NASDAQ OMX Group Inc.

Could cloud computing have helped Nasdaq OMX to avoid this, and if so, how? Those aren't easy questions to answer. According to Greifeld, the applications that failed were repeatedly tested. In the end, it was poor design that brought it down, the CEO asserted.

Cloud services can help enterprises with software testing. Clouds also can provide additional computing power if integrated with certain systems, although it's clear that some companies don't trust clouds with their data.

Data security has been a concern for Nasdaq OMX, especially since the systems were hacked early in 2011.

But clouds may not have helped anyway, claims Mary E. Shacklett, IE contributor and president of consultancy Transworld Data. She says Nasdaq should be looking at tightening up parallel processing and ensuring better failover points. "That would help going forward, whether Nasdaq is doing this in traditional datacenters or in its own private cloud."

Cloud or no cloud, there is no real guarantee that accidents like Friday's won't recur. In its 10-K, the firm states:

Although we currently maintain and expect to maintain multiple computer facilities that are designed to provide redundancy and back-up to reduce the risk of system disruptions and have facilities in place that are expected to maintain service during a system disruption, such systems and facilities may prove inadequate. If trading volumes increase unexpectedly, we may need to expand and upgrade our technology.

Sadly prophetic words.

Nasdaq OMX press contact had not returned a phone call and email at press time.

Related posts:

— Mary Jander Follow me on TwitterVisit my LinkedIn pageFriend me on Facebook, Managing Editor, Internet Evolution

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 2   Next >
Mary Jander
Thinkernetter
Monday June 4, 2012 9:20:26 AM
no ratings

Good point, DukeW. People design these systems and if there is something missing it's people who are to blame.

The Nasdaq system designers didn't think that order cancellations could overwhelm the system. That was their mistake, not the system's.

DukeW
IQ Crew
Sunday June 3, 2012 5:15:28 PM
no ratings

Thanks for the insight on this, Chris.  A lot of people still believe the hardware and software broke.  It seems they're looking for problems on the wrong side of the man/machine interface.  Maybe instead of more machines, they just need better men....

Mary Jander
Thinkernetter
Tuesday May 22, 2012 10:55:17 AM
no ratings

I hope we do hear more about the upshot to this computing fiasco. I only hope the news doesn't disappear as the fracas dies down.

One thing: For a system like OMX's, there are so many facets, so much contributed from acquistions, etc., so many moving parts, that we may never know where these apps originated or what exactly the CEO meant by poor design.

To get to the bottom of this, we'd have to know what to ask, and I'm not sure the company would answer the questions even if we knew what those should be.

Mary Jander
Thinkernetter
Tuesday May 22, 2012 10:50:21 AM
no ratings

Interesting observation, Dream Chaser, Computers are only the machinery of systems designed by humans. Indeed, it may be time to rethink the "brains" -- the basic concepts -- behind various systems. Where better to start than Wall Street?

Chris Poley
Thinkernetter
Tuesday May 22, 2012 10:39:30 AM
no ratings

First, an IPO is anthing but a "public offering. It is a reward for insider investors. This was a debacle of epic proportion by Morgan Stanley, over priced over subscibed, leaving no room for retail investors to scratch out a profit. Instead the retail customer got left holding the bag on the insider selling.

Second, never buy the hype.

Third if you are interested in getting in new technology innivations there are a number of sites like  Kickstarter or Slated or Crowd funding to get in early and ride the wave of popularity. If it pays off you can sell your shares on Second Market.

Paul Whyte
Researcher
Tuesday May 22, 2012 10:15:31 AM
no ratings

"Could cloud computing have helped Nasdaq OMX to avoid this, and if so, how? Those aren't easy questions to answer. According to Greifeld, the applications that failed were repeatedly tested. In the end, it was poor design that brought it down, the CEO asserted."

So if the problem according to Nasdaq's CEO was poor design, then it goes just beyond fixing the technical  hiccups The rule in design of any systems is you design for the worse case scenario I know it is more costly to honor this rule but at least you can be guarantee that such failures that happened last Friday don't occur. 

I will like to hear more from Nasdaq's CEO with respect to this issue of poor design. Is the poor design a product of system size or capability? Can Nasdaq hold the party that poorly design the system culpable for the technical hiccups that occured last Friday?

The Dream Chaser
Rank: Cyborg
Tuesday May 22, 2012 10:05:40 AM
no ratings

We're not going to become a Nation of people leisurely loafing around while our pc's and iPhones execute high frequency trading duties around the clock for us that should be obvious.  How do the "retail investor" seeking long term investments that have real value compete with systems and people who consider a stocks value at a lifetime of 12 seconds maximum?  

Mary Jander
Thinkernetter
Tuesday May 22, 2012 9:46:16 AM
no ratings

In this instance, I'd agree that fixing would be much better than condemning specific persons. This problem would have been a tough one to predict.

chuckgregory
IQ Crew
Tuesday May 22, 2012 9:34:09 AM
no ratings

I'm sure some heads will roll on this, and as I've mentioned in other situations I don't think that is the appropriate response. Companies, espocially big ones, are so tied to the idea of assessing blame and firing someone...it's far more useful fo work on fixing the actual technical problems.

Mary Jander
Thinkernetter
Tuesday May 22, 2012 8:49:56 AM
no ratings

Chris, thanks for these insights. Your input makes me think that there were a few factors that played into the Nasdaq OMX system's failure to live up to expectations.  The hardware and software had been tested, apparently for every contingency. But it's always the unexpected, the unanticipated, that spoils the plan.

Throw in a few human miscalculations and the machinery didn't have a chance.

Page 1 of 2   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Cloud Clan Editor's Blog
Mitch Wagner
Mitch Wagner   6/14/2013   17 comments
Before entrusting bet-your-business applications to the cloud, organizations need to ensure that service providers guarantee the apps will be available. The key to doing that is a strong Service Level Agreement (SLA).
Mitch Wagner
Mitch Wagner   6/4/2013   4 comments
IBM today said it will acquire SoftLayer Technologies, the largest privately held cloud computing infrastructure provider. IBM plans to leverage SoftLayer's expertise serving "born-on-the-Internet" companies to both broaden IBM's customer base and help better serve enterprise customers with cloud services.
Mitch Wagner
Mitch Wagner   5/31/2013   14 comments
The emergence of cloud puts IT in an awkward position familiar to seasoned pros: Business employees are bringing in new technology through the back door, without seeking permission from IT or even letting IT know it's being done.
Mitch Wagner
Mitch Wagner   5/22/2013   21 comments
Precor, which makes exercise equipment for gyms and homes, needed to transform itself into a cloud services provider in order to keep up with the changing demands of its customers.
Mitch Wagner
Mitch Wagner   5/17/2013   12 comments
Like other leading technology-using businesses, Walmart is starting to look like a vendor in its integration of the latest technologies to serve its customers. That's what led it to buy two Silicon Valley cloud startups this week.
5
of
Mary E. Shacklett
Enterprises Like SaaS for Social Networking

9|6|12   |   2:04   |   8 comments


Enterprises are discovering that using social networking within the secure setting of a SaaS provider's network gives them an unusual opportunity to freely collaborate with partners, suppliers, and even competitors.
Second Shooter
The Real Problem With Cloud Security

8|17|12   |   2:12   |   7 comments


All the recent hoopla about cloud security overlooks an important point, which is that it's not strictly a cloud problem. The linkage of online services into cooperative chains creates the risk, and only biometrics and federation of providers can save us.
Mary E. Shacklett
Microsoft Opens Up Office Options

7|16|12   |   1:38   |   2 comments


Microsoft's recent decision to bundle its Office software with business partner offerings indicates that cloud software may be in the news, but licensed packages are still in demand for failover.
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Second Shooter
Cisco & Linksys: A Problem at the Edge

1|4|13   |   2:15   |   No comments


Cisco's rumored sale of Linksys suggests we may have problem with innovation and profit at the edge of our Internet, and that could be critical to the evolution of many Internet-delivered services.
Wisdom of the Big Chair
Cloud SLAs Tilt to the Vendor

1|3|13   |   3:47   |   No comments


As enterprises move to cloud computing, they need to be sure their vendors will deliver reliable performance.
Second Shooter
The Cloud May Be Taking Over the Internet

11|28|12   |   2:12   |   6 comments


A change in priorities for networking spending could indicate a fundamental shift in Internet architecture that would affect everyone.
Mary E. Shacklett
Enterprises Beef Up Data Recovery

11|2|12   |   2:22   |   No comments


Global enterprises are now looking beyond having just two datacenters and toward establishing multiple datacenters in different parts of the world.
Wisdom of the Big Chair
Get on Facebook Right Now

11|1|12   |   2:42   |   No comments


A growing number of HR managers are suspicious of individuals who do not take part in social media and view them as anti-social in real life as well as online.
IETV: the thinkerNet on film
5
of
John Kennedy
How Big-Data Is Changing Marketing

6|13|13   |   1:07   |   1 comment


Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   10 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   1 comment


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
2pm EDT
Fri
Jun 21st
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   6/18/2013   Post a comment
The IBM Smarter Commerce Global Summit in Monaco kicked into high gear today, and we've already begun to see news emerging from that lovely city-state by the sea.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
NSA Leaks Shine Spotlight on Perils of Contractor Partnerships
Jason Mick
The US National Security Agency learned the
hard way that it can be dangerous to give a contractor too much money and access, with too little scrutiny. The NSA and other government agencies hire tens of thousands of contractors a year to analyze data. Edward Snowden -- who revealed himself as the NSA leaker after fleeing the country -- was one such contractor, reportedly holding a $122,000 salaried position at Booz Allen Hamilton at the time of his departure.

CLICK FOR MORE