The Macrosite for News, Analysis and Opinion about the Future of the Internet
Kim Davis

Analytics Must Scale to Meet Challenges

Written by Kim Davis
1/24/2013 6 comments
no ratings
DISCUSS     Email This

Business analytics may be trending. The question is whether growth threatens to outstrip capacity.

Yesterday, Tableau released an interesting breakdown of the specific ways in which business analytics is trending right now. Of course, Tableau is a business analytics vendor, so any trend looks like good news to the company. But its outlook is persuasive.

It emphasizes the importance of "self-reliance" -- users being empowered to generate their own analytical queries and reports rather than relying on IT. It predicts that Hadoop will be big in 2013, which goes hand-in-hand with the growing importance of unstructured data.

"Predictive analytics" and "pervasive analytics" strike me as marketing smoke and mirrors (since when do enterprises use analytics exclusively to understand the past?), but on the whole this is a shrewd take on the directions in which BI is headed.

But there's a potential problem with this. At least, there is if you believe Gartner's latest research on the challenge of scale.

It's not called "big-data" for nothing. IBM estimates that we create 2.5 quintillion bytes of information every day (that's a billion billion, if you're counting). It's safe to assume that no enterprise wants or needs to analyze all that, but simply keeping up with the global conversations on platforms like Facebook and Twitter can stretch capacity -- especially as we're talking about unstructured data here, and not number-crunching.

This dovetails neatly with Tableau's prediction for Hadoop. With its developing reputation as the premium tool for organizing very large sets of unstructured data across multiple servers, Hadoop, and its various modules, Gartner's prediction is hardly surprising:

While IT organisations conduct trials over the next few years, especially with Hadoop-enabled database management system products and appliances, application providers will go one step further and embed purpose-built, Hadoop-based analysis functions within packaged applications. The trend is most noticeable so far with cloud-based packaged application offerings, and this will continue, it said.

Cloud is the other part of the puzzle, of course. Enterprises looking to scale BI in response to the apparently irreversible growth in volume of data are just about compelled to consider cloud-based options.

Hadoop is certainly a solution for distributed data storage within internal datacenters, but internal datacenters will surely be increasingly left behind, not only by the volume, but by the velocity of data requiring processing -- a trend on which the mobile explosion is also bound to have an impact.

The right storage for the right data loads -- which probably means cloud platforms; Hadoop, or comparable software frameworks, to organize the data; and employees with the confidence and understanding to query it. These are elements far-sighted businesses need to have in place, before we go from zettabytes to hellabytes.

Related posts:

— Kim Davis Follow me on TwitterVisit my LinkedIn pageFriend me on Facebook, Community Editor, Internet Evolution

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
slfisher
Thinkernetter
Tuesday January 29, 2013 11:32:31 PM
no ratings

Certainly in some companies with which I'm familiar, data is seen as "the keys to the kingdom" and jealously guarded. 

Kim Davis
Thinkernetter
Friday January 25, 2013 12:23:35 PM
no ratings

I agree.  Specialists are needed to compile, clean, and supervise the storage of the data.  End users need accessible dashboards so that they can query the data and get intelligible, useable results.  The demand for real-time data means IT (or data analysts) can't act as go-betweens on each query.

DHagar
Thinkernetter
Thursday January 24, 2013 9:17:50 PM
no ratings

The end users is where the value will be created, otherwise we will continue to build towers of Babel.

I think, to Mitch's point, we need both.  We need distributed data to the end user that is more functional and intuitive to deliver useful information for business decision making.  But we need people trained in analyzing data and applying to complex and changing dynamics to provide new insights that are useful - thus our analysts and data scientists.

Clearly, beyond learning how to integrate with cloud solutions, the ability to begin to understand and effectively use data in meaningful and productive ways to the organization is a total study in itself - going far beyond just creating software and reading reports - otherwise we will not scale effectively.

DHagar

Mitch Wagner
Thinkernetter
Thursday January 24, 2013 5:10:38 PM
no ratings

Sure, but do end users need help in finding the data they need?

Kim Davis
Thinkernetter
Thursday January 24, 2013 5:09:06 PM
no ratings

The emphasis I keep hearing is putting the data in the hands of end users.  Rich Luciano is very good on this in the Corner Office videos at the top of our home page.

Mitch Wagner
Thinkernetter
Thursday January 24, 2013 4:51:01 PM
no ratings

It emphasizes the importance of "self-reliance" -- users being empowered to generate their own analytical queries and reports rather than relying on IT.

Is that best? Are users equipped to do their own analytics?

Analytics seems to be emerging as its own specialized field of knowledge. Are we seeing it emerge as its own department, just as IT, legal, marketing, and customer service are their own specialized disciplines?

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Analytics Clan Editor's Blog
Kim Davis
Kim Davis   5/16/2013   15 comments
A study of US ecommerce trends in the run up to Mother's Day points to what Jay Henderson, Global Strategy Director for IBM Smarter Commerce, called "a pretty seismic shift" in online shopping habits.
Kim Davis
Kim Davis   5/7/2013   14 comments
The New York Times made a fuss about the obvious this week, as it so often does, pointing out that Hollywood increasingly leverages big-data to select and hone movie scripts.
Kim Davis
Kim Davis   5/2/2013   9 comments
State and local government agencies would love to get their hands around big-data. All they lack is adequate data storage and computer power, and enough staff.
Kim Davis
Kim Davis   4/22/2013   6 comments
It's unwise to overlook significant data trends, even if you're not sure what's causing them.
Kim Davis
Kim Davis   4/10/2013   4 comments
Some people -- me, I confess -- hardly ever look at Pinterest. Many people practically live on the site. If it's truly competing with Twitter to be the number two social platform to Facebook, it's hardly surprising it's also starting to get a grip on its analytics.
5
of
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Wisdom of the Big Chair
Big-Data Engineers Command Big Bucks

3|8|13   |   2:30   |   No comments


Big-data has become a big point of emphasis for many businesses. While the technology is available to deploy these applications, the needed personnel often is not. As a result, analytic engineers' salaries have blown past the six-figure mark, and hiring these experts has become a challenge for IT managers.
Wisdom of the Big Chair
Cloud SLAs Tilt to the Vendor

1|3|13   |   3:47   |   No comments


As enterprises move to cloud computing, they need to be sure their vendors will deliver reliable performance.
Second Shooter
The Cloud May Be Taking Over the Internet

11|28|12   |   2:12   |   6 comments


A change in priorities for networking spending could indicate a fundamental shift in Internet architecture that would affect everyone.
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Dennis Carpio
Network Visibility Is More Important Than Ever

11|7|12   |   2:43   |   No comments


Network complexity, cloud-based architectures, the explosion of apps, and the growth of bandwidth needs are among the reasons enterprises need to improve insight into traffic and data.
Mary E. Shacklett
Enterprises Beef Up Data Recovery

11|2|12   |   2:22   |   No comments


Global enterprises are now looking beyond having just two datacenters and toward establishing multiple datacenters in different parts of the world.
Lars Härd
AI Gets Accessible to the Enterprise

10|17|12   |   1:04   |   6 comments


Lars Härd, founder of an artificial intelligence software company, explains why AI is becoming increasingly accessible and affordable.
Mary E. Shacklett
Enterprises Like SaaS for Social Networking

9|6|12   |   2:04   |   8 comments


Enterprises are discovering that using social networking within the secure setting of a SaaS provider's network gives them an unusual opportunity to freely collaborate with partners, suppliers, and even competitors.
Mary E. Shacklett
Microsoft Opens Up Office Options

7|16|12   |   1:38   |   2 comments


Microsoft's recent decision to bundle its Office software with business partner offerings indicates that cloud software may be in the news, but licensed packages are still in demand for failover.
IETV: the thinkerNet on film
5
of
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Second Shooter
Locked Handsets Aren't the Problem – Subsidies Are the Problem

3|13|13   |   2:09   |   10 comments


Subsidized handsets, rather than locked handsets, should be the focus of regulators. We're not getting good deals, not fostering innovation, and weakening our power as buyers.
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   5/17/2013   Post a comment
It's been 17 years since I've visited the city of Dublin, but I still have some very distinct impressions from my one and only visit.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
Websites Should Consider Tougher ID Verification Policies
Alan Reiter
The apartment and house sharing service,
Airbnb, now requires members to verify their identities by demonstrating a presence on the web, and by either scanning a government ID or entering detailed personal details. Other enterprises should take a close look at Airbnb's verification policies.

CLICK FOR MORE