The Macrosite for News, Analysis and Opinion about the Future of the Internet
Todd Watson

Big Study on Big-Data

Written by Todd Watson
10/17/2012 5 comments
no ratings
DISCUSS     Email This

Perfect timing.

In advance of IBM's massive event next week in Las Vegas featuring all things information management, Information On Demand 2012, IBM and the Saïd Business School at the University of Oxford today released a study on big-data.

According to a new global report from IBM and the Said Business School at the University of Oxford, less than half of the organizations engaged in active Big Data initiatives are currently analyzing external sources of data, like social media.

The headline: Most big-data initiatives currently being deployed by organizations are aimed at improving the customer experience, yet less than half of the organizations involved in active Big Data initiatives are currently collecting and analyzing external sources of data, like social media.

One reason: Many organizations are struggling to address and manage the uncertainty inherent within certain types of data, such as the weather, the economy, or the sentiment and truthfulness of people expressed on social networks.

Another? Social media and other external data sources are being underutilized due to the skills gap. Having the advanced capabilities required to analyze unstructured data -- data that does not fit in traditional databases such as text, sensor data, geospatial data, audio, images and video -- as well as streaming data remains a major challenge for most organizations.

The new report, entitled "Analytics: The real-world use of Big Data," is based on a global survey of 1,144 business and IT professionals from 95 countries and 26 industries. The report provides a global snapshot of how organizations today view big-data, how they are building essential capabilities to tackle big-data and to what extent they are currently engaged in using big-data to benefit their business.

Only 25 percent of the survey respondents say they have the required capabilities to analyze highly unstructured data -- a major inhibitor to getting the most value from big-data.

The increasing business opportunities and benefits of big-data are clear. Nearly two-thirds (63 percent) of the survey respondents report that using information, including big-data, and analytics is creating a competitive advantage for their organizations. This is a 70 percent increase from the 37 percent who cited a competitive advantage in a 2010 IBM study.

Big-data drivers and adoption
In addition to customer-centric outcomes, which half (49 percent) of the respondents identified as a top priority, early applications of big-data are addressing other functional objectives.

Nearly one-fifth (18 percent) cited optimizing operations as a primary objective. Other big-data applications are focused on risk and financial management (15 percent), enabling new business models (14 percent), and employee collaboration (4 percent).

Three-quarters (76 percent) of the respondents are currently engaged in big-data development efforts, but the report confirms that the majority (47 percent) are still in the early planning stages.

However, 28 percent are developing pilot projects or have already implemented two or more big-data solutions at scale. Nearly one quarter (24 percent) of the respondents have not initiated big-data activities, and are still studying how big-data will benefit their organizations.

Sources of big-data
More than half of the survey respondents reported internal data as the primary source of big-data within their organizations. This suggests that companies are taking a pragmatic approach to big-data, and also that there is tremendous untapped value still locked away in these internal systems.

Internal data is the most mature, well-understood data available to organizations. The data has been collected, integrated, structured, and standardized through years of enterprise resource planning, master data management, business intelligence, and other related work.

By applying analytics, internal data extracted from customer transactions, interactions, events and emails can provide valuable insights.

Big-data capabilities
Today, the majority of organizations engaged in big-data activities start with analyzing structured data using core analytics capabilities, such as query and reporting (91 percent) and data mining (77 percent).

Two-thirds (67 percent) report using predictive modeling skills.

But big-data also requires the capability to analyze semi-structured and unstructured data, including a variety of data types that may be entirely new for many organizations.

In more than half of the active big-data efforts, respondents reported using advanced capabilities designed to analyze text in its natural state, such as the transcripts of call center conversations.

These analytics include the ability to interpret and understand the nuances of language, such as sentiment, slang, and intentions. Such data can help companies, like a bank or telco provider, understand the current mood of a customer and gain valuable insights that can be immediately used to drive customer management strategies.

You can download and read the full study here.

Update: Also check out the new IBM Big Data Hub, a compendium of videos, blog posts, podcasts, white papers, and other useful assets centering on this big topic!

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
DHagar
Thinkernetter
Tuesday October 30, 2012 6:22:06 PM
no ratings

Todd,


Kudos to IBM for providing the leadership and support to bringing everyone along  to benefit from Big-Data.

DHagar

nasimson
Thinkernetter
Tuesday October 30, 2012 10:56:12 AM
no ratings

Todd Big data University is a step in the right direction and the need of the hour. I am sure the university programe will produce the next generation of future big data analyst who will help us de-clutter  meaningful data.Thanks for the link.

Todd Watson
Thinkernetter
Monday October 29, 2012 7:22:20 PM
no ratings

Nasimson,

There are a variety of things IBM is doing to help with this skills gap.  I'm including a link to a story below to get you started:

http://siliconangle.com/blog/2012/02/15/ibm-puts-big-data-in-universities-hopes-well-never-run-out-of-nerds/

Thx,

Todd

DHagar
Thinkernetter
Monday October 29, 2012 5:52:32 PM
no ratings

Those are key factors in the wider use and ROI from Big Data, nasimson.  I know here in California that IBM is working with colleges to expand the training and skill development in analytics.

As you and Todd point out, the value will come in the wider use and the direct application to business problems.  The technology is ready, the skills, culture, and leadership need to catch up now.

DHagar

nasimson
Thinkernetter
Monday October 29, 2012 5:36:38 AM
no ratings

Todd To quote from Wall street journal

"A significant constraint on realizing value from Big Data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from Big Data. We project a need for 1.5 million additional managers and analysts in the United States who can ask the right questions and consume the results of the analysis of Big Data effectively."

http://online.wsj.com/article/SB10001424052702304723304577365700368073674.html

How can IBM help to bridge this gap in skills?

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Todd Watson
Todd Watson
Todd Watson   5/22/2013   Post a comment
You only need take one quick glance around the IBM Smarter Commerce Global Summit at the Gaylord Opryland facility here in Nashville to recognize how busy the Smarter Commerce customer reference team has been these past few months in anticipation of the event.
Todd Watson
Todd Watson   5/22/2013   Post a comment
In this morning's general session here at the IBM Smarter Commerce Global Summit in Nashville, our emcee Jay Baer said what I've been thinking for the past several days: We're in a giant terrarium.
Alison Diana
Alison Diana   5/21/2013   1 comment
Ushering in a new era of cognitive computing systems, IBM announced today the IBM Watson Engagement Advisor, a technology breakthrough that allows brands to crunch big data in record time to transform the way they engage clients in key functions such as customer service, marketing, and sales.
Alison Diana
It's time for the annual IBM State of the State of Marketing, that time of the year when IBM reveals the results of its global survey of marketers.
5
of
Mitch Wagner
Brands Make the Most of Limited Online Resources

2|27|13   |   2:46   |   3 comments


Marketers at companies such as Whole Foods are putting colleagues in other departments to work on social media to make up for their own scant budgets.
Mary Maida
Medtronic Quantifies Social Business

1|9|13   |   1:15   |   No comments


The medical instruments manufacturer looks to metrics to quantify its social business engagement, according to Mary Maida, Medtronic lead information solutions manager. Internet Evolution editor in chief Mitch Wagner interviewed Maida at the E2 Innovate conference.
Mitch Wagner
TweetDeck Gets a Second Life

11|5|12   |   9:54   |   13 comments


A recent release of the popular TweetDeck app for Twitter power-users gives new life to software that had previously taken a wrong turn. Here's a quick walk-through of the new TweetDeck, to show you why it should be at the top of your Twitter toolkit.
Marketing Takes
How Four Seasons Handles Content Marketing

6|20|12   |   7:47   |   4 comments


Elizabeth Pizzinato, SVP of marketing and communications at Four Seasons Hotels and Resorts, calls content marketing "the new black" and explains how her brand engages its target audience.
Marketing Takes
The Evolution of Digital Marketing

6|19|12   |   4:12   |   1 comment


Amanda Richman, president of digital at MediaVest, cites the rise of the 'empowered consumer' as one of the most significant changes in digital marketing today.
Marketing Takes
An Evolving Take on Marketing at Citi

6|18|12   |   7:56   |   1 comment


Linda Descano, President and CEO of Women & Co., and managing director of partnerships and branded content of North America marketing at Citi, explains her firm's marketing opportunities and challenges.
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Drives Conversions With Analytics

3|1|13   |   1:20   |   No comments


The automotive website uses propensity modeling of customer behavior to convert more site visitors into leads, says Brian Baron, director of business analytics, in an interview at the Predictive Analytics Innovation Summit.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE