The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mary Jander

Pondering the Limits of Intuition

Written by Mary Jander
12/29/2011 23 comments
no ratings
DISCUSS     Email This

IT professionals love hard facts. It comes with the turf. So it's no surprise that many view the process of intuition skeptically. Indeed, increased use of analytics in enterprise information processing reflects an underlying mistrust of intuition in making tough business decisions.

But is there no room for intuition in IT at all?

The answer may depend on how one defines intuition. For some researchers, intuition has been described as the ability to make decisions quickly, on the fly, without much reflection. The success of intuition thus depends on a person's ability to synthesize information effectively. So success in intuitive decision-making depends on how much experience people have and how smart they are (and therefore how many facts they can recall).

At the same time, it isn't tough to find instances when intuition fails. The stock market is full of "geniuses" who eventually made the wrong choices. The trick seems to be to apply intuition where it can be most useful.

Finding where intuition best applies in business can be tricky. For purveyors of IT software and services, intuition is useful only if it can be backed up with analytics. Indeed, in describing the use of analytics in a medical project, a writeup from IBM Research basically devalues reliance on intution at all, even though medicine is a field where intuition has always played a strong role. The argument goes that if even the basic terminology of medicine can't be nailed down intuitively, what hope is there for more specific information to be processed adequately through human brainpower alone?

A study has shown that basic vocabulary to express uncertainty, such as "likely", "highly probable", etc., has a wide range of interpretation for individual physicians. The meaning of "likely", for instance, can range from not probable (around 20% of occurrences) to highly probable (around 95% of occurrences), depending on how an individual physician defines it.

There is thought on the other side of the issue, as well, which states that expert input can help in the creation of good analytics. In a blog, George Danner, president of Business Laboratory LLC, a Houston scientific simulation and analysis consulting firm, states:

Models don't replace human intuition, knowledge, and experience -- they codify them. Done properly, models and human judgment are seamlessly interwoven into a single, organized body of knowledge. An institutional artifact that is worthy of preservation and continuous use.

Some general tips have emerged in the past few years about how best to use intuition along with analytics. Here are a few worth mentioning:

  • Don't rely on intuition alone. In a paper published in May 2010, Daniel J. Simons of the University of Illinois at Urbana-Champaign and Christopher F. Chabris of Union College in New York warn against relying solely on intuition:
    The trouble with intuition is that while intuitive modes of thought are easier to use than analytical modes, they are poorly adapted to many circumstances and decisions we face in the modern world. If we follow our gut instincts, we will talk on the telephone while we drive, have too much trust in eyewitnesses, and believe we know what causes what -- in health care, finance, politics, and every other domain -- without even realizing that we haven't considered the right evidence, let alone come to the right conclusions.
  • Be willing to examine intuition for flaws. Finding a balance between intuition and analytics requires a willingness to examine how intuition fails. Only with this kind of honest appraisal can intuition be used effectively in corporate decision-making.

  • Apply intuition to finding the right questions, not answering them. In a press statement in a report on analytics, IBM, which has a vested interest in the subject, nevertheless makes a compelling argument:

    Flip the equation in the approach to data and insights: Many organizations start new initiatives by gathering all of the available data on a topic and then extracting whatever insights they can get. Instead, the first step should be to identify what specific insights are needed, and then identify those pieces of data needed for answers.

As the new year begins, intuition will continue to play a role in IT and other areas of the enterprise. But it will increasingly play a role subordinate to analytics.

— Mary Jander Follow me on TwitterVisit my LinkedIn pageFriend me on Facebook, Managing Editor, Internet Evolution

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 3   Next >
Mary Jander
Thinkernetter
Tuesday April 24, 2012 1:22:29 PM
no ratings

Unfortunately, a whole generation of businesspeople were trained to do just the opposite of this.

That said, I believe there is a place for intuition. But these days, it's folly to trust it alone without some backup from analytics.

InspiredSuccess
Rank: Cave Painter
Tuesday April 24, 2012 12:59:23 PM
no ratings

Intuition is the other side of the brain.  The key is knowing how to use intuition.  To access your intuition you have to get out of your mind -  the logical side of your mind that is.  Stepping back, not thinking, getting quiet, clearing your mind then open to your intuition.

I agree with using both - logic and intuition.  The key is knowing how to be intuitive aside from gut feelings.

DHagar
Thinkernetter
Tuesday January 3, 2012 1:50:33 PM
no ratings

Exactly, Mary.  It is that level of competition that I believe will make analytics a necessity.  The leading competitors will have to have a better total understanding of the markets.

DHagar

Mary Jander
Thinkernetter
Tuesday January 3, 2012 1:33:59 PM
no ratings

There is no solution that will last forever, and companies that recognize the need to stay in flux seem to be doing quite well in IT.

At the same time, the successful brands also recognize customer limitations and are willing to work within them.

DHagar
Thinkernetter
Tuesday January 3, 2012 1:30:41 PM
no ratings

Exactly, Dream Chaser.  It becomes very tempting to continue to get more from what you have; which can also convince you to not do more.

That's where a lot of managers and companies are trying to reap profits from ideas that are outdated, no longer relevant, or partial copies of genuine improvements.  The leading companies, like IBM, have invested instead in building the capability to keep learning.  The true answer is solving the customer's problems; you do that and you will do well.

DHagar

The Dream Chaser
Rank: Cyborg
Tuesday January 3, 2012 1:22:17 PM
no ratings

our lack of humility may take us confidently down the wrong path.  Or our inability to tame our lust and greed for more more more more.  I remember the Windows 95 launch.  Hardware company's were going nuts during this time. I was at an event at a Big Box retailer and there was mountains of new product everywhere you could hardly move through the aisles.  My intuition hit me right then and there and said, theres no way this is going to last no way. It didn't and at minimum I was at least prepared to change course when it ended. 

Mary Jander
Thinkernetter
Tuesday January 3, 2012 1:21:00 PM
no ratings

Agreed, DHagar. I'm always suspicious of "either/or" thinking, because typically I've found it false at the core. It's rare that there isn't a broader set of choices in enterprise problem solving.

DHagar
Thinkernetter
Tuesday January 3, 2012 1:10:04 PM
no ratings

Happy New Year as well, Mary!

Great points.  Actually, knowing the true questions is more critical today.  There are many executives solving today's problems based on their past experience and intuition. 

Analytics, in reality, can amplify our intuition and solidify our thinking.  If it is an either/or, it probably is lacking in the perception of the problem to begin with, meaning our lack of humility may take us confidently down the wrong path.

I think effective management skills for the next ten years will be learning how to use analytics effectively.  True fact-based profiles, along with our management experience, provides a sound basis for decision making.

DHagar

The Dream Chaser
Rank: Cyborg
Tuesday January 3, 2012 12:44:05 PM
no ratings

I know I've been up five hours already and my brain still isn't fully functioning.  LOL . . seriously though I think the best option would be something like this.

Mary Jander
Thinkernetter
Tuesday January 3, 2012 12:35:25 PM
no ratings

Ha! Not only do they wake up quicker, they aren't impaired by bad moods, lack of fresh air, insomnia, colds, hangovers....

And I do believe one of the first application of IBM's Watson will be to healthcare.

Page 1 of 3   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from IT Clan Editor's Blog
Mitch Wagner
Mitch Wagner   6/13/2013   6 comments
Join us on Thursday -- that's tomorrow -- on IE Radio to find out more about the challenges of turning a maker of exercise equipment into a cloud software company.
Mitch Wagner
Mitch Wagner   6/6/2013   19 comments
Microsoft has announced deals and disclosures designed to make Surface tablets as well as Windows 8.1 more attractive.
Mitch Wagner
Mitch Wagner   5/30/2013   28 comments
Patients can become their own doctors, at least in preventing and managing chronic conditions, with the aid of wireless technologies, according to Joseph C. Kvedar, MD, director of the Center for Connected Health at Partners Healthcare.
Mitch Wagner
Mitch Wagner   5/28/2013   23 comments
In an era of municipal budget cuts and austerity, the small City of Staunton, Va., expanded its services to include municipal WiFi for residents, employees, and tourists.
Mitch Wagner
Mitch Wagner   5/23/2013   10 comments
A pair of IBM studies show how advanced IT tools help drive value in two very different business functions: marketing and procurement.
5
of
Wisdom of the Big Chair
Big-Data Engineers Command Big Bucks

3|8|13   |   2:30   |   No comments


Big-data has become a big point of emphasis for many businesses. While the technology is available to deploy these applications, the needed personnel often is not. As a result, analytic engineers' salaries have blown past the six-figure mark, and hiring these experts has become a challenge for IT managers.
Second Shooter
Cisco & Linksys: A Problem at the Edge

1|4|13   |   2:15   |   No comments


Cisco's rumored sale of Linksys suggests we may have problem with innovation and profit at the edge of our Internet, and that could be critical to the evolution of many Internet-delivered services.
Dennis Carpio
Network Visibility Is More Important Than Ever

11|7|12   |   2:43   |   No comments


Network complexity, cloud-based architectures, the explosion of apps, and the growth of bandwidth needs are among the reasons enterprises need to improve insight into traffic and data.
Lars Härd
AI Gets Accessible to the Enterprise

10|17|12   |   1:04   |   6 comments


Lars Härd, founder of an artificial intelligence software company, explains why AI is becoming increasingly accessible and affordable.
Mary E. Shacklett
Scrum Brings Social MediaThinking to Projects

7|30|12   |   2:12   |   8 comments


The very low-tech "scrum" project technique introduces "crowd talking" to projects and also sets the entire crowd to problem solving. So far, these new social-media-style meetings appear to have supercharged project execution.
Singer at C-Level
I Predict You Will Watch This Video

7|27|10   |   1:59   |   No comments


Wouldn’t it be great to be able to predict what your customers want before they know they want it? Check our our latest tutorial about Predictive Analytics to find out how: www.internetevolution.com/tutorial-predictive-analytics.asp
John Kennedy
How Big-Data Is Changing Marketing

6|13|13   |   1:07   |   1 comment


Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   10 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
IETV: the thinkerNet on film
5
of
John Kennedy
How Big-Data Is Changing Marketing

6|13|13   |   1:07   |   1 comment


Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   10 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   1 comment


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
2pm EDT
Fri
Jun 21st
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   6/18/2013   Post a comment
The IBM Smarter Commerce Global Summit in Monaco kicked into high gear today, and we've already begun to see news emerging from that lovely city-state by the sea.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Taking a Dim View of Home Energy Management Tech
Mary E. Shacklett
Energy consumption is a primary contributor to
global warming. At the end of 2012, 40 percent of energy consumption in the US came from commercial and residential buildings.

CLICK FOR MORE