The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mary E. Shacklett

Figuring Out Third-Party Data Harvesting & Risk Management

1/15/2013 12 comments
no ratings
DISCUSS     Email This

Organizations are largely attracted to business analytics and big-data by their desire to capture greater value from their data. They do this by plumbing areas of unstructured information originating from outside sources such as the Internet.

No one is feeling this urge more than the folk in corporate marketing departments. For years, marketing has struggled with customer relationship management (CRM) and other marketing intelligence systems, trying to purchase and integrate appendices of data that give teams a clearer picture of who customers are and how they can best sell to them.

I remember working with one such marketing intelligence system several years ago. We could get basic customer information, such as age, sex, and where they lived. But we had to pay our provider to append more data when we wanted to add dimensions to the intelligence like our customers’ professions and whether they had children.

Sometimes it was worth it. If you were trying to target young teens to open savings accounts for their college educations (thereby beginning relationships with the bank), it helped to know which of our established customers had children and if the parents were employed in professions requiring college degrees.

But there were also inherent risks, dangers that haven’t appreciably changed over the years...

Is the data right? A Time magazine writer from Los Angeles was reported as living in New York, and at least one data analytics program profiled him as a woman between the ages of 18 and 19. At least 8.7 percent of Facebook profiles are from fake users. In plain numbers, this adds up to 87 million users out of an estimated 1 billion account-holders as of year's end 2012.

The moral of the story: Marketing departments should pre-assess the degree of accuracy they believe their data will have before engaging a third-party data mining shop to help them get it.

Will customers approve data collection? There are customers who love it when you are intuitive and anticipate their every need -- and there are those who don’t. There's no way you can create a targeted marketing campaign that's granular (or accurate) enough to figure out individual customers' opinions about this tactic.

Some companies get around the situation by having an “opt in” policy for customers who wish to receive promotions. Others send out the company's data privacy policy to customers each year (something regulators in the healthcare and financial services industries require). A corporate privacy policy should clearly explain to customers just when, how, and by whom their personal data can be used, so at least there are no surprises.

Is your third-party data mining source reliable? Overwhelmed by the amount of data they can mine, many companies turn to professional data mining and aggregation houses for help. What they discover is a treasure trove of information that can be mined for them at a fraction of a penny per match. In one case, Maggiano’s Little Italy engaged Rapleaf, a third-party data mining and aggregation firm, to transform Maggiano’s extensive customer email contact list into a marketing database that appended demographics and psychographics to better understand the lifestyles of Maggiano’s basic and premium customers and how to increase sales to them.

In another case, United Oil Co., a chain of more than 125 gas stations throughout Southern California, used business analytics to tap into point-of-sale (POS) information it had collected from its service stations to determine which product mixes worked best in which geographical locations. No matter whether it was a restaurant or a gas station, both organizations evaluated the credibility of their data and their data-gathering sources before making the investment in analytics -- and, in both cases, the investment led to business intelligence breakthroughs.

"We were surprised at the amount of data that was coming through our POS systems and how much micro-analysis potential there was," says Bill De La Espriella, director of technology at United Oil. "This is why we’ll be focusing most of our IT efforts in the area of analytics."

— Mary E. Shacklett is president of Transworld Data

Related posts:

DISCUSS     Email This
Current display:       chronological order       display newest comments first
Page 1 of 2   Next >
Alison Diana
Thinkernetter
Tuesday January 15, 2013 2:35:59 PM
no ratings

"We were surprised at the amount of data that was coming through our POS systems and how much micro-analysis potential there was," says Bill De La Espriella, director of technology at United Oil.


As you say in your article, Mary, the amount of data is going up, up, and away, not only from POS, but from sensors, social media, and all sorts of other input devices and applications. It's imperative, then, that organizations figure this out. And fast!

Mary E. Shacklett
Thinkernetter
Tuesday January 15, 2013 2:38:24 PM
no ratings

They are simply overwhelmed at this, Alison.

Many are looking at their vendors to lead them out of the wilderness.

Alison Diana
Thinkernetter
Tuesday January 15, 2013 2:44:01 PM
no ratings

It is overwhelming! But as you pointed out, it's one of those tasks that has to be done -- and done right. It's also a reason why rogue cloud deployments are such a bad idea; they make risk management more challenging since IT and legal have no idea where data resides, who is hosting this information, how many versions exist, and so forth. 

Mary E. Shacklett
Thinkernetter
Tuesday January 15, 2013 3:50:03 PM
no ratings

A very good point on cloud, Alison--especially since many organizations are starting  to relax on their cloud due diligence.

Michael P. Kassner
Thinkernetter
Wednesday January 16, 2013 8:44:48 AM
no ratings

Now if you think about your comments as referenced to governments. 

Kim Davis
Thinkernetter
Wednesday January 16, 2013 3:56:19 PM
no ratings

I think the government is conscious of the problem: witness projects like FedRAMP.  But that doesn't mean, of course, that it's on top of it.

Mitch Wagner
Thinkernetter
Thursday January 17, 2013 7:30:02 PM
no ratings
The service station example is an intriguing one. By tapping into POS systems, companies can find out what customers really want, as opposed to what customers say they want.
Mary E. Shacklett
Thinkernetter
Friday January 18, 2013 10:26:12 AM
no ratings

Yes--and it's nice to see companies begin to use this data for more proactive service.

DavidSilversmith
Thinkernetter
Thursday January 24, 2013 9:49:14 PM
no ratings

Since it "must be true" if it is on the Internet, too many organizations assume that "data availability" and "data accuracy" are the same thing.  

Over the years, in order to test applications and social media, I have built several fake profiles (it was easier than explaining to my connections that they should ignore my next 25 Facebook posts as I tested to make sure all of a websites social media links worked).   I am constantly amazed by friend requests to a fake profile and my fake people have even been tagged in photos - but maybe those are other fake people.  But most interesting, one of my profiles recently jumped from online marketing to direct postal marketing and I am now getting physical junk mail.  I guess multichannel marketing works - but bad data on one channel probably equals bad data on another channel.

Mary E. Shacklett
Thinkernetter
Friday January 25, 2013 1:21:29 PM
no ratings

Data accuracy is a MAJOR issue--and most enterpises aren't devoting enough time to it.

Page 1 of 2   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Mary E. Shacklett
Mary E. Shacklett
Social media has been with us for a decade -- but employer policies and the law are anything but firm about the most appropriate usage of this powerful tool.
Mary E. Shacklett
The average yearly tuition cost for brick-and-mortar colleges and universities in the US today is more than $20,000, an expense that has increased 1,120 percent since 1978. By comparison, students of all ages can often earn an online education for one fourth of this annual cost -- and more businesses are starting to acknowledge online degrees.
Mary E. Shacklett
Social media has indelibly changed the way we think about community and collaboration. Diminishing IT budgets are having a similar effect.
Mary E. Shacklett
Technology facilitates the virtual office -- but is that all there is to it?
Mary E. Shacklett
The datacenter collocation market is estimated to grow to 32.2 billion dollars by 2015.
most recent post: Mary E. Shacklett... It's really a tough one to call at this point, DHagar!
5
of
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Mary E. Shacklett
Doing Social Networking Right

3|19|12   |   2:31   |   9 comments


Companies are still getting their feet wet with social networking and what employees should and shouldn't broadcast. But they don't always involve HR and PR. Here's why they should, and what they risk when they don't.
Singer at C-Level
Goldilocks & the Data Center

2|4|10   |   3:39   |   2 comments


What kinds of companies are doing the most innovation in the data center? Turns out it's midtier enterprises that are taking the "Just Right" approach.
The Incredible Hultquist
Web 2.0 – Just Being There Isn't Enough

11|3|09   |   2:15   |   9 comments


As enterprises leap into the Web 2.0 world of blogging, commenting, and social networking, just 'being there' won't deliver ROI. You may want a 'Web Evangelist' to systematically harvest the feedback in order to polish your product or service.
The Incredible Hultquist
Social Networks & Hiring Pitfalls

10|16|09   |   2:16   |   5 comments


More companies are trolling social networks to find and vet potential job candidates. Beware the pitfalls of blurring the line between personal and professional lives.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Mitch Wagner
Brands Make the Most of Limited Online Resources

2|27|13   |   2:46   |   3 comments


Marketers at companies such as Whole Foods are putting colleagues in other departments to work on social media to make up for their own scant budgets.
Second Shooter
Graphing Facebook Graph Search's Success

1|25|13   |   2:13   |   10 comments


Facebook's Graph Search may face some profound challenges and risks, first, because Facebook users haven't been thinking of their posts as product reviews; and second, because Facebook will now have to contend with the social-network equivalent of SEO "gaming" of results.
Kim Davis
Employees Can Speak Freely on Social Media

1|23|13   |   1:52   |   16 comments


US regulators are sympathetic to employees who use Facebook and Twitter to air their grievances.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE