The Macrosite for News, Analysis and Opinion about the Future of the Internet
Alan Reiter

Mining the Wisdom of Wireless Crowds

Written by Alan Reiter
6/16/2008 19 comments
no ratings
1 saves
DISCUSS     Email This

The "wisdom of crowds" -- employing the opinions of large numbers of people -- has become a tremendously popular concept used for the growing number of Web services that rely on user recommendations. The wisdom of wireless crowds, as I’m describing it, is different.  In this new wireless group, “wisdom” potentially has valuable uses.  

The wisdom of wireless crowds is the collection of telemetry and individual data points -- not personal opinions -- from multiple cellular phones and wireless devices in an attempt to uncover or analyze a situation, such as the location of radioactive weapons, air pollution levels, and subscriber travel habits. 

It’s also different in another way:  An organization could be conducting this group data mining without the miners being aware of it. It has raised privacy concerns, and the debate isn’t going to stop.

Intel Corp. (Nasdaq: INTC) and the University of California at Berkeley have been testing "participatory urbanism" that employs “networked mobile personal measurement instruments” where participating consumers are “agents of change.” A project in Accra, Ghana involved taxis and individuals with portable air pollution monitors, which incorporated GPS, to measure pollution around the city and map the levels on the Web.  Cellphones weren’t used, but this is a logical next step.

Purdue University is working with Indiana to develop a system of GPS-enabled cellphones with integrated radiation sensors to detect terrorist “dirty” or nuclear bombs. Small radiation monitors already exist and could be incorporated into phones without adding much bulk, according to the press release.

College researchers tested a cellphone network that successfully detected sealed, weak radiation sources placed around the campus. Researchers are enthusiastic about wireless Internet capabilities, since data can be transmitted in real time. This illustrates the “wisdom” of wireless crowds because multiple detections would be required to determine an accurate location.

Voluntary, involuntary group monitoring
Researchers also are beginning to monitor the locations and habits of the cellular users. Several years ago, "Reality Mining" began at MIT’s Media Lab.  During the 2004-2005 academic year, the movements of some 100 MIT students were monitored via Nokia phones. The project's goals included the evolution of social networks, the predictability of people’s lives, and changing group interactions. More than 350,000 hours (about 40 years) of data were collected.

The monitoring was voluntary. But what if your movements were monitored without your knowledge? A research paper in this month’s Nature used location data collected for six months from more than 100,000 cellphone users in an unnamed country (not the United States). 

The researchers from Northeastern University studied travel patterns and found most people don’t travel very far from their homes. The concerns aren’t about the paper’s results but whether it was illegal for the cellular operator (also unnamed) to turn over the data.  The data didn’t include names or phone numbers, just anonymous ID codes.  An article in The Register reports it would be illegal in the U.S. because cellular operators can’t turn over location information without the subscriber’s prior consent.  According to the article, similar requirements exist in the European Union.

This is just the start of wirelessly monitoring group behavior. For example, a few days ago Sense Networks debuted its Citysense cellular service that’s designed to employ a variety of location techniques, such as GPS, WiFi hotspots, cellular triangulation, and even GPS logs from taxis and RFID sensors.  

The phone displays red “heat maps" that show where large numbers of people are congregating. Users may click on Google (Nasdaq: GOOG) or Yelp Inc. (NYSE: YELP) to determine what’s at those locations -- clubs, restaurants, etc. The software also learns user preferences and matches them to appropriate areas of activity.  The company says its “Macrosense” technology is the “first platform capable of collecting and analyzing massive amounts of anonymous, aggregate location data in real-time.”

There you have it:  A world where increasingly large amounts of wireless-based group data are being analyzed second-by-second by corporations, government institutions, schools, and, of course, Web companies. There’s good and bad here. But we need to be very sure about who’s sifting through our data and for what it’s being used.

— Alan Reiter, President, Wireless Internet & Mobile Computing

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 2   Next >
Alan Reiter
Thinkernetter
Tuesday June 17, 2008 3:17:41 PM
no ratings

Hi Mr. Roques,

The good news is we have a wealth of resources for information.  A hotel certainly is one good source, but, obviously, not always.  There are several great Internet resources, such as Yelp, and more on the way.

Citysense has promise.  But what I'd like to know is whether large numbers of people congregating at specific restaurants, clubs, etc. means these venues are good or appropriate for me.

The future, more and more, is matching every person's preferences to databases of objective and subjective parameters to produce optimal (or very good) recommendations.  I suspect this will be achievable in the near future.  We already have massive databases of restaurants, movies, clubs, etc. and the social networking groups. 

What we need is better software to, well, data-mine these resources in conjunction with our preferences.  If Friend A almost always has the same tastes as you in music, then his/her recommendations would be given more weigh than Friend B who isn't attuned to your musical tastes but might be closer to your tastes in movies or travel destinations.

Pandora provides me with music based on its algorithms and my "yea" or "nay" determination for each new song.  It doesn't take long for Pandora to produce musical channels that are extremely close to what I like in a variety of categories.

One of the downsides of "perfect" recommendations is lack of chance discoveries of things the software doesn't think we'd like.  The value of chance isn't to be underestimated.

Alan Reiter
Thinkernetter
Tuesday June 17, 2008 2:53:16 PM
no ratings

Hi Kim,

The Internet is the poster child for meandering discussions but it's also the poster child for the serendipitous discovery of interesting/useful information as a result of this meandering and hyperlinks.

Alan Reiter
Thinkernetter
Tuesday June 17, 2008 2:43:59 PM
no ratings

Hi Joe Earhart,

Yes, there can be great power in a dedicated small group or individual.  Indeed, it is how many (all?) revolutions are started.  The Internet, of course, is perfect for the development of a lone voice.  If data mining of cellular phones becomes prevalent, there's simply no question that it will be publicized all over the Internet (well, the technology-oriented areas of the Internet, not the "wanna-see-more-pictures-of-my-cat" Internet).

Unfortunately, I'm not familiar with the issue of fees to the consultant.  However, the spectrum auctions were, on the one hand, a success for the government because they generated billions of dollars.  On the other hand, they resulted in the same old entrenched operators capturing most of the spectrum. 

The auctions also resulted in insufficient bidders for the D-block which has to be shared with public safety organizations.  There is no perfect solution.  Many analysts have suggested ways to, for example, establish a consortium for this block.

Alan Reiter
Thinkernetter
Tuesday June 17, 2008 2:30:10 PM
no ratings

Hi Paul,

You're right -- my column is about group -- aggregated -- telemetry-type information gathered (voluntarily or involuntarily), not individual personal data.  It is about retrieving "wisdom" from wireless aggregated data.

I'm not sure if "wisdom" should be replaced.  It could be replaced, if you want, with the Facts of Wireless Crowds or the Knowledge of Wireless Crowds or the Behaviors of Wireless Crowds.  That's just the start.  After retrieving the telemetry-type data, other software (or humans) correlate it with other databases to reach more detailed conclusions or assumptions.

Your question about ISPs offering or allowing anti-mining software is interesting.  I just suggested this type of software as a possibility.  There are a variety of "anti" programs (virus, trojans, etc.).  I haven't heard of an anti-mining program.  I wonder if one exists.  If not, I wonder if such a program will be created for cellular phones.  Interesting to speculate, eh?

Mr. Roques
Researcher
Tuesday June 17, 2008 1:43:54 PM
no ratings

For some services we would need some objective data probably obtained from sensors (say temperature or pollution) but for others the wisdom of crowds is all we've got.

I went to San Francisco this month and I was looking for some places to go for a drink at night. I asked in the hotel and the pointed me to a place, but it's not what I was looking for and never could find a place I wanted. If I had known of CitySense - which oddly enough has San Francisco in their demo - I would had been able to see where most people are going, and I guess it would be fairly easy to filter it to my age group (the possibilities are endless)

Next time I'll check CitySense first. 

Paul Whyte
Researcher
Tuesday June 17, 2008 1:23:02 PM
no ratings

Hi Kim,

You are right because i've benefitted so much from that discuss. I was just trying to highlight the perceive ambiguity in the title of the Post. Other than that, i think your discussion had benefitted the entire readership. I don't know if you can get a thinkernetter post base on that discussion. It would be really interesting!!

KimSolez
Thinkernetter
Tuesday June 17, 2008 12:43:31 PM
no ratings

Hi Paul,

There is in this thread a mixing up the words 'wisdom' and 'information' and 'data points' but I sense that in discussions like these we are seeing the Internet evolve before our very eyes.  Probably there is a word not invented yet which better captures what we are talking about, but that makes it all the more fun to engage in these debates. Certainly there is no reason to confine discussion within one narrow box. Sometimes as the discussion goes on it drifts into areas even more interesting and important than the original essay. It's all good!

Best regards. - Kim 

Joe_Earhart
IQ Crew
Tuesday June 17, 2008 12:28:53 PM
no ratings

A small cabal is always there to countermand them over "hanging chad..." or some such technicality.

Hey, since you are a wireless guru could you comment on that fiasco of a bandwidth spectrum auction that took place earlier this year or late last year as well as the story about the consultant they had appointed as 'overseer' and the quote unqoute "FEEs" that were going to be tributed to that consultant the bidders balked at...

Paul Whyte
Researcher
Tuesday June 17, 2008 10:29:23 AM
no ratings

Hi Alan,

Your discuss with Kim and others have skewed the intent of your Post or may be you have to re-phrase the title of your post to incorporate that discussion. I initially noticed that the word 'wisdom' will be mis-interpreted in this context to mean a 'collective decision' by cellphone users. So Kim and others have angled the discussion to include 'personal ' leadership as oppose to 'crowds'. I think what you basically want to drive on your post is that there is so much wealth of data from wireless crowds which can be harness by a variety of authorities in a variety of ways.

So may be to avoid the ambiguity, the word wisdomshould have been replaced. But i think you did a great job in the opening paragraph to emphasize the "wisdom" you are referring to rather than the more popular 'wisdom of the crowds'.

With regards to the anti-mining software, do you think ISPs will allow them to be installed or even to accept their use?

Alan Reiter
Thinkernetter
Tuesday June 17, 2008 12:16:20 AM
no ratings

Hi Kim,

A great comment!

As I wrote to Joe Earhart, I am certainly not a rah-rah cheerleader for everything about the wisdom of crowds. The fact that millions of people watch reality TV should dispel all notions about the omniscience of the great unwashed. Group-think is often dolt-think, and the true geniuses often go against conventional wisdom, as highlighted in that absolutely brilliant and moving Apple commercial for "think different."

However, wisdom comes from a variety of sources -- groups and individuals. Indeed, one of the great challenges of the Internet is for people to discern what are truth and lies.

Some of what you and Nikki are suggesting is in the nascent stages. As I wrote, Citysense is, literally, displaying blobs of red colors on phone screens to indicate the largest concentrations of people.

There is at least one solution to the problem of people turning off their phones to "cheat" about the number of people at a location: Fixed and portable cameras. With the prevalence of cameras (ask any Londoner.....or me living in the Washington, D.C. area!), it's "a simple matter of programing" to offer cellular phone applications that tap into cameras at bars, clubs, etc. Sure, there are security concerns. But they are mere bagatelles compared to the value of being able to see whether a dance club is busy.

I think we'll also see more wireless applications offered by amusement parks, such as being able to check wait times for attractions or no-reservation restaurants.  I'm actually researching that now for a possible "Thinkernet" article; still in the very early stages of the research.

We can already view all sorts of cameras via the wired Internet and are beginning to see the development of wirelessly viewing cameras, especially traffic cameras -- across the street or across the oceans. Of course, when the cellular camera bots are unleashed, we will be able to surreptitiously view surroundings via other people's camera phones. But I'm forbidden to talk about that.

No, I don't think you are dreaming. We don't need to take the blue pill to realize these speculations are completely do-able. With the development of increasingly sophisticated camera phones, location technologies, real-time monitoring software, etc., it's probably a matter of "when," not "if."

As for Schrodinger's Cat, well, it's only a cat. If it were a dog, then it would be important.

Page 1 of 2   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Alan Reiter
Alan Reiter
Alan Reiter   5/16/2013   30 comments
The apartment and house sharing service, Airbnb, now requires members to verify their identities by demonstrating a presence on the web, and by either scanning a government ID or entering detailed personal details. Other enterprises should take a close look at Airbnb's verification policies.
Alan Reiter
Alan Reiter   5/6/2013   46 comments
Enterprises must keep a close eye on the Marketplace Fairness Act, now before Congress, which would allow a nationwide sales tax on US online purchases. The bill's enactment will affect every business that operates or buys from an e-commerce website.
Alan Reiter
Alan Reiter   4/30/2013   57 comments
Samsung Electronics recently announced two Galaxy Mega branded phones with enormous screens -- 5.8 inches and 6.3 inches -- that could be useful for enterprises, especially those in vertical markets.
Alan Reiter
Alan Reiter   4/16/2013   52 comments
Virtual walls combine analog and digital elements -- paper posters and wireless transmissions -- that offer fascinating business and branding opportunities for enterprises. These walls are powerful tools because they merge the emotional experiences of the analog world with the intellectual experiences of the digital world.
Alan Reiter
Alan Reiter   3/25/2013   80 comments
While many retailers bemoan customers' use of showrooming, a handful of Internet-savvy companies are embracing this trend. From their perspective, the Internet is encouraging businesses to explore innovative ways to leverage online sales with brick-and-mortar or even engine-and-wheels locations.
5
of
Reiter's Block
Amazon's Kindle Whispercast Targets Enterprises

10|29|12   |   3:05   |   No comments


Amazon's Kindle offerings typically are aimed at consumers, but its new Whispercast content management service is for businesses and non-profits.
Wisdom of the Big Chair
Wireless Data Growth Is Wild!

4|30|12   |   2:50   |   9 comments


The amount of data traffic running over US wireless networks grew 123 percent from 2010 (388 billion MB) to 2011 (866.7 billion MB), according to the CTIA. Carriers have tried to prepare for the change by moving from 3G to 4G networks. But with data rates increasing so rapidly, will there be enough bandwidth to meet future demand? Doubtful!
Second Shooter
The Real Impact of Google+

7|15|11   |   2:13   |   14 comments


Maybe Google+ will be competitive and maybe it won't, but it's likely to introduce video calling and OTT communications as a replacement for standard telephony. There will be major consequences to this, and we don't have an FCC or political framework capable of coping.
Second Shooter
We May Face a 'Neutrality Tax'

2|2|11   |   02:08   |   2 comments


The explosive growth in Internet traffic is forcing ISPs to increase their access investments without generating new revenue. They'll need to either raise prices or make the OTT players like Google or Netflix pay.
Eurotrash
High & Dry in Barcelona

2|3|10   |   1:08   |   1 comment


Ray’s heading to Barcelona for the Mobile World Congress, and he’s not happy about it, the miserable git.
Second Shooter
80/20, 40/3, Shovel/Snow

12|14|09   |   2:09   |   No comments


The iPhone has created a new form of the 80/20 rule, according to AT&T, which claims only 3% of iPhone users generate 40% of wireless traffic. But is that really a justification for usage caps and pricing tiers? What did AT&T think was going to happen with the iPhone pricing plan, and are they shoveling something else at us now that we're hooked?
TeleGraham
2009: The Year the Internet Went Wireless

12|8|09   |   2:32   |   1 comment


With the number of mobile broadband users more than doubling in 2009, and soon to exceed fixed broadband, the Internet saw a historic transition this year – and the long-term effects are incalculable.
TeleGraham
China's Broadband Revolution

10|13|09   |   2:36   |   1 comment


China is investing heavily in fiber to the premises to propel itself into the world broadband Internet first division. What's it deploying, and what's it going to do with all that bandwidth?
Second Shooter
Firefox OS Points to Possible New Directions for Google

3|4|13   |   2:08   |   6 comments


A "Chromephone" would allow Google to regain the control it lost from Android.
Kim Davis
Buzzfeed Is Booming

1|11|13   |   2:07   |   1 comment


Buzzfeed, the viral post aggregator, raised nearly $20 million in new funding this week.
IETV: the thinkerNet on film
5
of
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Second Shooter
Locked Handsets Aren't the Problem – Subsidies Are the Problem

3|13|13   |   2:09   |   10 comments


Subsidized handsets, rather than locked handsets, should be the focus of regulators. We're not getting good deals, not fostering innovation, and weakening our power as buyers.
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   5/17/2013   1 comment
It's been 17 years since I've visited the city of Dublin, but I still have some very distinct impressions from my one and only visit.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
Websites Should Consider Tougher ID Verification Policies
Alan Reiter
The apartment and house sharing service,
Airbnb, now requires members to verify their identities by demonstrating a presence on the web, and by either scanning a government ID or entering detailed personal details. Other enterprises should take a close look at Airbnb's verification policies.

CLICK FOR MORE