The Macrosite for News, Analysis and Opinion about the Future of the Internet
Ken Trough

Saving the Internet From Stupidity

Written by Ken Trough
1/7/2008 9 comments
no ratings
DISCUSS     Email This

Is the Internet getting smarter, or is it just ignoring stupidity? It could be a little of both if the founders of the StupidFilter Project have their way.

Gabriel Ortiz, a Linux enthusiast, and Paul Starr, a novelist and scholar, were tired of tolerating the stupid content that appears to be growing on the Web. They decided to fight back with an open-source filter software that can detect rampant stupidity in written English. Termed the "StupidFilter Project," this tool is set to launch this month, January '08, and will give Web users a method for determining what content is legitimate and what is "stupid."

The source-code filter, intended to help users weed out worthless Internet content, can be incorporated into Websites, content management systems, blogs, wikis, and the like. A fully implemented Firefox plug-in and a Wordpress plug-in are also expected to come later.

So what process does this filter use to determine what is stupid? The StupidFilter will look for things that are characteristically stupid and weigh them according to how often they occur. Currently, hand-picked examples of idiotic comments are graded by moderators who rank them on a scale from 1 to 5, with 1 being least stupid, and 5 being most stupid. Moderators are told to be especially cognizant of the fact that they are ranking form, and not content. Eventually, the creators plan to release a core engine source code for the filter, which will include weighted Bayesian or similar analysis and some rules-based processing, similar to spam detection engines.

As Ortiz put it, "A passionate defense of Britney Spears' status as 'The Queen of Pop' cannot be marked stupid simply because of the commenter's arguably poor musical taste." Moderators will look for punctuation and grammatical errors, excessive emoticon or acronym use, and pervasive misspelling, which Ortiz says are "the earmarks of careless composition or simple inability to effectively wield language."

From my perspective, there are a lot of stupid posts and a lot of stupid people on the Web. This should come as no surprise to anyone. If it does, you are probably one of those people.

Now, before you slam me for being insensitive, I'm not talking about your grandmother who just got online last week, nor am I talking about someone who struggles to communicate with English as a second (or third) language. I am talking about the people who, for example, post messages using a form of "stupid shorthand" to communicate. I'm referring to those excessive abusers of too many text messages and popular abbreviations -- from LOL (Laugh Out Loud) to BRB (Be Right Back).

I asked Ortiz about his goals for filtering egregiously stupid comments and the impact it might have on the Internet. "I'm really hoping that even with moderate uptake of this concept, whether or not my particular implementation sees widespread usage, this idea will improve the discourse on the Internet in general," he said.

Ortiz sees the StupidFilter Project as having something of a cohesive effect on the evolution of written English. "In my more hubris-filled daydreams, I hope that it will save us from a Tower of Babel type situation where incomprehensible Balkanization of the language occurs," explains Ortiz. As the project site reminds us, the Internet needs prophylactics for mimetically transmitted diseases (information corrupted by stupidity).

So what happens if the StupidFilter project becomes really popular and influential? Would Ortiz ever be tempted to filter out an ex-friend for being terminally stupid? "Our principles are to adhere strictly to form over content, so we're going to try to prevent any kind of bias," says Ortiz. "But if some kind of bias were to creep in, it's always possible for someone to fork the code and start a competing filter."

That's the beauty of open source, I suppose.

Out here in the ether, we have been treading water for years on a virtual "Sea of Stupidity." It is gratifying to see that someone is finally starting to build a raft to help us float above it all. This is a key trend that will become much more important as time moves on.

— Ken Trough, Social network moderator and technology expert

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Paul Whyte
Researcher
Tuesday January 8, 2008 1:11:05 PM
no ratings

The idea is certainly innovative but i think the name is definitely inappropiate. I think the pioneers of this so-call StupidFilter or StupidityFilter as my colleague refers to it should coin a more appropiate term for their new product. Something can be grammatically correct and yet utterly stupid.

Whilst this will allow me to read coments without wanting to rip my eyeballs out, the best part will be the users who are unable to post thier comments and would say" Yo I tried 333 tiems to comemt and can't!!!! Watfxup??? How will this StupidityFilter rate this one??? I guess it would be 5.

Anyway, i agreed 100% with the person who wrote this article: The StupidFilter is sooooo stooopid!!!!

jonhenshaw
Rank: Cave Painter
Tuesday January 8, 2008 11:55:01 AM
no ratings
Sounds like what they need is their own private forum where they can all love on each others' elitism.
M Hulot
IQ Crew
Tuesday January 8, 2008 9:59:35 AM
no ratings

"prophylactics for mimetically transmitted diseases"?

Now, that's stupid.

viboons
Researcher
Tuesday January 8, 2008 9:05:48 AM
no ratings

First of all, filtering out content with "rampant stupidity in written English" won't make the Internet any smarter. However, geting the stupidity filter to work, to get rid of actual stupid or worthless content on the Web, will be a very smart and useful thing. It's not impossible to achieve, but if it doesn't work it will officially be known as the "stupid filter" rather than "stupidity filter" (StupidFilter Project).

Since stupidity is anything but absolute, the filter needs to be customizable and can be fine-tuned to a certain level as required by users as most of them would have different opinions on what's stupid and to what degree. This makes it very challenging and will require intelligence in the filtering algorithm.

"Stupid is as stupid does" - Forrest Gump (1994) 

ielid
Rank: Cave Painter
Tuesday January 8, 2008 1:33:38 AM
no ratings

what is "blind to irony" ?

 

 

Tim Bell
Rank: Cave Painter
Monday January 7, 2008 7:25:24 PM
I would like a portable version that could be worn around town much like earmuffs. The perfect complement to your next staff meeting.

Rated a negative five monkeys.
Insultant
Thinkernetter
Monday January 7, 2008 5:54:18 PM

this code sounds less like a stupidity filter and more like a grammar checker. Is there even a correlation between how people write and the value of the content? I'm not sure that there is. Seems like the only thing this will do is divide posts from old people from those from young people.

Insultant.  

Mashka

Hello,Ken!

I think, saying there are a lot of stupid people on the web is just the same  as saying ,there are  stupid people.Well,  because there ARE stupid people, and their quantity on the web is  about the same that off-line. there is a permanent ratio.  and it just has been moved on-line:).But we deal with it off-line somehow,so we learn to deal with it on line:)

Jasper Sluijs
Researcher
Monday January 7, 2008 5:37:59 PM
Hi Ken,

Thank you for introducing the StupidFilter project to me. It seems like a very interesting project by two self-proclaimed elitists, which I'm sure will get a lot of attention once running.

I'm however not sure if I completely agree with Ortiz and Star's justification of the StupidFilter. There seem to be some issues they clearly haven't really thought about that well. First of all, 'stupidity' exists everywhere, and always has. Nevertheless there's no reason to assume that there's more stupidity in the online world than there is in RL (pardon my popular abbreviation), or that social computing enhances stupidity. The Flynn effect convincingly demonstrates that IQ levels rise with every generation, and I don't see emoticons changing anything to that. Based on the work of Steven Johnson, I argue that an initiative like the StupidFilter trivializes the level of complexity (online) popular culture offers. Ortiz and Star's focus on formal aspects might be more objective than an emphasis on content, it's still reductionist.

Second of all, the idea behind the StupidFilter seems to bypass the fact that language naturally evolves through popularized usage. That's how 'it is' became 'it's' and the British 'colour' became 'color' in American English. This development in language is self-regulating, but this does not imply that every popularization makes it into mainstream language. The purism of Ortiz and Star is of all ages, and in most cases is uttered by non-linguists. Whoever is completely against the 'degrading' of the english language by 'stupid' utterances might as well dress up for his/her appearance at the 'pre-Roman Britain' live action role playing party, where only pure English is uttered.

By the way: as if fancy capitalization (StupidFilter) isn't a clear example of "pervasive misspelling."

Finally: Ortiz and Star's romantic notion of "the internet was a place where one could communicate intelligently with similarly erudite people" is debatable, to say the least. As if pre-Eternal September internet ever was the haven of eloquence...
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Ken Trough
Ken Trough
Ken Trough   12/6/2007   14 comments
Apple Inc. (Nasdaq: AAPL) is at a crossroad. Ever since the runaway success of the iPod, followed by the introduction of its wildly popular iPhone, Apple has transformed itself into a dominant player in the consumer electronics marketplace. But the growth has brought big changes. Gradually, Apple has been using its influence to act like a digital bully.
Ken Trough
Ken Trough   10/31/2007   3 comments
Wireless Broadband Internet access combined with new powerful hand-held devices is allowing us to richly collaborate from almost anywhere on the planet. This capability, which grants us greater productivity and participation in each other's projects, is key to creating a successful social enterprise network that can enhance business competitiveness.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   3 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
Yahoo Needs to Break Tumblr in Order to Fix It
Joe Stanganelli
As
Mitch Wagner discussed today, Yahoo is acquiring Tumblr. The big Internet debate at the moment is whether Tumblr will be good or bad for Yahoo. Regardless of their stances on the future of Yahoo itself, many claim that Yahoo will somehow ruin Tumblr.

CLICK FOR MORE