The Macrosite for News, Analysis and Opinion about the Future of the Internet
John Myers

Ray Kurzweil's 'Singularity' Is a Terrifying Threat

Written by John Myers
8/14/2012 92 comments
DISCUSS     Email This

Singularity: n. The state, fact, or quality of being singular. That's the dictionary definition of the word. My personal definition is: the single greatest and most terrifying threat, ever, to the human species.

According to those who sing of the holy virtues of "the Singularity," thanks to ever-increasing improvements in technology and artificial intelligence programming, a time will come when man and machine merge; when it becomes possible for machines to become truly self-aware and self-learning; when the consciousness of man may be offloaded from the organic computer of the brain and loaded into electronic computers of man's design.

I can see the allure. Life everlasting -- assuming you don't get stuck on a cut-rate desktop with a failing hard drive. Or worse, some teenager's smartphone texting machine.

Ray Kurzweil, the inventor of text-to-speech synthesis, member of the US Patent Office National Inventors Hall of Fame, and Presidential-nominated holder of the National Medal of Technology and Innovation, is the leading evangelist of the Singularity vision. He's so for the notion that in addition to taking somewhere around 150 vitamins and supplements a day in an attempt to hang around long enough to see it happen, he's made a documentary film on the subject, called The Singularity Is Near.

Ray Kurzweil speaking at Stanford, 2008. Photo: Roland Dobbins.
Ray Kurzweil speaking at Stanford, 2008. Photo: Roland Dobbins.

Very original title aside, I'm not buying his vision.

Sorry. Just can't do it.

Unlike our man Ray, I don't see this as a good thing. In fact, the whole idea of a truly sentient machine scares the crap out of me, be it sentient by artificial intelligence (AI), or sentient by means of transference from the human brain.

Here's where Kurzweil's vision falls apart: If we do manage to make a self-aware AI, we would have to include limiting factors in AI code and resurrect slavery, or take the chance that AI-created cyborgs won't destroy us, a choice that would leave us open for variations on sci-fi themes: Borg? Robocop? Terminator? Human-form Replicators? A variation on The Matrix? Inspector Gadget?

We already have the Internet. We already have the beginnings of bionics and a thriving prosthetics industry. What's to stop something like the Borg from becoming the future of humankind?

Consider it for a moment. Okay, two moments. It's not at all difficult to imagine Borg-like qualities emerging from the joining of human and machine. There's the Pollyanna vision of Steve Austin and Jaime Sommers -- and then there's the more likely outcome, given the fact that humans are involved.

We're familiar with the effects of brain damage. It can lead to all manner of behavioral problems. Imagine the same type of thing happening to a "brain" that's connected to all the other "brains" via an Internet type massive mesh link. What's to stop some truly deranged "brain" from developing a virus that will spread and infest the whole of the Internet attached brains?

What if we develop a set of self-aware machines that one day realize they're dissatisfied with the whole notion of us being their lords and masters, a la Terminator?

What if we do develop the self-replicating nanobots Kurzweil envisions? What do we do when they get together and start acting like cells, forming networks and becoming specialized, then self-aware? Do we end up with human-form Replicators? Or simply machines that no longer deem us necessary? Picture a colony of army ants, operating at the cellular level. Get a chill?

Photo: Snarkhunt, via Wikimedia.
Photo: Snarkhunt, via Wikimedia.

Part of what makes humans great is our mortality. We know we're here for a limited number of years, and we work at achieving our goals before that time is up. What if we no longer have that mortality to spur us on? What if we had a virtually endless number of days in which to take on an infinite number of tasks? Would we take them on? Or would we become a species of procrastinators, willing to put off just about anything because we're no longer time constrained to get them done? Would we revert? Would we become something akin to the Feeders of Vaal -- slaves to a machine?

And, if we become capable of transferring the intelligence from a human brain to an electronic computer, what's to keep us from transferring the intelligence from a human brain to another human brain? Perhaps without the current owner's permission, like in Freejack?

These are just a few of the undesirable aspects of the Singularity. I'm sure if we consider it for a bit, we'll find a score or more of equal, or worse, risks associated with the idea. And if we can think of them now, when it's not a reality, consider how much worse it will be when it is.

Thanks for sharing the vision, Ray, but I'll pass.

Related posts:

— John Myers is a former computer science professor and the owner of several technology-related companies.

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 10   Next >
mhhfive
IQ Crew
Wednesday August 22, 2012 7:33:23 PM
no ratings

@Dr. John... yah, I think doped diamond is a next generation semiconductor material that will probably replace silicon... so watch out for strong AI on a diamond media, and technically, they'll be carbon-based, but not quite like humans are...

Dr. John
Thinkernetter
Wednesday August 22, 2012 6:53:03 PM
no ratings

mhhfive:

Silicon may be the weak link.  I think it'd probably take a much more capable medium.

mhhfive
IQ Crew
Wednesday August 22, 2012 6:30:20 PM
no ratings

Personally, the creation of Strong AI doesn't seem to be very likely. And I have a sneaky suspicion that there's a natural upper limit to super-intelligence, so even if we do create supercomputers with AI, they may only be as smart as the smartest people... but with the capability of not requiring sleep or rest, etc.

I think it's far more likely that we'll genetically engineer super-intelligent parrots or something before we create Strong AI on silicon.... 

mhhfive
IQ Crew
Wednesday August 22, 2012 6:23:14 PM
no ratings

There are numerous terrible bioweapons, and some of them arent' even secret. The deadly bird flu strain can be made into an airborne transmissible flu with only a few mutations. (Luckily, most terrorists are not biotech experts.) But that also means that Nature could create a terrible pandemic without any help... 

This is why we need to colonize Mars... just so we have some backup place to live. :P

Mary Jander
Thinkernetter
Wednesday August 22, 2012 5:37:00 PM
no ratings

Chilling stuff, Dr. J. I hope the Singularity, if it happens, doesn't turn out to be dramatically negative.

Dr. John
Thinkernetter
Wednesday August 22, 2012 5:27:52 PM
no ratings

Mary:

You don't hear about it more because you're not supposed to hear about it.  It's not the kind of thing you advertise.  Most of it is classified, regardless of origin or location of operations.  The scariest thing is that a lot of the "research" and development, doesn't take an expensive and secure lab.  A few basic precautions, and some equipment that could be fabricated in a handyman's workshop are all it takes. 

And, any lab designed to study a bug, is capable of manipulating a bug.

The info about the Soviet anthrax program was leaked a while back, and made it into some of the press, so I can talk about it.  But, most of this kind of info is classified, so I can only speak about it in the vaguest of terms. 

Kim Davis
Thinkernetter
Wednesday August 22, 2012 3:14:17 PM
no ratings

There are doubtless some philosophers who fit your descriptions, Mitch, but there were major philosophers in the eighteenth century (Kant) who didn't think the mind was machine-like, just as there are major twentieth century philosophers who don't think it's computer-like.  There's certainly a temptation, of course, to model our understanding on technology.

Mary Jander
Thinkernetter
Wednesday August 22, 2012 2:19:32 PM
no ratings

This is terrifying, Dr. John! Why don't we hear more about these horrible developments? Where are they happening?

Dr. John
Thinkernetter
Monday August 20, 2012 5:00:15 PM
no ratings

Aphilogelast:

I apologize if I gave the impression that I was denying the possibility of your post.  My intent was to expand on it.

Inhalation Anthrax is 100% without effective treatment.  Recently, a strain was proven to exist, purportedly developed by Soviet scientists decades ago, that is resistant to known treatments. 

One of the goals of the old bioweapons programs was to make treatment resistant strains of known, deadly agents.  Creating them was relatively simple.  Provide them with low doses of the treatment agents, gradually increasing their resistance to the point that they became what we now term as "superbugs". 

Take these old methods, add modern genetic engineering, rather than just trial and error mutation, and things get even scarier, even quicker.

 

no ratings

Sadly, some people aren't great spokespersons for the views or brands they're expounding. Not everyone has stage presence. I can't speak to his honesty, but I think Ray Kurzweil is unfortunately one of those people who come across as cold and, frankly, weird -- and not in a good way.

Page 1 of 10   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from John Myers
John Myers
John Myers   3/9/2012   19 comments
At Internet Evolution we spend a fair bit of our resources on topics related to the Internet. Hey, it comes up.
John Myers
John Myers   2/1/2012   27 comments
So, you finely got your new smartphone. Shiny! (If you don’t get the reference to “shiny,” you’re not a Firefly fan, but I won’t hold that against you.) You waited patiently until your carrier offered just what you wanted -- with just the right features, at just the right price -- and your new phone discount was finally available again.
John Myers
John Myers   1/25/2012   67 comments
Here's some food for thought: Installing a Webcam in primary public education classrooms could result in billions of dollars saved annually.
John Myers
John Myers   1/16/2012   43 comments
I drive a minivan. I know what you’re thinking. It’s not because I’m having a midlife crisis and need to drive something sexy, a veritable chick magnet, but because it’s practical for a small-business owner and grandpa.
IETV: the thinkerNet on film
5
of
John Kennedy
How Big-Data Is Changing Marketing

6|13|13   |   1:07   |   1 comment


Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   10 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   1 comment


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
2pm EDT
Fri
Jun 21st
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   6/18/2013   Post a comment
The IBM Smarter Commerce Global Summit in Monaco kicked into high gear today, and we've already begun to see news emerging from that lovely city-state by the sea.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
NSA Leaks Shine Spotlight on Perils of Contractor Partnerships
Jason Mick
The US National Security Agency learned the
hard way that it can be dangerous to give a contractor too much money and access, with too little scrutiny. The NSA and other government agencies hire tens of thousands of contractors a year to analyze data. Edward Snowden -- who revealed himself as the NSA leaker after fleeing the country -- was one such contractor, reportedly holding a $122,000 salaried position at Booz Allen Hamilton at the time of his departure.

CLICK FOR MORE