When Pranav Mistry previewed this technology during an enthralling TED Talk in November 2009, he promised that, one day in the near future, developers would have access to the tools they needed to build their own "Sixth Sense" devices, open-source-style.
Sixth Sense uses hand gestures to control interactions as opposed to a mouse, trackball, or screen. Mistry's goal: To seamlessly connect the virtual and physical worlds in order to make the computing experience more intuitive. As a result, he wanted to remove the digital world from the confines of the smartphone or tablet and bring that world to everyday objects such as paper, walls, and t-shirts.
"Rather than getting your camera out of your pocket, you can just do the gesture of taking a photo and it takes a photo for you," he said in the video.
The Future Is Here
In his TED talk, Pranav Mistry demonstrated his open-source-based technology that eliminates the need for typical screens or hardware, and uses "screens" such as paper, wrists, or walls to display data.
Recently Mistry lived up to his promise of sharing his powerful technology. The code and hardware component list (HCL) for Sixth Sense are now available. Wearable technology, as defined by Apple, Samsung, Dell, HP, and Microsoft, looks much different than the world Mistry envisioned four years ago. By offering this technology for free and open-source-style, Sixth Sense is definitely not on the same roadmap that the big boys of high tech are traveling.
The components you need to build a Sixth Sense device are both off-the-shelf and inexpensive. They include:
Camera to capture the user’s hand movements and gestures, take pictures, and interpret users' “framing” gestures. Approximate cost: $50
Projector for output (GUI), giving the ability to use virtually any surface as a “monitor,” as well as augmenting physical objects with real-time content. Approximate cost: $250
Mirror measuring 1” x 1” as a physical relay for the projected image. Approximate cost: $5
Microphone, used to enable paper as an interactive surface by capturing sound across the paper medium. With current camera tech, the microphone is usually part of the camera apparatus. Approximate cost: $0
Mobile computing device -- smartphone or laptop. Approximate cost: Varies
That totals about $300 in hardware, all based on readily available, off-the-shelf components. That's not a huge investment, given the impact of the technology. Currently, no (or perhaps only a few) VARs are marketing Sixth Sense, although I predict this will change -- soon. Packaging the system with software to create a usable bundle of some wearable device at an inexpensive purchase price is inevitable.
Gaming platforms adopted gesture- and voice-based recognition, allowing for free-form game play and voice command for software manipulation. Microsoft, Apple, and BlackBerry accustomed users to control their devices via gesture and swipe commands. Now a new tier of tablet manufacturers can pull up a seat at the mobile table, given the low-cost barrier to entry and the potential market for vertical, specialized, inexpensive models, or diverse new wearable prototypes based on these open-source specs.
The table has been set for a truly intuitive platform to sweep the marketplace. I foresee the release of “Sixth Sense” as a free open-source alternative will have a big effect on an already explosive impact.
Well, what I was just reading is that it will need special apps... its not clear if thats for the device to function or apps that will take full advantage of it. To make myself clear, will it work with my current apps or will I need a whole new set of apps? If its the latter, I dont see it going far.
This technology is very similar to Leap Motion. If you havent heard of it, check it out (theres a nice youtube video). Coincidentally, it announced it will sell its tech soon.
@Mr.Roques, thanks for sharing this info. Just read that this company has created a system that seems to let you type on thin air and it also has predictive text correction. It would be interesting to know what other products are being developed by this company.
Ubuntu-based browser shell for mobile OS's is really gaining a lot of interest from those looking for inexpensive alternatives to Android, Apple, and BlackBerry smart phone devices.
@nathanwosnack, is this mobile OS already released to the market ? Are there any apps available in market which can be installed on thsi OS ?
I was also actually thrilled when I saw this Pranav Mistry's TED talk more than a couple of years ago. What is commendable about it is, he is releasing it in the open source market. Probably the reason might be that the hardware is very simple enough to manufacture. But, whatever it is, I just hope to see the sixth sense ddevices ASAP.
I like this concept. We can consolidate the number of object we need to use by making them all more multifunctional. We're already seeing this in our phones, tablets and computers. But this is the next step, especially for those of us who like to own less, not more.
Open source initiatives by Firefox, releasing an Ubuntu-based browser shell for mobile OS's is really gaining a lot of interest from those looking for inexpensive alternatives to Android, Apple, and BlackBerry smart phone devices.
I think this whole sixth sense technology will change the future as we know it. It seems like more and more people are adoption tablets, as well as touch screen computers. It seems like it won't be much longer before mouse and keyboards become no longer the norm. It is both sad and exciting. I am just curious as to how many people are willing to give up the control the actual keyboard and mouse have willingly, before they become rare?
This technology is very similar to Leap Motion. If you havent heard of it, check it out (theres a nice youtube video).
Coincidentally, it announced it will sell its tech soon.
When I saw the TedX Talks featuring the Sixth Sense Tech, I immediately pictured Tom Cruise in Minority Report manipulating a virtual database interface. Even that fictional representation required the user wear gloves! Amazing what Sixth Sense is doing at such a reasonable price!
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
Throughout their generations, medical records have promised us lowered costs, increased efficiency, and generally better healthcare. However, despite untold dollars and the efforts of some very smart people, we've yet to realize a fully electronic medical record.
When one of my team members recently responded to network-down call at a client's home office, he quickly established, beyond a shadow of a doubt, that the edge device -- a customer premise equipment (CPE) router -- had been compromised. Regaining control of the edge router proved difficult. A neighbor who was within range of the 802.11n wireless radio was actively hacking the router, overpowering the field tech with password resets in real time. In order to regain control of the network, the tech had to remove the antennas, allowing for LAN access only to the routing edge, and effectively cutting off the hack by cutting off his basic access.
This year's opening keynote speech at the Consumer Electronics Show (CES) broke the mold: Dr. Paul Jacobs, CEO of Qualcomm, delivered the first non-Microsoft presentation in a dozen years. Though Microsoft CEO Steve Ballmer did make an appearance, the presentation was dominated by a core technology for release by Qualcomm this year.
Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The IBM Smarter Commerce Global Summit in Monaco kicked into high gear today, and we've already begun to see news emerging from that lovely city-state by the sea.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.
Email This
