Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011 by Nancy Owano report

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. According to the official description from its creators, there is at work a "novel real-time algorithm for representing hands and other physical objects" allowing physically realistic interaction between real and virtual 3-D objects.

Holodesk does its magic with the help of an optical see-through display plus Kinect camera. The illusion is that the user is directly touching and maneuvering 3-D graphics. According to the project notes, a of a 3-D scene is rendered through a half-silvered mirror and spatially aligned with the real world for the viewer.

This video is not supported by your browser at this time.

A Holodesk video shows the user looking down on a pane of glass at virtual but very realistic-looking balls and other shaped objects. His hands are positioned underneath the glass and they move in such a way that you think the user is actually moving real objects around. He scoops real balls into cups, or so it seems. The video as a whole is a deft rendering of how the virtual and real meet. While Holodesk is not the only 3-D interaction experiment out there, observers say it stands away from the pack, with its use of called beam-splitters and a graphic processing algorithm, in providing a life-like experience.

Holodesk is one of the latest innovations within the and Devices Group (working with technologies such as sensors, flexible electronics, and novel displays)at Microsoft Research. The latter, since its establishment in 1991, has become a large and active software research organization.

Microsoft Research joins today's research hotbeds looking at enhancing environments. The name of the game is creating clever ways to enable the user to cross that magical bridge between reality and the virtual. Meantime, Microsoft itself is reportedly working on all fronts on innovations that involve the “natural user interface,” or in software developer parlance, the NUI. A NUI is supported by technology that frees up users to carry out relatively natural movements or gestures that control and manipulate on-screen content. As such, the NUI is elevated as one of the next big things in human-machine interactions.

As for possible applications for Holodesk, easy assumptions might place it squarely in gaming but its potential may also one day surface in design and research. In this wider sense, the Holodesk debut is one more idea from Microsoft Research that suggests a bright NUI future.

Explore further: For Google's self-driving cars, learning to deal with the bizarre is essential

More information: via Microsoft blog

Related Stories

Virtual reality you can touch (w/ Video)

Aug 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. ...

3D without the glasses: introducing pCubee (w/ Video)

Mar 31, 2010

(PhysOrg.com) -- After a wave of 3D movies such as Alice in Wonderland and Avatar, and a number of television manufacturers producing 3D TVs this year, there is growing interest in a three-dimensional viewing ...

Gesture recognition

Dec 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. ...

Virtual reality you can reach out and touch

Jul 01, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

HIRO III lets you feel what you see on screen (w/ Video)

Jul 02, 2010

(PhysOrg.com) -- Researchers in Japan are developing a new touch screen system, the HIRO III, that incorporates a robot hand that could offer a new way of simulating the touching of virtual objects and receiving ...

Recommended for you

Bluetooth may be the key to your future smart home

Nov 25, 2014

If you've ever considered trying to turn your house into a smart home, you've likely found the prospect expensive or technologically intimidating. That situation could soon change, thanks in part to an old ...

Self-driving cars could be the answer to congested roads

Nov 24, 2014

If cars with drivers still suffer under gridlock conditions on roads, how will driverless cars fare any better? With greater computerisation and network awareness, driverless cars may be the answer to growing ...

User comments : 12

Adjust slider to filter visible comments by rank

Display comments: newest first

Isaacsname
3 / 5 (1) Oct 20, 2011
Nice, I want to see the interface monkey play against the pingpong robot over this. They could get the robot mouth to cheer for them.

" AAAAAAAAAAA...EEEEEEEEEEEE...OOOOOOOOOOOO...UUUUUUUUU "

No , on a serious note, this would be interesting integrated into glasses/wearable goggles, might appear to external observers that the user is grabbing invisible butterflies, but,..it's cool.

Kingsix
1 / 5 (1) Oct 20, 2011
Wow, totally cool.
kaasinees
0.7 / 5 (25) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.
gwrede
3 / 5 (2) Oct 20, 2011
Some five years ago I saw a system that blew puffs of air into one's hands and created the illusion o handling tangible objects. I'd like to try it with this system.
Pirouette
1 / 5 (3) Oct 20, 2011
and I was thinking of purchasing Windows 7. . .so maybe I should just hold off and wait a few years for this new hi tech.
powerup1
3 / 5 (2) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.


@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.
Osiris1
1 / 5 (1) Oct 21, 2011
Now about that spin off project to take a supermodel and make a holodeck model of her three dimensional photometric 'image'....ahhh the possibilities are endless...now program sensory inputs and detectors....and transducers...
Ricochet
not rated yet Oct 21, 2011
"half-slivered"
You mean "silvered"?
kaasinees
0.7 / 5 (25) Oct 21, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.


@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.


Because its just a projection with some cameras and software, no big deal, in fact some of the software most likely developed in university of netherlands.

If you compare that with real hologram systems that have been studied this is no big deal.
oliverrp
not rated yet Oct 23, 2011
Ricochet: Looks like "silvered" to me.
Ricochet
not rated yet Oct 25, 2011
They must've corrected it, then. That or I'm somewhat lysdexic.

I'm surprised no one's made any ball jokes yet.
yedead1
not rated yet Oct 29, 2011
@Isaacsname
already been done with the vuzix star1200 ar glasses :)

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.