Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011 by Nancy Owano report

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. According to the official description from its creators, there is at work a "novel real-time algorithm for representing hands and other physical objects" allowing physically realistic interaction between real and virtual 3-D objects.

Holodesk does its magic with the help of an optical see-through display plus Kinect camera. The illusion is that the user is directly touching and maneuvering 3-D graphics. According to the project notes, a of a 3-D scene is rendered through a half-silvered mirror and spatially aligned with the real world for the viewer.

This video is not supported by your browser at this time.

A Holodesk video shows the user looking down on a pane of glass at virtual but very realistic-looking balls and other shaped objects. His hands are positioned underneath the glass and they move in such a way that you think the user is actually moving real objects around. He scoops real balls into cups, or so it seems. The video as a whole is a deft rendering of how the virtual and real meet. While Holodesk is not the only 3-D interaction experiment out there, observers say it stands away from the pack, with its use of called beam-splitters and a graphic processing algorithm, in providing a life-like experience.

Holodesk is one of the latest innovations within the and Devices Group (working with technologies such as sensors, flexible electronics, and novel displays)at Microsoft Research. The latter, since its establishment in 1991, has become a large and active software research organization.

Microsoft Research joins today's research hotbeds looking at enhancing environments. The name of the game is creating clever ways to enable the user to cross that magical bridge between reality and the virtual. Meantime, Microsoft itself is reportedly working on all fronts on innovations that involve the “natural user interface,” or in software developer parlance, the NUI. A NUI is supported by technology that frees up users to carry out relatively natural movements or gestures that control and manipulate on-screen content. As such, the NUI is elevated as one of the next big things in human-machine interactions.

As for possible applications for Holodesk, easy assumptions might place it squarely in gaming but its potential may also one day surface in design and research. In this wider sense, the Holodesk debut is one more idea from Microsoft Research that suggests a bright NUI future.

Explore further: The ethics of driverless cars

More information: via Microsoft blog

Related Stories

Virtual reality you can touch (w/ Video)

Aug 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. ...

3D without the glasses: introducing pCubee (w/ Video)

Mar 31, 2010

(PhysOrg.com) -- After a wave of 3D movies such as Alice in Wonderland and Avatar, and a number of television manufacturers producing 3D TVs this year, there is growing interest in a three-dimensional viewing ...

Gesture recognition

Dec 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. ...

Virtual reality you can reach out and touch

Jul 01, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

HIRO III lets you feel what you see on screen (w/ Video)

Jul 02, 2010

(PhysOrg.com) -- Researchers in Japan are developing a new touch screen system, the HIRO III, that incorporates a robot hand that could offer a new way of simulating the touching of virtual objects and receiving ...

Recommended for you

Fitbit to Schumer: We don't sell personal data

32 minutes ago

The maker of a popular line of wearable fitness-tracking devices says it has never sold personal data to advertisers, contrary to concerns raised by U.S. Sen. Charles Schumer.

C2D2 fighting corrosion

1 hour ago

Bridges become an infrastructure problem as they get older, as de-icing salt and carbon dioxide gradually destroy the reinforced concrete. A new robot can now check the condition of these structures, even ...

Should you be worried about paid editors on Wikipedia?

4 hours ago

Whether you trust it or ignore it, Wikipedia is one of the most popular websites in the world and accessed by millions of people every day. So would you trust it any more (or even less) if you knew people ...

User comments : 12

Adjust slider to filter visible comments by rank

Display comments: newest first

Isaacsname
3 / 5 (1) Oct 20, 2011
Nice, I want to see the interface monkey play against the pingpong robot over this. They could get the robot mouth to cheer for them.

" AAAAAAAAAAA...EEEEEEEEEEEE...OOOOOOOOOOOO...UUUUUUUUU "

No , on a serious note, this would be interesting integrated into glasses/wearable goggles, might appear to external observers that the user is grabbing invisible butterflies, but,..it's cool.

Kingsix
1 / 5 (1) Oct 20, 2011
Wow, totally cool.
kaasinees
0.7 / 5 (25) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.
gwrede
3 / 5 (2) Oct 20, 2011
Some five years ago I saw a system that blew puffs of air into one's hands and created the illusion o handling tangible objects. I'd like to try it with this system.
Pirouette
1 / 5 (3) Oct 20, 2011
and I was thinking of purchasing Windows 7. . .so maybe I should just hold off and wait a few years for this new hi tech.
powerup1
3 / 5 (2) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.


@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.
Osiris1
1 / 5 (1) Oct 21, 2011
Now about that spin off project to take a supermodel and make a holodeck model of her three dimensional photometric 'image'....ahhh the possibilities are endless...now program sensory inputs and detectors....and transducers...
Ricochet
not rated yet Oct 21, 2011
"half-slivered"
You mean "silvered"?
kaasinees
0.7 / 5 (25) Oct 21, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.


@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.


Because its just a projection with some cameras and software, no big deal, in fact some of the software most likely developed in university of netherlands.

If you compare that with real hologram systems that have been studied this is no big deal.
oliverrp
not rated yet Oct 23, 2011
Ricochet: Looks like "silvered" to me.
Ricochet
not rated yet Oct 25, 2011
They must've corrected it, then. That or I'm somewhat lysdexic.

I'm surprised no one's made any ball jokes yet.
yedead1
not rated yet Oct 29, 2011
@Isaacsname
already been done with the vuzix star1200 ar glasses :)