Holodesk prototype puts life in computers (w/ video)

October 20, 2011 by Nancy Owano report

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. According to the official description from its creators, there is at work a "novel real-time algorithm for representing hands and other physical objects" allowing physically realistic interaction between real and virtual 3-D objects.

Holodesk does its magic with the help of an optical see-through display plus Kinect camera. The illusion is that the user is directly touching and maneuvering 3-D graphics. According to the project notes, a of a 3-D scene is rendered through a half-silvered mirror and spatially aligned with the real world for the viewer.

A Holodesk video shows the user looking down on a pane of glass at virtual but very realistic-looking balls and other shaped objects. His hands are positioned underneath the glass and they move in such a way that you think the user is actually moving real objects around. He scoops real balls into cups, or so it seems. The video as a whole is a deft rendering of how the virtual and real meet. While Holodesk is not the only 3-D interaction experiment out there, observers say it stands away from the pack, with its use of called beam-splitters and a graphic processing algorithm, in providing a life-like experience.

Holodesk is one of the latest innovations within the and Devices Group (working with technologies such as sensors, flexible electronics, and novel displays)at Microsoft Research. The latter, since its establishment in 1991, has become a large and active software research organization.

Microsoft Research joins today's research hotbeds looking at enhancing environments. The name of the game is creating clever ways to enable the user to cross that magical bridge between reality and the virtual. Meantime, Microsoft itself is reportedly working on all fronts on innovations that involve the “natural user interface,” or in software developer parlance, the NUI. A NUI is supported by technology that frees up users to carry out relatively natural movements or gestures that control and manipulate on-screen content. As such, the NUI is elevated as one of the next big things in human-machine interactions.

As for possible applications for Holodesk, easy assumptions might place it squarely in gaming but its potential may also one day surface in design and research. In this wider sense, the Holodesk debut is one more idea from Microsoft Research that suggests a bright NUI future.

Explore further: Microsoft shows off 3D and NUI technology (w/ Video)

More information: via Microsoft blog

Related Stories

Virtual reality you can touch (w/ Video)

August 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. By incorporating ...

3D without the glasses: introducing pCubee (w/ Video)

March 31, 2010

(PhysOrg.com) -- After a wave of 3D movies such as Alice in Wonderland and Avatar, and a number of television manufacturers producing 3D TVs this year, there is growing interest in a three-dimensional viewing experience. ...

Gesture recognition

December 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. ...

Virtual reality you can reach out and touch

July 1, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

HIRO III lets you feel what you see on screen (w/ Video)

July 2, 2010

(PhysOrg.com) -- Researchers in Japan are developing a new touch screen system, the HIRO III, that incorporates a robot hand that could offer a new way of simulating the touching of virtual objects and receiving feedback ...

Recommended for you

A not-quite-random walk demystifies the algorithm

December 15, 2017

The algorithm is having a cultural moment. Originally a math and computer science term, algorithms are now used to account for everything from military drone strikes and financial market forecasts to Google search results.

US faces moment of truth on 'net neutrality'

December 14, 2017

The acrimonious battle over "net neutrality" in America comes to a head Thursday with a US agency set to vote to roll back rules enacted two years earlier aimed at preventing a "two-speed" internet.

FCC votes along party lines to end 'net neutrality' (Update)

December 14, 2017

The Federal Communications Commission repealed the Obama-era "net neutrality" rules Thursday, giving internet service providers like Verizon, Comcast and AT&T a free hand to slow or block websites and apps as they see fit ...

The wet road to fast and stable batteries

December 14, 2017

An international team of scientists—including several researchers from the U.S. Department of Energy's (DOE) Argonne National Laboratory—has discovered an anode battery material with superfast charging and stable operation ...


Adjust slider to filter visible comments by rank

Display comments: newest first

3 / 5 (1) Oct 20, 2011
Nice, I want to see the interface monkey play against the pingpong robot over this. They could get the robot mouth to cheer for them.


No , on a serious note, this would be interesting integrated into glasses/wearable goggles, might appear to external observers that the user is grabbing invisible butterflies, but,..it's cool.

1 / 5 (1) Oct 20, 2011
Wow, totally cool.
0.7 / 5 (25) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.
3 / 5 (2) Oct 20, 2011
Some five years ago I saw a system that blew puffs of air into one's hands and created the illusion o handling tangible objects. I'd like to try it with this system.
1 / 5 (3) Oct 20, 2011
and I was thinking of purchasing Windows 7. . .so maybe I should just hold off and wait a few years for this new hi tech.
3 / 5 (2) Oct 20, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.

@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.
1 / 5 (1) Oct 21, 2011
Now about that spin off project to take a supermodel and make a holodeck model of her three dimensional photometric 'image'....ahhh the possibilities are endless...now program sensory inputs and detectors....and transducers...
not rated yet Oct 21, 2011
You mean "silvered"?
0.7 / 5 (25) Oct 21, 2011
Pretty cool indeed.

But its just a package of existing systems put into one.

@kaasinees. I don't get the point in the last paragraph of your statement. The dismissive tone seems odd.

Because its just a projection with some cameras and software, no big deal, in fact some of the software most likely developed in university of netherlands.

If you compare that with real hologram systems that have been studied this is no big deal.
not rated yet Oct 23, 2011
Ricochet: Looks like "silvered" to me.
not rated yet Oct 25, 2011
They must've corrected it, then. That or I'm somewhat lysdexic.

I'm surprised no one's made any ball jokes yet.
not rated yet Oct 29, 2011
already been done with the vuzix star1200 ar glasses :)

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.