TED SpaceTop presenter is redefining hands-on computing (w/ video)

Feb 27, 2013 by Nancy Owano report

(Phys.org)—Jinha Lee, an MIT graduate student, this week showed his SpaceTop, a desktop environment where you can "reach inside" a computer screen and manipulate objects as if they were real. Lee, who initially worked on the concept as an intern with Microsoft Applied Science, presented the SpaceTop at the TED conference. The project earlier on had been tagged at Microsoft as the 3-D See-Through Desktop.

The SpaceTop presented this week shows how users can type, click, and draw in 2-D, and directly manipulate interface elements that float in the 3-D space above the keyboard, according to Lee. SpaceTop makes it easy for a user to switch from one modality to another, or to simultaneously use two modalities with different hands.

In one scenario demonstrated by Lee, users can place their hands behind the screen to scroll or type as in traditional computers, and can directly manipulate display objects as well with their hands. SpaceTop enables bimanual interaction, where each hand is associated with an interaction of different fidelities, according to Lee. The user can use one hand to flip through a pile of documents while using another hand to specify a line in the main document. In other scenarios, users can prototype a model with free-form manipulation.

The buzz surrounding this , though in its early phase, is that of a concept stirring imaginations for what the next big things in interface experiences might be. Lee's stepping stone to the future is powered by an . The system uses two cameras. One tracks the user's gestures. The other tracks the user's and makes adjustments on what is displayed so that everything appears as correct. The ability to manipulate objects in a see-through scenario will not easily relate to all work tasks, but Lee said that his 3-D interaction could make sense for a number of use cases, such as collaboration, design, and even trying on virtual clothes.

Lee looks forward to users being able to freely experience a seamless work experience of transitioning regularly between 2-D and 3-D manipulations. Through the use of depth cameras and a transparent display, interaction modalities can occur in a unified workspace.

Lee, selected as a TED Fellow, has described his role as "an interaction designer and researcher working at the boundary of physical and digital world." His inventions include levitating tangible interfaces and a pen that reaches inside a screen.

A video presentation, "Integrating 2-D and spatial 3-D interactions in a see-through desktop environment," carries credits of the team involved in working on the see-through environment as shown in the video. Besides Lee are Alex Olwal, Hiroshi Ishii and Cati Boulanger. Olwal and Ishii are from the MIT Media Lab and Boulanger is from Microsoft .

Explore further: Bringing history and the future to life with augmented reality

More information: www.leejinha.com/spacetop

Related Stories

Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" ...

Recommended for you

Patent talk: Google sharpens contact lens vision

Apr 16, 2014

(Phys.org) —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Neuroscientist's idea wins new-toy award

Apr 15, 2014

When he was a child, Robijanto Soetedjo used to play with his electrically powered toys for a while and then, when he got bored, take them apart - much to the consternation of his parents.

Land Rover demos invisible bonnet / car hood (w/ video)

Apr 14, 2014

(Phys.org) —Land Rover has released a video demonstrating a part of its Discover Vision Concept—the invisible "bonnet" or as it's known in the U.S. the "hood" of the car. It's a concept the automaker ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

ScottyB
5 / 5 (1) Feb 27, 2013
Very cool!
VendicarE
5 / 5 (1) Feb 27, 2013
This should be the windows 9 start bar.

No alternatives can be permitted.

More news stories

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...