Virtual reality you can touch (w/ Video)

Aug 19, 2010
Virtual reality you can touch
Real or virtual? The virtual object, in this case the white cylinder, is projected into the actual environment and can be felt using a sensor rod. (Picture: Matthias Harders / ETH Zurich)

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. By incorporating the sense of touch, the user can delve deeper into virtual reality.

Sending a friend a virtual birthday present, or quickly beaming a new product over to a customer in America to try out - it sounds like science fiction, but this is what researchers at the Computer Vision Lab want to make possible, with the aid of new technology. Their first step was to successfully transmit a to a spatially remote person, who could not only see the object, but also feel it and move it.

This video is not supported by your browser at this time.

Incorporating all the senses

The more senses are stimulated, the greater the degree of immersion in the . While visual and acoustic simulation of virtual reality has become increasingly realistic in recent years, development in the haptic area, in other words the , lags far behind. Up to now, it has not been possible to touch the virtual copy of an object, or to move it. The aim of the EU project “Immersence”, in which ETH Zurich has also been involved, was to develop new methods for haptic interaction. Matthias Harders, together with other scientists from the Computer Vision Lab, led the sub-project which dealt with interaction between people and virtual objects.

3D in real time

The researchers developed a method for combining visual and haptic impressions with one another. Whilst a 3D scanner records an image of the object, which in one experiment was a soft toy frog, a user simultaneously senses the object using a haptic device. The sensor arm, which can be moved in any direction and is equipped with force, acceleration, and slip sensors, collects information about shape and solidity. With the aid of an algorithm, a virtual copy is created on the computer from the measurements - even while the toy frog is still being scanned and probed.

Virtual reality you can touch
Complex technical equipment is required to create a visual and tactile experience in the virtual world. (Picture: Matthias Harders / ETH Zurich)

Combining vision and touch

The virtual copy can be sent to another person over the Internet if desired. In order for this other person to be able to see and feel the virtual frog, special equipment is needed: data goggles with a monitor onto which the virtual object is projected, and a sensor rod which is equipped with small motors. A computer program calculates when the virtual object and the sensor rod meet, and then sends a signal to the motors in the rod. These brake the movement that is being made by the user, thereby simulating resistance. The user has the sensation of touching the frog, whilst from the outside it appears that he is touching air.

In order to intensify the impression of reality even further, the virtual frog can be projected into the actual environment, where, for example, it appears to be sitting on the table in front of the viewer. The researchers have already achieved this superimposition of the real and virtual worlds, which is termed “augmented reality”, in an earlier project. There, they developed a ping-pong game in which only the handle of the bat exists in reality. With a virtual striking surface, two players can bat the virtual ball to one another. “It feels quite similar to a real game,” says Matthias Harders.

This video is not supported by your browser at this time.

Technology of the future

Whereas earlier attempts simulated the virtual object largely on the basis of assumptions, the method developed by the ETH researchers is based more heavily on measured data. “Our approach can be viewed as an extension of photography,” explains Harders. The method is particularly advantageous in the case of complex objects which would be difficult to describe with a model.

Up to now, it has been possible to touch a virtual object, but not to grasp it. For this, special sensor gloves are needed, with which the user can both “scan in” a real object and touch a virtual object. The ETH researchers are still working on the development of these. However, Harders believes that this technology could be as widely used in twenty years’ time as the Internet is today.

Virtual reality you can touch
How does the virtual soup taste? (Picture: Matthias Harders / ETH Zurich)

Attending conferences by teleporter

In their next EU project, whose name, “Beaming”, is reminiscent of the Starship Enterprise, the scientists are going a step further. They are planning a method of teleportation, in other words for transporting people. “Only virtually, of course,” Harders assures us. This would, for example, make it possible to take part in a conference without having to be present in person, which would save time and travel costs. At the same time, interaction with other participants would be more intensive than is possible in video conferences, for example. “The idea is to generate the feeling of sitting together with other people at a table”.

Explore further: Researchers developing algorithms to detect fake reviews

More information: www.immersence.info/

Related Stories

Virtual reality you can reach out and touch

Jul 01, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

An added dimension for virtual museums

Dec 05, 2004

Culture vultures enjoy exploring museum collections online. New 3D technology promises to make their experience richer still. With a mouse click, people can manipulate valuable objects as if they were in their own hands. ...

Recommended for you

Researchers developing algorithms to detect fake reviews

6 minutes ago

Anyone who has conducted business online—from booking a hotel to buying a book to finding a new dentist or selling their wares—has come across reviews of said products and services. Chances are they've also encountered ...

Skin icons can tap into promise of smartwatch

2 hours ago

You have heard it before: smartwatches are cool wearables but critics remind us of the fact that their small size makes many actions cumbersome and they question how many people will really have them on their ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

HealingMindN
5 / 5 (1) Aug 19, 2010
Next step is the holodeck. Do we have to wear suits attached to all of our naughty bits?
chandram
1 / 5 (2) Aug 20, 2010
reality is also virtual in other than four dimensions. Thus reality in this universe is just a relative thing. There is no way we can ascertain absoluteness about anything we do in science. It is all relative truths. As basic concepts require change in science, the entire picture held as true thus far can change