New high-performance cave automatic virtual environment that functions with gesture recognition

April 18, 2013
Visualisaton of a 3D model of a ribcage.

The Universitat Politècnica de Catalunya BarcelonaTech (UPC) presents a new multi-projector CAVE, designed and built in its entirety by the Virtual Modelling, Visualisation, Interaction and Virtual Reality Research Group (MOVING). This immersive virtual reality system is a pioneering design at world level that is adaptable and based on widely available consumer electronics and computer technology. It consists of four 3 m2 walls (including the floor) that function as screens and has 40 commercial, low-cost projectors that are controlled by 12 PCs. Low cost, versatility and high resolution are some of the characteristics of the new CAVE, which works with a range of projector models that can be substituted at any moment for more modern or cheaper ones.

This architecture is based on a multi-projector scheme in passive stereo that provides high and 2000x2000 pixel resolution on each of the walls (16 million pixels in total). The uniformity of the final image is achieved using self-calibration software, also designed by MOVING, which adapts each of the 40 projections and guarantees the concordance and continuity of the system.

The self-calibration algorithm is based on the projection of patterns and on the capture of these patterns by four digital cameras that are controlled by a PC. Its own visualisation software guarantees that any can be inspected using the interaction methods defined for the navigation, selection and manipulation of .

In the CAVE, users interact wirelessly with objects and the virtual scene through their gestures. The new interaction system, which is at the experimental stage, is intended to be transparent and highly ergonomic. It is based on two Kinect sensors placed at 90 degrees to each other that work in unison, detecting the movements and positions of the main joints of the person inside the CAVE in real time.

The system adapts the image perspective to the head position of the users in real time, allowing them to select and modify the characteristics of the virtual objects with gestures, zooming in or moving them around themselves in order to inspect and see specific areas of these objects more clearly.

The objects are visualised in greater detail and at a lower cost than is offered by current systems. The CAVE thus saves money and time, improving the quality of work, products and technology transfer.

Visualisaton of a 3D model of a ship.

Museums, industrial design and medicine

The new CAVE system is currently being used in applications related to the visualisation of museum pieces, cooperative ship design and medicine, although its sphere of application is broader still, covering industrial design, visualisation of simulation results, molecular design, architecture and urbanism, archaeology and the study of monuments, and geonavigation.

In medicine, biomedicine and biochemistry it is of great help for anatomical volume rendering, surgical simulation and non-invasive examination, the study of molecular dynamics using models and the real-time simulation of critical situations in operating theatres for the training of surgeons.

In industry, the application offers advantages in fields such as the interior and exterior design of vehicles, data training [LV1] and visualisation, virtual prototyping and cooperative design, remote maintenance and ground surveying.

In architecture, urbanism and interior design, virtual reality tools help in planning and decorating spaces.

Leaders in virtual reality

In 2001, the UPC installed the first cave automatic virtual environment in Spain at the Virtual Reality Centre. The system had four walls for projections and used four large CRT technology projectors to generate images. Three-dimensional perception was achieved with active 3D glasses. The visualisation of models required a Silicon Graphics Onyx Infinite Reality Monster supercomputer.

The technology developed for the new multi-projector cave at the UPC—which has an image resolution four times greater than that of the previous incarnation and is three times cheaper—can be used in facilities that require large monocular or stereoscopic projections onto more than one flat surface. The research group MOVING that designed this environment in the framework of the Visualisation, Virtual Reality and Graphic Interaction Centre (ViRVIG) of the UPC and the University of Girona offers it as a service for institutions and businesses, for dissemination and training and for the immersive inspection of 3D digital models. It also offers the possibility of tailoring this technology to specific requirements.

CAVEs are environments. They are rooms in cube form (3x3x3 metres), in which projectors are directed at the walls. CAVEs may have three, four, five or six walls, although four (including the floor) is the most common. They were introduced in 1994 by scientists Tom de Fanti and Carolina Cruz-Neira, of the University of Illinois (Chicago, USA), in the framework of the latter's doctoral thesis.

Visualisation of the three vertical walls is achieved by rear projection. After almost 20 years, CAVEs continue to be the best systems, both in terms of immersion and presence perception and in terms of ergonomics. The ultimate aim of these systems is for users to feel that they are in a virtual world.

Explore further: Research uses muscle activity to move virtual objects (w/ video)

Related Stories

Virtual Reality Becoming a Valuable Resource for Researchers

February 21, 2007

Virtual reality isn’t just for gamers anymore. At the University of Arizona, the technology that used to be synonymous with the video game industry is now supporting the efforts of UA researchers in fields as diverse as ...

FRAVE: Flexible virtual reality system

May 31, 2011

Product developers, vehicle design engineers and trainee pilots increasingly utilize 3-D worlds, operating in a virtual space created by realistic images in real time. Researchers at the Technische Universitaet Muenchen (TUM) ...

A virtual reality scent system that fools human taste

April 19, 2011

( -- Can you fool the human sense of taste in the world of virtual reality? Up until recently that question was impossible to answer, most because it had not been tested. Most of virtual reality relied on sight ...

Gesture recognition

December 18, 2008

A system that can recognize human gestures could provide a new way for people with physical disabilities to interact with computers. A related system for the able bodied could also be used to make virtual worlds more realistic. ...

Recommended for you

'Droneboarding' takes off in Latvia

January 22, 2017

Skirted on all sides by snow-clad pine forests, Latvia's remote Lake Ninieris would be the perfect picture of winter tranquility—were it not for the huge drone buzzing like a swarm of angry bees as it zooms above the solid ...

Singapore 2G switchoff highlights digital divide

January 22, 2017

When Singapore pulls the plug on its 2G mobile phone network this year, thousands of people could be stuck without a signal—digital have-nots left behind by the relentless march of technology.

Making AI systems that see the world as humans do

January 19, 2017

A Northwestern University team developed a new computational model that performs at human levels on a standard intelligence test. This work is an important step toward making artificial intelligence systems that see and understand ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.