3D Virtual Reality Environment Developed at UC San Diego Helps Scientists Innovate

Sep 18, 2008 By Doug Ramsey
Calit2 Director of Visualization Tom DeFanti inside the StarCAVE virtual reality system.

Its name sounds like something out of science fiction, but the StarCAVE at the University of California, San Diego is now a science fact. The virtual-reality environment allows groups of scientists to venture into worlds as small as nanoparticles and as big as the cosmos – permitting new insights that could fuel discoveries in many fields. Early users of the StarCAVE include UC San Diego researchers in biomedicine, neuroscience, structural engineering, archaeology, earth science, genomics, art history and other disciplines.

The StarCAVE is a five-sided virtual reality (VR) room where scientific models and animations are projected in stereo on 360-degree screens surrounding the viewer, and onto the floor as well. It was constructed by the UC San Diego division of the California Institute for Telecommunications and Information Technology (Calit2). At less than $1 million, the StarCAVE immersive environment cost approximately the same as earlier VR systems, while offering much higher resolution and contrast.

“When you’re inside the StarCAVE the quality of the image is stunning,” said Thomas A. DeFanti, director of visualization at Calit2 and one of the pioneers of VR systems. “The StarCAVE supports 20/40 vision and the images are very high contrast, thanks to the room’s unique shape and special screens that allow viewers to use 3D polarizing glasses. You can fly over a strand of DNA and look in front, behind and below you, or navigate through the superstructure of a building to detect where damage from an earthquake may have occurred.”

A research paper about the design and construction of the StarCAVE appears in the current issue of the Elsevier journal, Future Generation Computer Systems (FGCS), and is available online at ScienceDirect.* DeFanti’s co-authors on “The StarCAVE, a Third-Generation CAVE and Virtual Reality OptIPortal,” include Calit2’s Gregory Dawe, Jurgen P. Schulze, Peter Otto, Javier Girado, Falko Kuester, Larry Smarr and Ramesh Rao (all at UC San Diego), as well as Daniel J. Sandin of the University of Illinois at Chicago’s Electronic Visualization Lab (EVL), and Javier Girado (now at Qualcomm, Inc.).

The StarCAVE represents the third generation of surround-VR rooms. DeFanti’s team built and named the original Cave Automated Virtual Environment (CAVE) at the University of Illinois at Chicago in 1991. A second-generation model built ten years later at EVL is now the standard surround-VR technology and is widely used around the world and marketed by Mechdyne Corp. The first- and second-generation CAVEs require viewers to wear battery-powered ‘shutter’ glasses; the StarCAVE provides an improved 3D experience and allows viewers to wear only lightweight, polarized ‘sun’ glasses.

The room operates at a combined resolution of over 68 million pixels – 34 million per eye – distributed over 15 rear-projected walls and two floor screens. Each side of the pentagon-shaped room has three stacked screens, with the bottom and top screens titled inward by 15 degrees to increase the feeling of immersion (while also reducing the ghosting, or ‘seeing double’, that bedevils VR systems).

Because the StarCAVE is designed to help scientists, DeFanti and his team made sure to incorporate the latest in computer graphics processing – using 34 of the newest nVIDIA chips that can generate highly complex images. Thirty-four high-definition projectors (two per screen) create very bright left and right eye visuals, i.e. stereo or 3D, per screen. Each pair of projectors is powered by a high-end, quad-core PC running on Linux, with dual graphics processing units and dual network cards to achieve gigabit Ethernet or 10GigE networking.

“With its advanced networking, the StarCAVE is the best virtual-reality portal within the OptIPuter network,” said Calit2’s DeFanti, co-principal investigator on the National Science Foundation-funded OptIPuter project. “That network now connects more than 20 so-called OptIPortals which are up and running around the world. They are ultra-high-resolution, tiled display walls, but for some researchers, flat display walls just aren’t enough: they want the realism that comes from the fully immersive 3D experience that only a 360-degree VR room such as the StarCAVE can offer.”

Adding to the virtual reality in the StarCAVE is the surround sound system, which harnesses recent advances in wave field synthesis – a way to maximize the perception of many channels of sound emanating from different sides of the room. Calit2 also worked closely with Meyer Sound, Inc., to customize the installation of three arrays of five conventional high-quality speakers to provide 5.1 surround sound or up to 15 channels of discreet audio diffusion (with a subwoofer channel built into the floor structure).

Users of the StarCAVE can interact with the visuals on the 360-degree display – by pointing a “wand” that makes it easy to fly through the 3D images and zoom in or out. The exact position of the wand and the user is determined by a multi-camera wireless tracking system.

Among the VR room’s other features, it is wheelchair accessible, and it was designed to withstand earthquakes. One of the StarCAVE’s five walls (along with its six projectors, three screens and three computers) rolls back on steel rails to provide access for users into the space, and the wall rolls back into place to provide the full 360-degree, immersive VR experience.

While the StarCAVE was in development, computer scientists were working on new applications to adapt computer programs for display in the VR environment. The room connects to the Protein Data Bank, so users can pull up one or multiple proteins and fly around them to find similarities and differences between the proteins. A virtual replica of Calit2’s headquarters building at UC San Diego, Atkinson Hall, has been used by neuroscientists who want to know if the human brain operates differently in virtual reality versus reality in ‘wayfinding’ situations.

“We also created an application which displays computer-aided design models of parts of the new San Francisco Oakland Bay Bridge,” said DeFanti. “The application allows users to walk/fly through these parts at their real size, to find material clashes, construction errors, and generally to draw conclusions about whether the structure could be built as designed.”

While the StarCAVE is already being used by a variety of scientists at UC San Diego, Calit2 will continue to make upgrades to the system to provide even greater realism for users. Eventually the engineers hope to increase the visual acuity from 20/40 to 20/20, by upgrading the system’s 34 projectors from 2K to 4K (roughly 4,000 horizontal pixels for each of the 17 screens) – an upgrade that could cost at least $3 million at today’s prices.

Source: University of California, San Diego

Explore further: BMW to reveal driverless innovations that allow for 360- degree collision avoidance and valet parking

add to favorites email to friend print save as pdf

Related Stories

Virtual reality guides those whose memory is failing

Aug 20, 2014

Experts agree that the ability to navigate a neighborhood or built space is one of the first faculties to suffer at the onset of cognitive decline. They also agree that early intervention is crucial for stemming ...

New WAVE display technology rises at UC San Diego

Dec 12, 2013

The next phase in the evolution of high-tech displays is here, and this time, the term 'leading edge' isn't just a catchy slogan, but an evocative description of the technology's look and feel.

Researchers turn Kinect game into a 3D scanner

Aug 01, 2011

University of California, San Diego students preparing for a future archaeological dig to Jordan will likely pack a Microsoft Kinect, but it won’t be used for post-dig, all-night gaming marathons. Instead, ...

Modified HDTV screens used for 3-D technology (w/ Video)

Aug 18, 2009

Surround 3-D TV is poised to take over your living room. For the first time, a team of researchers at the California Institute for Telecommunications and Information Technology (Calit2) at the University of ...

Recommended for you

Cheaper, more powerful VR system for engineers

Dec 17, 2014

It's like a scene from a gamer's wildest dreams: 12 high-definition, 55-inch 3D televisions all connected to a computer capable of supporting high-end, graphics-intensive gaming.

Nokia HERE prepares maps for autonomous cars

Dec 17, 2014

Autonomous cars will need a new kind of map, a crucial element that until now has been given a back seat to the more popularly discussed issues of sensors and legal questions. Senior Writer Greg Miller in ...

Dutch launch 'intelligent bicycle' that warns of danger

Dec 15, 2014

The Netherlands on Monday launched its first-ever "intelligent bicycle", fitted with an array of electronic devices to help bring down the high accident rate among elderly cyclists in the bicycle-mad country.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.