3D Virtual Reality Environment Developed at UC San Diego Helps Scientists Innovate

Sep 18, 2008 By Doug Ramsey
Calit2 Director of Visualization Tom DeFanti inside the StarCAVE virtual reality system.

Its name sounds like something out of science fiction, but the StarCAVE at the University of California, San Diego is now a science fact. The virtual-reality environment allows groups of scientists to venture into worlds as small as nanoparticles and as big as the cosmos – permitting new insights that could fuel discoveries in many fields. Early users of the StarCAVE include UC San Diego researchers in biomedicine, neuroscience, structural engineering, archaeology, earth science, genomics, art history and other disciplines.

The StarCAVE is a five-sided virtual reality (VR) room where scientific models and animations are projected in stereo on 360-degree screens surrounding the viewer, and onto the floor as well. It was constructed by the UC San Diego division of the California Institute for Telecommunications and Information Technology (Calit2). At less than $1 million, the StarCAVE immersive environment cost approximately the same as earlier VR systems, while offering much higher resolution and contrast.

“When you’re inside the StarCAVE the quality of the image is stunning,” said Thomas A. DeFanti, director of visualization at Calit2 and one of the pioneers of VR systems. “The StarCAVE supports 20/40 vision and the images are very high contrast, thanks to the room’s unique shape and special screens that allow viewers to use 3D polarizing glasses. You can fly over a strand of DNA and look in front, behind and below you, or navigate through the superstructure of a building to detect where damage from an earthquake may have occurred.”

A research paper about the design and construction of the StarCAVE appears in the current issue of the Elsevier journal, Future Generation Computer Systems (FGCS), and is available online at ScienceDirect.* DeFanti’s co-authors on “The StarCAVE, a Third-Generation CAVE and Virtual Reality OptIPortal,” include Calit2’s Gregory Dawe, Jurgen P. Schulze, Peter Otto, Javier Girado, Falko Kuester, Larry Smarr and Ramesh Rao (all at UC San Diego), as well as Daniel J. Sandin of the University of Illinois at Chicago’s Electronic Visualization Lab (EVL), and Javier Girado (now at Qualcomm, Inc.).

The StarCAVE represents the third generation of surround-VR rooms. DeFanti’s team built and named the original Cave Automated Virtual Environment (CAVE) at the University of Illinois at Chicago in 1991. A second-generation model built ten years later at EVL is now the standard surround-VR technology and is widely used around the world and marketed by Mechdyne Corp. The first- and second-generation CAVEs require viewers to wear battery-powered ‘shutter’ glasses; the StarCAVE provides an improved 3D experience and allows viewers to wear only lightweight, polarized ‘sun’ glasses.

The room operates at a combined resolution of over 68 million pixels – 34 million per eye – distributed over 15 rear-projected walls and two floor screens. Each side of the pentagon-shaped room has three stacked screens, with the bottom and top screens titled inward by 15 degrees to increase the feeling of immersion (while also reducing the ghosting, or ‘seeing double’, that bedevils VR systems).

Because the StarCAVE is designed to help scientists, DeFanti and his team made sure to incorporate the latest in computer graphics processing – using 34 of the newest nVIDIA chips that can generate highly complex images. Thirty-four high-definition projectors (two per screen) create very bright left and right eye visuals, i.e. stereo or 3D, per screen. Each pair of projectors is powered by a high-end, quad-core PC running on Linux, with dual graphics processing units and dual network cards to achieve gigabit Ethernet or 10GigE networking.

“With its advanced networking, the StarCAVE is the best virtual-reality portal within the OptIPuter network,” said Calit2’s DeFanti, co-principal investigator on the National Science Foundation-funded OptIPuter project. “That network now connects more than 20 so-called OptIPortals which are up and running around the world. They are ultra-high-resolution, tiled display walls, but for some researchers, flat display walls just aren’t enough: they want the realism that comes from the fully immersive 3D experience that only a 360-degree VR room such as the StarCAVE can offer.”

Adding to the virtual reality in the StarCAVE is the surround sound system, which harnesses recent advances in wave field synthesis – a way to maximize the perception of many channels of sound emanating from different sides of the room. Calit2 also worked closely with Meyer Sound, Inc., to customize the installation of three arrays of five conventional high-quality speakers to provide 5.1 surround sound or up to 15 channels of discreet audio diffusion (with a subwoofer channel built into the floor structure).

Users of the StarCAVE can interact with the visuals on the 360-degree display – by pointing a “wand” that makes it easy to fly through the 3D images and zoom in or out. The exact position of the wand and the user is determined by a multi-camera wireless tracking system.

Among the VR room’s other features, it is wheelchair accessible, and it was designed to withstand earthquakes. One of the StarCAVE’s five walls (along with its six projectors, three screens and three computers) rolls back on steel rails to provide access for users into the space, and the wall rolls back into place to provide the full 360-degree, immersive VR experience.

While the StarCAVE was in development, computer scientists were working on new applications to adapt computer programs for display in the VR environment. The room connects to the Protein Data Bank, so users can pull up one or multiple proteins and fly around them to find similarities and differences between the proteins. A virtual replica of Calit2’s headquarters building at UC San Diego, Atkinson Hall, has been used by neuroscientists who want to know if the human brain operates differently in virtual reality versus reality in ‘wayfinding’ situations.

“We also created an application which displays computer-aided design models of parts of the new San Francisco Oakland Bay Bridge,” said DeFanti. “The application allows users to walk/fly through these parts at their real size, to find material clashes, construction errors, and generally to draw conclusions about whether the structure could be built as designed.”

While the StarCAVE is already being used by a variety of scientists at UC San Diego, Calit2 will continue to make upgrades to the system to provide even greater realism for users. Eventually the engineers hope to increase the visual acuity from 20/40 to 20/20, by upgrading the system’s 34 projectors from 2K to 4K (roughly 4,000 horizontal pixels for each of the 17 screens) – an upgrade that could cost at least $3 million at today’s prices.

Source: University of California, San Diego

Explore further: Reflected smartphone transmissions enable gesture control

add to favorites email to friend print save as pdf

Related Stories

Virtual reality guides those whose memory is failing

Aug 20, 2014

Experts agree that the ability to navigate a neighborhood or built space is one of the first faculties to suffer at the onset of cognitive decline. They also agree that early intervention is crucial for stemming ...

New WAVE display technology rises at UC San Diego

Dec 12, 2013

The next phase in the evolution of high-tech displays is here, and this time, the term 'leading edge' isn't just a catchy slogan, but an evocative description of the technology's look and feel.

Researchers turn Kinect game into a 3D scanner

Aug 01, 2011

University of California, San Diego students preparing for a future archaeological dig to Jordan will likely pack a Microsoft Kinect, but it won’t be used for post-dig, all-night gaming marathons. Instead, ...

Modified HDTV screens used for 3-D technology (w/ Video)

Aug 18, 2009

Surround 3-D TV is poised to take over your living room. For the first time, a team of researchers at the California Institute for Telecommunications and Information Technology (Calit2) at the University of ...

Recommended for you

Wireless sensor transmits tumor pressure

8 hours ago

The interstitial pressure inside a tumor is often remarkably high compared to normal tissues and is thought to impede the delivery of chemotherapeutic agents as well as decrease the effectiveness of radiation ...

Tim Cook puts personal touch on iPhone 6 launch

10 hours ago

Apple chief Tim Cook personally kicked off sales of the iPhone 6, joining in "selfies" and shaking hands with customers Friday outside the company's store near his Silicon Valley home.

Team improves solar-cell efficiency

Sep 19, 2014

New light has been shed on solar power generation using devices made with polymers, thanks to a collaboration between scientists in the University of Chicago's chemistry department, the Institute for Molecular ...

Calif. teachers fund to boost clean energy bets

Sep 19, 2014

The California State Teachers' Retirement System says it plans to increase its investments in clean energy and technology to $3.7 billion, from $1.4 billion, over the next five years.

User comments : 0