Virtual Reality for Virtual Eternity

Mar 12, 2007

Imagine having a discussion with Isaac Newton or Albert Einstein on the nature of the universe, where their 3-D, life-sized representations looked you in the eye, examined your body language, considered voice nuances and phraseology of your questions, then answered you in a way that is so real you would swear the images were alive.

This was an opening scene from an episode of the TV show "Star Trek" almost a decade and a half ago. A new research project between the University of Illinois at Chicago and the University of Central Florida in Orlando may soon make such imaginary conversations a reality.

Technology from computer games, animation and artificial intelligence provide the elements to make this happen. The National Science Foundation has awarded a half-million dollar, three-year grant to UIC and UCF researchers to bring those elements together and create the methodology for making such virtual figures commonplace.

UIC will focus on the computer graphics and interaction while UCF will concentrate on artificial intelligence and natural language processing software.

"The goal is to combine artificial intelligence with the latest advanced graphics and video game-type technology to enable us to create historical archives of people beyond what can be achieved using traditional technologies such as text, audio and video footage," said Jason Leigh, associate professor of computer science and director of UIC's Electronic Visualization Laboratory. Leigh is UIC's lead principal investigator.

EVL will build a state-of-the-art motion-capture studio to digitalize the image and movement of real people who will go on to live a virtual eternity in virtual reality. Knowledge will be archived into databases. Voices will be analyzed to create synthesized but natural-sounding "virtual" voices. Mannerisms will be studied and used in creating the 3-D virtual forms, known technically as avatars.

Leigh said his team hopes to create virtual people who respond with a high degree of recognition to different voices and the various ways questions are phrased.

"Imagine a computer smart enough to have the avatar respond 'Do you understand what I'm saying?' in the natural way humans communicate with each other," said Leigh. "We're trying to tip towards being as naturalistic as possible."

The project's test subject will be a senior NSF program manager known for his wealth of institutional knowledge. A UIC graduate student will shadow this official for several months making video and voice recordings. His presence will be digitally reconstructed and interviews used to glean his institutional insights will be stored in the information database. It will allow NSF personnel to consult his virtual counterpart whenever they want to tap his institutional wisdom.

Leigh sees a commercial market for preserving virtual people whose critical or unique knowledge is vital to operations of corporations and other institutions.

Faster, more powerful computers in the future will likely enhance the realism of these interactive avatars. How they will be used is limited only by one's imagination.

"What's interesting to us is how this works in cycles," said Leigh. "Advanced graphics/simulation research resulted in today's gaming technology. A lot of the virtual reality techniques we now take for granted in game systems like Nintendo Wii or immersive environments like Second Life came out of labs like EVL. Now next generation gaming technology is stimulating new applications for advanced graphics/simulation research that can benefit gaming as well as other fields."

Source: University of Illinois at Chicago

Explore further: Computerized emotion detector

add to favorites email to friend print save as pdf

Related Stories

Facebook dressed down over 'real names' policy

3 hours ago

Facebook says it temporarily restored hundreds of deleted profiles of self-described drag queens and others, but declined to change a policy requiring account holders to use their real names rather than drag names such as ...

Far more displaced by disasters than conflict

3 hours ago

Disasters last year displaced three times more people than violent conflicts, showing the urgent need to improve resilience for vulnerable people when fighting climate change, according to a study issued ...

Recommended for you

Computerized emotion detector

Sep 16, 2014

Face recognition software measures various parameters in a mug shot, such as the distance between the person's eyes, the height from lip to top of their nose and various other metrics and then compares it with photos of people ...

Cutting the cloud computing carbon cost

Sep 12, 2014

Cloud computing involves displacing data storage and processing from the user's computer on to remote servers. It can provide users with more storage space and computing power that they can then access from anywhere in the ...

Teaching computers the nuances of human conversation

Sep 12, 2014

Computer scientists have successfully developed programs to recognize spoken language, as in automated phone systems that respond to voice prompts and voice-activated assistants like Apple's Siri.

User comments : 0