Fitness system creates virtual avatars in 10 minutes

January 3, 2018, Bielefeld University
In order to test the new process, doctoral student Jascha Achenbach had 40 cameras photograph him simultaneously (left). Ten minutes later, the virtual version of the researcher was finished (right). Credit: CITEC/Bielefeld University

Avatars—virtual persons—are a core element of ICSpace, a virtual fitness and movement environment at Bielefeld University's Cluster of Excellence Cognitive Interaction Technology (CITEC). The system makes it possible to practice and improve motion sequences by providing individualised feedback in real time. The system consists of a virtual person acting as a coach.

In addition, users see themselves as avatars, virtual copies of themselves in the mirror of the virtual room. The creation of such personalised avatars used to take several days, but CITEC researchers have now developed an accelerated process.

In order to create avatars for the ICSpace system, the researchers "scan" people. The computer scientists use a circular array of 40 DSLR cameras to photograph the subject from all sides and use these images to compute several million three-dimensional sample points on the person's body. A generic virtual human model is fitted to this data in such a way that it corresponds to the shape and appearance of the person scanned. "Our virtual human model was generated from more than one hundred 3-D scans and contains statistical knowledge about human body shape and movement," says Professor Dr. Mario Botsch, head of the Computer Graphics and Geometry Processing research group and one of the coordinators of the ICSpace project. "Only through this model are we able to create avatars quickly and automatically."

The resulting virtual people can be animated in detail: they can move all joints, even individual fingers, and communicate through facial expressions, speech and gestures. "The most important feature, though, is that they reflect the user photorealistically," says Botsch. This is crucial because personalised avatars are much more readily accepted by users. This is shown in a study carried out by computer graphic researchers from Bielefeld in cooperation with Professor Dr. Marc Latoschik from the University of Würzburg. "The study shows that users identify better with such a custom-tailored individualised than with an avatar that does not resemble them, even if it looks similarly realistic," says Latoschik, who holds the chair for Human-Computer Interaction in Würzburg.

"Until a few months ago, the individual processing steps for creating avatars were scarcely automated," says Botsch. The new process has changed this.

For the current study, his team has developed algorithms that accelerate the complete processing of the photo data right up to the animated avatar. "This way, we can now generate the avatar of any person within 10 minutes," says Jascha Achenbach, lead author of the resulting publication. "We create the virtual avatars in a format that is also used by the computer games industry," says Thomas Waltemate, who, like Achenbach, works in Botsch's research group.

The researchers presented their development of accelerated avatar generation a month ago in Gothenburg (Sweden) at the conference "ACM Symposium on Virtual Reality Software and Technology." The study on how personalised avatars are accepted by users will be presented at the IEEE Conference on Virtual Reality and 3-D User Interfaces in the spring of 2018.

The virtual training environment ICSpace is a joint development by six research groups of the Excellence Cluster CITEC. ICSpace stands for "Intelligent Coaching Space." The system analyses the movement of athletes and rehabilitation patients and helps to correct them. It is based on an open space with two projection walls (front and floor), known as Cave Automatic Virtual Environment (CAVE). The CAVE makes it possible to simulate a walk-in, computer-generated virtual environment. Test subjects wear 3-D glasses similar to those worn in the cinema. It is the first system of its kind worldwide to simulate the complete training process and adapt flexibly to the user's behaviour. Mario Botsch coordinates the project together with computer scientist Professor Dr. Stefan Kopp and sport and cognitive scientist Professor Dr. Thomas Schack.

Explore further: Smart physical training in virtual reality

More information: Paper: Fast Generation of Realistic Virtual Humans, Proceedings of ACM Symposium on Virtual Reality Software and Technology - www.hci.uni-wuerzburg.de/downl … c-virtual-humans.pdf

Related Stories

Smart physical training in virtual reality

February 18, 2016

A new system in a virtual training room is helping users practice and improve sports exercises and other motor activities: six research groups from the Cluster of Excellence Cognitive Interaction Technology (CITEC) at Bielefeld ...

Using virtual reality to make experiments more realistic

January 27, 2016

Avatars are all around us: they represent real people online and colonise new worlds in the movies. In science, their role has been more limited. But avatars can be extremely useful in linguistics, new research shows. Scientists ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.