Augmented reality promises astronauts instant medical knowhow

Feb 06, 2012
The Computer Assisted Medical Diagnosis and Surgery System, CAMDASS, is a wearable augmented reality prototype. Augmented reality merges actual and virtual reality by precisely combining computer-generated graphics with the wearer’s view. CAMDASS is focused for now on ultrasound examinations but in principle could guide other procedures. Credits: ESA/Space Applications Service NV

A new augmented reality unit developed by ESA can provide just-in-time medical expertise to astronauts. All they need to do is put on a head-mounted display for 3D guidance in diagnosing problems or even performing surgery.

The Computer Assisted and Surgery System, CAMDASS, is a wearable prototype.

Augmented reality merges actual and by precisely combining computer-generated graphics with the wearer’s view.

CAMDASS is focused for now on ultrasound examinations but in principle could guide other procedures.  

Ultrasound is leading the way because it is a versatile and effective medical diagnostic tool, and already available on the International Space Station.

Future astronauts venturing further into space must be able to look after themselves. Depending on their distance from Earth, discussions with experts on the ground will involve many minutes of delay or even be blocked entirely.

“Although will be available among the crew to some extent, cannot be trained and expected to maintain skills on all the medical procedures that might be needed,” said Arnaud Runge, a biomedical engineer overseeing the project for ESA.

CAMDASS uses a stereo head-mounted display and an ultrasound tool tracked via an infrared camera. The patient is tracked using markers placed at the site of interest.

The CAMDASS headset being tried out on a plastic head during the October 2011 International Symposium on Mixed and Augmented Reality in Basel, Switzerland. Credits: ESA/Space Applications Service NV

An ultrasound device is linked with CAMDASS and the system allows the patient’s body to be ‘registered’ to the camera and the display calibrated to each wearer’s vision.

3D augmented reality cue cards are then displayed in the headset to guide the wearer. These are provided by matching points on a ‘virtual human’ and the registered patient.

This guides the wearer to position and move the ultrasound probe.

Reference ultrasound images give users an indication of what they should be seeing, and speech recognition allows hands-free control.

The prototype has been tested for usability at Saint-Pierre University Hospital in Brussels, Belgium, with medical and nursing students, Belgian Red Cross and paramedic staff.

CAMDASS has been tested for usability at Saint-Pierre University Hospital in Brussels, Belgium, with medical and nursing students, Belgian Red Cross and paramedic staff. Untrained users found they could perform a reasonably difficult procedure without other help, with effective probe positioning. Credits: ESA/Space Applications Service NV

Untrained users found they could perform a reasonably difficult procedure without other help, with effective probe positioning.

“Based on that experience, we are looking at refining the system – for instance, reducing the weight of the head-mounted display as well as the overall bulkiness of the prototype,” explained Arnaud.

“Once it reaches maturity, the system might also be used as part of a telemedicine system to provide remote medical assistance via satellite.

“It could be deployed as a self-sufficient tool for emergency responders as well.

“It would be interesting to perform more testing in remote locations, in the developing world and potentially in the Concordia Antarctic base. Eventually, it could be used in space.”

Funded by ESA’s Basic Technology Research Programme, the prototype was developed for the Agency by a consortium led by Space Applications Services NV in Belgium with support from the Technical University of Munich and the DKFZ German Cancer Research Centre.

Explore further: Cadillac CT6 will get streaming video mirror

add to favorites email to friend print save as pdf

Related Stories

Augmented reality to help astronauts make sense of space

Sep 22, 2009

(PhysOrg.com) -- Life aboard the International Space Station is hard work. Crewmembers have a multiplicity of complex tasks, potentially involving thousands of tools, components and other items. But ESA astronaut ...

Exploring Rio Tinto Eurobotically

May 02, 2011

No wonder it is called Red River: it looks like it could be on the red planet rather than in Spain. The landscape and terrain make it a perfect place for simulating a Mars sortie.

Space sensor makes bolts smarter

Dec 13, 2010

Technology developed for the International Space Station and a Mars rover is helping European auto-parts manufacturers to engineer lighter, stronger and safer drivetrains and axles.

Recommended for you

Cadillac CT6 will get streaming video mirror

15 hours ago

Cadillac said Thursday it will add high resolution streaming video to the function of a rearview mirror, so that the driver's vision and safety can be enhanced. The technology will debut on the 2016 Cadillac ...

Poll: Americans skeptical of commercial drones (Update)

Dec 19, 2014

Americans broadly back tight regulations on commercial drone operators, according to a new Associated Press-GfK poll, as concerns about privacy and safety override the potential benefits of the heralded drone ...

Cheaper, more powerful VR system for engineers

Dec 17, 2014

It's like a scene from a gamer's wildest dreams: 12 high-definition, 55-inch 3D televisions all connected to a computer capable of supporting high-end, graphics-intensive gaming.

Nokia HERE prepares maps for autonomous cars

Dec 17, 2014

Autonomous cars will need a new kind of map, a crucial element that until now has been given a back seat to the more popularly discussed issues of sensors and legal questions. Senior Writer Greg Miller in ...

Dutch launch 'intelligent bicycle' that warns of danger

Dec 15, 2014

The Netherlands on Monday launched its first-ever "intelligent bicycle", fitted with an array of electronic devices to help bring down the high accident rate among elderly cyclists in the bicycle-mad country.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.