Augmented reality system to help medical professionals

Augmented Reality system to help medical professionals
Credit: Birmingham City University

A mixed reality system which allows medical practitioners to view and interact with virtual replicas of patients' organs, bones or body parts is being developed by academics.

Researchers at Birmingham City University's Digital Media Technology Lab (DMT Lab) are devising the system which enables users to interact with and patient data using freehand movements.

The system allows users to manipulate, navigate and demonstrate patient data using hand motions and gestures, so that practitioners can showcase , lifestyle choices, and treatment effects using customised 3-D virtual models and patients' real medical records.

It could be used to visually demonstrate medical problems, the areas where surgery will be conducted, improvements which could be made following treatment or the damage caused by harmful addictive substances such as tobacco.

The technology uses motion detecting sensors combined with the DMT Lab expertise in freehand interaction in mixed reality to create a more realistic experience in virtual environments and bridge the gap between users and technology.

Dr Ian Williams said: "We are developing this system as a platform to allow medical professionals to interact with genuine patient data and manipulate it by hand to educate and inform patients.

Augmented Reality system to help medical professionals
Credit: Birmingham City University

"The real advantages this brings are being able to visually demonstrate parts of the anatomy, using virtual models which can be customised for each patient and show how they have been impacted by lifestyle choices or how they may be changed following treatments or surgery."

Staff at the University will be discussing the system and other projects during an Open Day to be held on Saturday (June 10) at its City Centre Campus.

In the future the system will be upgraded to replicate injuries, mobility problems or illnesses and show changes which could be made through or medical procedures.

Augmented Reality system to help medical professionals

It could also help the practitioners by creating a new way to view in an array of settings.

Medical practitioners could be able to showcase medical procedures and treatment effects on customised medical models.

Surgeons would also be able to interact with images of patients' bodies to view and manipulate during procedures without the need to remove their scrubs and gloves in sterilised environments.

The use of customised models and the interactive environment that can be shared with the patient, can help to boost patients' engagement into treatments and their understanding.

Augmented Reality system to help medical professionals
Credit: Birmingham City University

Explore further

Visiting virtual beach improves patient experiences during dental procedures

Citation: Augmented reality system to help medical professionals (2017, June 16) retrieved 22 October 2019 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Jun 16, 2017
I don't think I have ever seen a person's face blanked out who was demonstrating a technology. If that person did not want to be recognized as making a contribution why didn't they just use someone else?
Usually all the people in this type of article a smiling proudly.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more