More accurate biopsy by augmented reality

April 6, 2018, University of Twente
Credit: University of Twente

The University of Twente is currently developing a smartphone technology based on the usage of Simultaneous Localization And Mapping (SLAM) and augmented reality (AR). This technology enables medical personnel to reconstruct 3-D body sections quickly, only by holding the smartphone around the area of interest. This smartphone will display the augmented layers of the 3-D skin surface in order to visualize invisible information for medical personnel.

"We would like to layer the information from the MRI and other vein scans (from sensor devices using laser speckle) and make them visible with ", says Dr. Eng. Beril Sirmacek (Computer Science). This allows doctors to see the inner body segments, tumors, veins and the status of diabetic ulcers with the use of augmented reality. This visual support enables doctors to oversee the situation better and make better decisions. In a biopsy situation, this visual support can help with guiding the robot arms to reach the tumor for biopsy at the first attempt, instead of taking the off-chance and reach for the correct location by working with a patient for a whole day and making unsuccessful biopsy holes on the patient's body.

The augmented visualization of big data and the guidance with the application highly relies on the technology of Simultaneous Localization and Mapping (SLAM). "Even though I didn't have a medical background, our common focus on SLAM and AR provides a great platform."

SLAM box

"When we started this project, our goal was to develop a SLAM box at the UT research group RAM (Robotics and Mechatronics). We can use our localization and 3-D reconstruction software on different and not only with the use of smartphones. Our vision will lead to many health applications, and other robotics applications will become more intelligent. With this technology, the algorithms quickly understand the 3-D models of the surrounding objects regardless of the imaging sensors which are used."

Prof. Dr. Ir. Stefano Stramigioli (Chairman of the Group, Robotics and Mechatronics): "SLAM is a core in robotics, but its universal usage will only be possible if we have methods to easily interface many sensors in a robotic system. At RAM, we intend to create a modular SLAM box which will automatically reconfigure itself if extra sensors are attached in a Plug&Play fashion. Then it would be possible to connect this "SLAM Box" to a complete robotic system, giving it powerful perception capabilities."

Explore further: Robot's in-hand eye maps surroundings, determines hand's location

Related Stories

Robonaut—perception in space

March 21, 2017

In order to remain safe, robots are commonly used to reach what human hands cannot. Often a robot is used to uncover victims from rubble or bring them safely to shore. These helpful hands can even reach a world far beyond ...

Humanoid robot that sees and maps

July 2, 2013

(Phys.org) —Computer vision algorithms that enable Samsung's latest humanoid robot, Roboray, to build real-time 3D visual maps to move around more efficiently have been developed by researchers from the University of Bristol.

Slam dunk for future smart robots

December 14, 2009

(PhysOrg.com) -- 'What does the world look like' and 'where am I' are two questions robots must solve if they are to act autonomously in an unknown environment. Work by European researchers will help future robot generations ...

Recommended for you

Nanoscale Lamb wave-driven motors in nonliquid environments

March 19, 2019

Light driven movement is challenging in nonliquid environments as micro-sized objects can experience strong dry adhesion to contact surfaces and resist movement. In a recent study, Jinsheng Lu and co-workers at the College ...

OSIRIS-REx reveals asteroid Bennu has big surprises

March 19, 2019

A NASA spacecraft that will return a sample of a near-Earth asteroid named Bennu to Earth in 2023 made the first-ever close-up observations of particle plumes erupting from an asteroid's surface. Bennu also revealed itself ...

The powerful meteor that no one saw (except satellites)

March 19, 2019

At precisely 11:48 am on December 18, 2018, a large space rock heading straight for Earth at a speed of 19 miles per second exploded into a vast ball of fire as it entered the atmosphere, 15.9 miles above the Bering Sea.

Levitating objects with light

March 19, 2019

Researchers at Caltech have designed a way to levitate and propel objects using only light, by creating specific nanoscale patterning on the objects' surfaces.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.