New microscopy technology augments surgeon's view for greater accuracy

October 7, 2015
New microscopy technology augments surgeon's view for greater accuracy
Custom colored dye solutions with randomly plated ICG solution: (a) visible view through microscope, (b) NIR view seen on computer monitor, and (c) augmented view seen in real time through the ocular of the augmented microscope. Credit: Journal of Biomedical Optics doi:10.1117/1.JBO.20.10.106002 (© the authors)

Researchers at the University of Arizona (UA) have developed a prototype of a new microscope technology that could help surgeons work with a greater degree of accuracy. The new technology, call augmented microscopy, overlays images depicting diagnostic information such as blood flow and cancerous tissue over real images of blood vessels and other tissues and structures being viewed in the microscope.

A report on the work by Jeffrey Watson and co-authors from the UA departments of Biomedical Engineering and Surgery was published today in the Journal of Biomedical Optics, published by SPIE, the international society for optics and photonics.

Surgical microscopes are highly specialized stereomicroscopes installed on articulated mounts and provide a long working distance and functional enhancements, and are widely used in certain delicate operations, notably neurosurgery.

Within the last decade, surgical microscopes have been combined with near-infrared (NIR) fluorescence imaging, in which contrast agents are injected into tissue and their fluorescence detected in NIR scans. The scans may reveal patterns of , or differentiate cancerous from normal tissue.

But there are limitations. For example, some microscopes used in complex vascular surgeries switch between two different views: the fully optical bright-field (real) view and the computer-processed projection of NIR fluorescence. The NIR image is two-dimensional, and on its own lacks the spatial cues that would help the surgeon identify anatomical points of reference. So the surgeon must visualize how the fluorescence in the NIR image lines up with the respective anatomical structures shown in the bright-field view.

The UA researchers' article, "Augmented microscopy: Real-time overlay of bright-field and near-infrared fluorescence images" describes their prototype of an augmented stereomicroscope that presents a simultaneous view of real objects in the surgical field and computer-processed images superimposed in real time.

"Surgeons want to see the molecular signals with their eyes, so that they can feel confident about what is there," said journal associate editor Brian Pogue of Dartmouth College. "Too often, what they see is a report of the signals depicted in false color on a monitor. By displaying information through the surgical scope itself, the surgeon then sees the information with his or her own eyes."

Pogue said he sees the work being important in advancing the translation of research into clinical practice. "There are very few papers on this idea of augmenting the surgical field of view that the surgeon sees, yet this is a high-interest topic," he said. "This article presents a very practical idea and innovative implementation which is well done technically."

The prototype offers advantages over earlier versions of augmented microscopes. By utilizing the optical path of the stereomicroscope, it maintains full three-dimensional stereoscopic vision, which is lost in fully digital display systems.

It also retains the imaging environment familiar to surgeons, including key features of surgical microscopes such as real-time magnification and focus adjustments, camera mounting, and multiuser access.

One possible application for this augmented microscope is laser surgery. In the past, surgeons could not see the laser beam through the standard stereomicroscope, nor anatomical details in the NIR images.

The researchers also suggest that this technology will be useful in the surgical treatment of brain tumors. Surgeons aggressively removing a tumor run the risk of damaging normal brain tissue and impairing the patient's brain functions; on the other hand, incomplete removal of a tumor results in immediate relapse in 90% of patients. Being able to simultaneously see the surgical field and the contrast agent identifying cancerous tissue within the augmented microscope may allow surgeons to remove these challenging tumors more accurately.

Explore further: Team devises use of food dye, near infrared light to aid in breast resection

More information: Journal of Biomedical Optics DOI: 10.1117/1.JBO.20.10.106002

Related Stories

Near-infrared imaging techniques for cartilage tissue

June 19, 2015

The mainstream techniques for visualization of cartilage tissue in the body are magnetic resonance imaging and computer tomography, but both techniques do not provide optimum quality images. A new method projected by American ...

Recommended for you

Shocks in the early universe could be detectable today

October 27, 2016

(—Physicists have discovered a surprising consequence of a widely supported model of the early universe: according to the model, tiny cosmological perturbations produced shocks in the radiation fluid just a fraction ...

Neutrons prove the existence of 'spiral spin-liquid'

October 27, 2016

Magnetic moments ("spins") in magnetic solids are capable of forming the most diverse structures. Some of them are not only of interest from a scientific point of view, but also from a technical standpoint: processors and ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.