Image analysis might allow pathologists to expedite diagnoses

October 17, 2012
Image analysis may allow pathologists to expedite diagnoses
Work by a team of Penn State electrical engineers and veterinarians may one day allow for computers to examine medical samples, such as these kidney cells to determine whether they are healthy, left, or inflamed, right. Credit: Animal Diagnostic Laboratory

(—For pathologists, identifying damaged or diseased tissue is a time-consuming process of poring over samples under a microscope. But collaborative research between veterinarians and electrical engineers at Penn State could significantly speed up the process.

Using technology similar to what powers photo-editing software and social media to recognize faces, a team led by Vishal Monga, assistant professor of , with veterinarians at the University's Animal (ADL), has developed an automated method of classifying histopathological .

" researchers routinely solve image classifications problems," Monga said. "The idea is if you have a collection of images, can you automatically put them in categories?"

Monga continued, "What was particularly interesting was (ADL ) were capturing tissue imagery—histopathological images."

During the course of a year, ADL's five pathologists examine more than 10,000 slides, according to Art Hattel, veterinary pathologist at ADL. To properly evaluate a slide, Hattel said a pathologist usually takes seven to 10 minutes, but the process can take as long as 20 to 25 minutes.

"It's time consuming. You have to look carefully or you'll miss something," he said.

It was a chance meeting at a social gathering where Monga was telling Bhushan Jayarao, ADL's director, about his research into image processing and classification.

As Jayarao recalled, "I told Dr. Monga, why don't we apply this to some of the work Dr. Hattel does? This is total virgin territory. No one has really ventured into histopathology."

Monga said, "Although image classification has been around for a while, these images are nothing like the typical images you would see. They're not photos of you and I or landscapes. The geometries and structures that they exhibit are entirely different."

After initial tests showed it was feasible to use image classification on histopathology, the team began in January when Hattel received a $19,000 research grant from the Pennsylvania Department of Agriculture to initiate the project.

A series of training slides were sent to Monga's team. In addition to the sample images, Jayarao said ADL pathologists sat down with Monga and his graduate student, Umamahesh Srinivas, to help explain things.

Hattel said the engineers told him, " 'We want to see these images and why you're calling this normal and why you're calling that abnormal.' "

Starting with diseases that featured many lesions, Hattel said the ADL staff explained what pathologists look for in diagnosing the samples, including color changes, differences in shapes and sizes or an influx of white blood cells.

To accomplish the task, Monga's team developed a set of custom tools which rely on a sparse encoding of image attributes to help with identification.

Srinivas said the electrical engineers designed the tools mimicking the same methods human pathologists use to classify samples. "They look for distinguishing features."

Once the tools were developed, Monga said the automated solution proved to be quite accurate.

"We have benchmarked against human judgment, and we are already seeing 80- to 85-percent success in automatically categorizing into three areas: healthy, inflammation and necrosis," Monga said.

"We were surprised with how well it picked things up," Hattel said.

With the initial success using the training images, Jayarao said the system could potentially be scaled up to examine other types of abnormalities.

To do so, Monga said the software would require a "training phase" where it is taught what healthy tissue looks like and what looks like. But once the big step of pre-processing is finished, the software could process thousands of images in a second.

In addition to ADL's large collection of images, the system could incorporate the massive disease databases maintained by the National Institutes of Health, the U.S. government and other academic and private institutions, Jayarao said.

Although the new method isn't being used by ADL to diagnose any real samples yet, the researchers are applying for larger grants to continue the effort in the hopes that one day it might.

"This is only the tip of the iceberg," Monga said. "Right now we're just answering questions like whether it's healthy or diseased. But we would like to answer more elaborate questions like what kind of disease and what stage of disease because then it can become a very powerful diagnostic tool."

Explore further: New software opens the door to wider use of 3-D imaging in the study of disease

Related Stories

SUNY researcher issued patent for virtual telemicroscope

March 27, 2008

After nearly ten years of research and development, scientists at SUNY Downstate Medical Center in Brooklyn and Peking University in Beijing were awarded a United States patent for their virtual telemicroscope. This patented ...

Virtual slides reveal disease in 3D

April 23, 2012

(Medical Xpress) -- Computing experts and medical researchers at the University of Leeds have developed a fast, easy-to-use way of studying tissue samples in 3D using ‘virtual’ microscope slides.

Computer-assisted diagnosis tools to aid pathologists

January 31, 2011

Researchers are leveraging Ohio Supercomputer Center resources to develop computer-assisted diagnosis tools that will provide pathologists grading Follicular Lymphoma samples with quicker, more consistently accurate diagnoses.

U-M develops a potential 'game changer' for pathologists

February 28, 2011

Ulysses Balis, M.D., clicks a mouse to identify a helicopter in a satellite photo of Baghdad, Iraq. With another click, an algorithm that he and his team designed picks out three more choppers without highlighting any of ...

Recommended for you

Volvo to supply Uber with self-driving cars (Update)

November 20, 2017

Swedish carmaker Volvo Cars said Monday it has signed an agreement to supply "tens of thousands" of self-driving cars to Uber, as the ride-sharing company battles a number of different controversies.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.