A sensible censor for sharing medical records

July 24, 2008

(PhysOrg.com) -- Newly developed MIT software will help to allay patients' fears about who has access to their confidential records, facilitating the use of that data for medical research.

In the July 24 issue of the journal BMC Medical Informatics and Decision Making, a team of MIT researchers describes a computer program capable of automatically deleting details from medical records that may identify patients, while leaving important medical information intact.

Patient records that are to be shared within the research community must have any identifying information removed, according to the U.S. Health Insurance Portability and Accountability Act (HIPAA). However, manual removal of identifying information is prohibitively expensive, time consuming and prone to error-constraints that have prompted considerable research toward developing automated techniques for "de-identifying" medical records.

The MIT team aimed to solve this problem. "We've developed a free and open-source software package to allow researchers to accurately de-identify text in medical records in a HIPAA-compliant manner," said Gari D. Clifford, a principal research scientist in the Harvard-MIT Division of Health Sciences and Technology (HST) who led the work with Principal Investigator Roger G. Mark, a professor in HST and MIT's Department of Electrical Engineering and Computer Science.

According to Dr. Zohara Cohen, program director at the National Institute of Biomedical Imaging and Bioengineering, sponsor of the work, the information in patients' medical records is a "largely untapped treasure trove" that the biomedical research community could use to better understand diseases and their treatments.

"The automated de-identification software developed under the guidance of Dr. Mark is a big step forward in permitting the widespread sharing of patient information without the risk of compromised privacy and confidentiality," Cohen said.

Clifford, Mark and colleagues tested their censoring software on 1,836 nursing notes (a total of 296,400 words). Using multiple experts and additional algorithms, they replaced all personal information with "fake" data. In their BMC paper, they report that "the software successfully deleted more than 94 percent of the confidential information, while wrongly deleting only 0.2 percent of the useful content. This is significantly better than one expert working alone, at least as good as two trained medical professionals checking each other's work and many, many times faster than either."

The team is providing researchers access to the evaluation dataset together with the software to allow others to improve their systems, and to allow the software to be adapted to other data types that may exhibit different qualities.

Provided by MIT

Explore further: Medical monitor with eyes and ears

Related Stories

Medical monitor with eyes and ears

February 1, 2016

In intensive care Units (ICU), every second counts. In emergencies, doctors and nurses need to make the right decisions quickly. Fraunhofer researchers have developed a smart "proxemic monitor" which has optimized the processes ...

Adjusting production processes in real time

January 28, 2016

Industry 4.0 requires comprehensive data collection in order to control highly automated process sequences in complex production environments. One example is the cultivation of living cells. But digitalizing and networking ...

Medical imaging helps define Moa diet

January 14, 2016

Medical scanners and the same software used to assess building strength after the Canterbury earthquakes, have revealed new information about the diet and dining preferences of New Zealand's extinct moa.

Brain monitoring takes a leap out of the lab

January 12, 2016

Bioengineers and cognitive scientists have developed the first portable, 64-channel wearable brain activity monitoring system that's comparable to state-of-the-art equipment found in research laboratories.

Breakthrough imaging tool maps cells' composition in 3-D

January 20, 2016

A one-of-a-kind instrument built at CSU lets scientists map cellular composition in three dimensions at the nanoscale, allowing researchers to watch how cells respond to new medications at the most minute level ever observed.

Recommended for you

How the finch changes its tune

August 3, 2015

Like top musicians, songbirds train from a young age to weed out errors and trim variability from their songs, ultimately becoming consistent and reliable performers. But as with human musicians, even the best are not machines. ...

Machine Translates Thoughts into Speech in Real Time

December 21, 2009

(PhysOrg.com) -- By implanting an electrode into the brain of a person with locked-in syndrome, scientists have demonstrated how to wirelessly transmit neural signals to a speech synthesizer. The "thought-to-speech" process ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.