Lifebrowser: Data mining gets (really) personal at Microsoft

Mar 17, 2012 by Nancy Owano report

(PhysOrg.com) -- Microsoft Research is doing research on software that could bring you your own personal data mining center with a touch of Proust for returns. In a recent video, Microsoft scientist Eric Horvitz demonstrated the Lifebrowser, which is prototype software that helps put your digital life in meaningful shape. The software uses machine learning to help a user place life events, which may span months or years, to be expanded or contracted selectively, in better context.

Navigating the large stores of personal information on a user’s computer, the program goes through the piles of , including photos, emails and calendar dates. A search feature can pull up landmark on a certain topic. Filtering the data, the software calls up memory landmarks and provides a timeline interface. Lifebrowser's timeline shows items that the user can associate with "landmark" events with the use of artificial intelligence algorithms.

This video is not supported by your browser at this time.

A calendar crawler, working with Microsoft Outlook extracts various properties from calendar events, such as location, organizer, and relationships between participants. The system then applies Bayesian machine learning and reasoning to derive atypical features from events that make them memorable. Images help human memory, and an image crawler analyzes a photo library. By associating an email with a relevant calendar date with a relevant document and photos, significance is gleaned from personal life events. With a timeline in place, a user can zoom in on details of the timeline around landmarks with a “volume control” or search across the full body of information.

The user can slide the "volume control" to change how significant data has to be if it is to appear on the timeline. Lifebrowser’s machine-learning techniques are key to the way it works. At , has been a focus of research interest as scientists look for further advancements in algorithms and technologies to glean knowledge from data.

Lifebrowser looks for clues about whether a file is especially significant, but if the program is not sure, it asks the user for helpful hints. The questions are in the form of prompts that ask the user if a photo is of a landmark event or if some calendar invitation relates to a landmark event. The premise is that, over time, machines learn what is important to the user.

Searching a person's name made it possible for Horvitz to find the first e-mail that person sent him. Lifebrowser then went to work showing a photo of a family event that took place around the same time. The idea was to walk away with a fuller recollection of the period. Aside from general personal use, one can imagine an application where the software might help someone with memory loss.

Lifebrowser was engineered to make life-spanning search and content-serving easy while providing powerful intelligent software as its foundation. The design is based on studies of human memory that suggest humans often use special events or "landmarks" to guide recall.

Explore further: Microsoft CEO is driving data-culture mindset

Related Stories

Google works to close security loophole in Android

May 20, 2011

Google is in the process of updating its Android operating system to fix an issue that is believed to have left millions of smartphones and tablets vulnerable to personal data leaks. ...

Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" ...

Recommended for you

Hackathon team's GoogolPlex gives Siri extra powers

2 hours ago

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...