Lifebrowser: Data mining gets (really) personal at Microsoft

March 17, 2012 by Nancy Owano report

( -- Microsoft Research is doing research on software that could bring you your own personal data mining center with a touch of Proust for returns. In a recent video, Microsoft scientist Eric Horvitz demonstrated the Lifebrowser, which is prototype software that helps put your digital life in meaningful shape. The software uses machine learning to help a user place life events, which may span months or years, to be expanded or contracted selectively, in better context.

Navigating the large stores of personal information on a user’s computer, the program goes through the piles of , including photos, emails and calendar dates. A search feature can pull up landmark on a certain topic. Filtering the data, the software calls up memory landmarks and provides a timeline interface. Lifebrowser's timeline shows items that the user can associate with "landmark" events with the use of artificial intelligence algorithms.

This video is not supported by your browser at this time.

A calendar crawler, working with Microsoft Outlook extracts various properties from calendar events, such as location, organizer, and relationships between participants. The system then applies Bayesian machine learning and reasoning to derive atypical features from events that make them memorable. Images help human memory, and an image crawler analyzes a photo library. By associating an email with a relevant calendar date with a relevant document and photos, significance is gleaned from personal life events. With a timeline in place, a user can zoom in on details of the timeline around landmarks with a “volume control” or search across the full body of information.

The user can slide the "volume control" to change how significant data has to be if it is to appear on the timeline. Lifebrowser’s machine-learning techniques are key to the way it works. At , has been a focus of research interest as scientists look for further advancements in algorithms and technologies to glean knowledge from data.

Lifebrowser looks for clues about whether a file is especially significant, but if the program is not sure, it asks the user for helpful hints. The questions are in the form of prompts that ask the user if a photo is of a landmark event or if some calendar invitation relates to a landmark event. The premise is that, over time, machines learn what is important to the user.

Searching a person's name made it possible for Horvitz to find the first e-mail that person sent him. Lifebrowser then went to work showing a photo of a family event that took place around the same time. The idea was to walk away with a fuller recollection of the period. Aside from general personal use, one can imagine an application where the software might help someone with memory loss.

Lifebrowser was engineered to make life-spanning search and content-serving easy while providing powerful intelligent software as its foundation. The design is based on studies of human memory that suggest humans often use special events or "landmarks" to guide recall.

Explore further: Microsoft Researchers Developing Muscle-Based PC Interface (w/ Video)

Related Stories

Holodesk prototype puts life in computers (w/ video)

October 20, 2011

( -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. ...

Recommended for you

Toyota promises better mileage and ride with Prius hybrid

October 13, 2015

Toyota Motor Corp. released details for its fourth-generation Prius on Tuesday, promising that improvements in the battery, engine, wind resistance and weight mean better mileage for the world's top-selling hybrid car.

Facebook to test mobile app shopping tab

October 12, 2015

Facebook said Monday that it will begin testing a shopping tab for its mobile app as it works to ramp up advertising and online commerce offerings.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.