Lifebrowser: Data mining gets (really) personal at Microsoft

March 17, 2012 by Nancy Owano report

( -- Microsoft Research is doing research on software that could bring you your own personal data mining center with a touch of Proust for returns. In a recent video, Microsoft scientist Eric Horvitz demonstrated the Lifebrowser, which is prototype software that helps put your digital life in meaningful shape. The software uses machine learning to help a user place life events, which may span months or years, to be expanded or contracted selectively, in better context.

Navigating the large stores of personal information on a user’s computer, the program goes through the piles of , including photos, emails and calendar dates. A search feature can pull up landmark on a certain topic. Filtering the data, the software calls up memory landmarks and provides a timeline interface. Lifebrowser's timeline shows items that the user can associate with "landmark" events with the use of artificial intelligence algorithms.

The video will load shortly

A calendar crawler, working with Microsoft Outlook extracts various properties from calendar events, such as location, organizer, and relationships between participants. The system then applies Bayesian machine learning and reasoning to derive atypical features from events that make them memorable. Images help human memory, and an image crawler analyzes a photo library. By associating an email with a relevant calendar date with a relevant document and photos, significance is gleaned from personal life events. With a timeline in place, a user can zoom in on details of the timeline around landmarks with a “volume control” or search across the full body of information.

The user can slide the "volume control" to change how significant data has to be if it is to appear on the timeline. Lifebrowser’s machine-learning techniques are key to the way it works. At , has been a focus of research interest as scientists look for further advancements in algorithms and technologies to glean knowledge from data.

Lifebrowser looks for clues about whether a file is especially significant, but if the program is not sure, it asks the user for helpful hints. The questions are in the form of prompts that ask the user if a photo is of a landmark event or if some calendar invitation relates to a landmark event. The premise is that, over time, machines learn what is important to the user.

Searching a person's name made it possible for Horvitz to find the first e-mail that person sent him. Lifebrowser then went to work showing a photo of a family event that took place around the same time. The idea was to walk away with a fuller recollection of the period. Aside from general personal use, one can imagine an application where the software might help someone with memory loss.

Lifebrowser was engineered to make life-spanning search and content-serving easy while providing powerful intelligent software as its foundation. The design is based on studies of human memory that suggest humans often use special events or "landmarks" to guide recall.

Explore further: Facebook forces Timeline; tips to hide users' past

Related Stories

Holodesk prototype puts life in computers (w/ video)

October 20, 2011

( -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. ...

Recommended for you

Microsoft aims at Apple with high-end PCs, 3D software

October 26, 2016

Microsoft launched a new consumer offensive Wednesday, unveiling a high-end computer that challenges the Apple iMac along with an updated Windows operating system that showcases three-dimensional content and "mixed reality."

Making it easier to collaborate on code

October 26, 2016

Git is an open-source system with a polarizing reputation among programmers. It's a powerful tool to help developers track changes to code, but many view it as prohibitively difficult to use.

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.