Lifebrowser: Data mining gets (really) personal at Microsoft

Mar 17, 2012 by Nancy Owano report

(PhysOrg.com) -- Microsoft Research is doing research on software that could bring you your own personal data mining center with a touch of Proust for returns. In a recent video, Microsoft scientist Eric Horvitz demonstrated the Lifebrowser, which is prototype software that helps put your digital life in meaningful shape. The software uses machine learning to help a user place life events, which may span months or years, to be expanded or contracted selectively, in better context.

Navigating the large stores of personal information on a user’s computer, the program goes through the piles of , including photos, emails and calendar dates. A search feature can pull up landmark on a certain topic. Filtering the data, the software calls up memory landmarks and provides a timeline interface. Lifebrowser's timeline shows items that the user can associate with "landmark" events with the use of artificial intelligence algorithms.

This video is not supported by your browser at this time.

A calendar crawler, working with Microsoft Outlook extracts various properties from calendar events, such as location, organizer, and relationships between participants. The system then applies Bayesian machine learning and reasoning to derive atypical features from events that make them memorable. Images help human memory, and an image crawler analyzes a photo library. By associating an email with a relevant calendar date with a relevant document and photos, significance is gleaned from personal life events. With a timeline in place, a user can zoom in on details of the timeline around landmarks with a “volume control” or search across the full body of information.

The user can slide the "volume control" to change how significant data has to be if it is to appear on the timeline. Lifebrowser’s machine-learning techniques are key to the way it works. At , has been a focus of research interest as scientists look for further advancements in algorithms and technologies to glean knowledge from data.

Lifebrowser looks for clues about whether a file is especially significant, but if the program is not sure, it asks the user for helpful hints. The questions are in the form of prompts that ask the user if a photo is of a landmark event or if some calendar invitation relates to a landmark event. The premise is that, over time, machines learn what is important to the user.

Searching a person's name made it possible for Horvitz to find the first e-mail that person sent him. Lifebrowser then went to work showing a photo of a family event that took place around the same time. The idea was to walk away with a fuller recollection of the period. Aside from general personal use, one can imagine an application where the software might help someone with memory loss.

Lifebrowser was engineered to make life-spanning search and content-serving easy while providing powerful intelligent software as its foundation. The design is based on studies of human memory that suggest humans often use special events or "landmarks" to guide recall.

Explore further: 'Halo' makers shed light on live-action series

Related Stories

Google works to close security loophole in Android

May 20, 2011

Google is in the process of updating its Android operating system to fix an issue that is believed to have left millions of smartphones and tablets vulnerable to personal data leaks. ...

Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" ...

Recommended for you

Watching others play video games is the new spectator sport

Aug 29, 2014

As the UK's largest gaming festival, Insomnia, wrapped up its latest event on August 25, I watched a short piece of BBC Breakfast news reporting from the festival. The reporter and some of the interviewees appeared baff ...

SHORE facial analysis spots emotions on Google Glass

Aug 28, 2014

One of the key concerns about facial recognition software has been over privacy. The very idea of having tracking mechanisms as part of an Internet-connected wearable would be likely to upset many privacy ...

User comments : 0