ShakeID tracks touch action in multi-user display

Jun 03, 2012 by Nancy Owano report
ShakeID tracks touch action in multi-user display
System includes Kinect camera, multi-touch display and 2 accelerometer-equipped phones (one visible).

(Phys.org) -- How do you determine who is doing the touching with a multi-user touch display? Microsoft Research has published a paper that presents a technique for doing so. The researchers make their attempt by fusing Kinect, mobile device inertial sensing, and multi-touch interactive displays. The technique can associate multi-touch interactions to individual users and their accelerometer-equipped mobile devices. ShakeID is the technique; it associates a specific user’s touch contacts on an interactive display to a mobile device held by the user. The phone’s on-board sensors and touch screen sensing go to work to drive the association.

The researchers say that the technique is special compared to other approaches that require bringing the phone in physical contact with the display. ShakeID differs as it only requires the user to hold the phone while touching the display, The approach involves a camera, multi-touch display and two accelerometer-equipped phones. Specifically, the experimenters used the Kinect for Windows SDK to track the hands of multiple users, the Microsoft Surface 2.0 SDK for the multi-touch display and two Windows Phone smartphones.

If two users touch a display simultaneously in different locations to grab content, ShakeID can associate each touch to a specific user and transfer the correct content to each user’s personal device.

Capabilities like this may make shared interactive displays for walk-up use in conference rooms and office hallways more useful. The study says that other applications for interactive displays incorporate smaller devices such as mobile phones.

The researchers showed that ShakeID cross-correlates acceleration data from smartphones that people carry together with hand acceleration captured through Kinect to perform user identification. ShakeID matches the motion sensed by the device to motion observed by a Microsoft Kinect camera pointed at the users standing in front of the touch . To validate this approach, the researchers conducted a 14 person user study and showed accuracy rates of 92% and higher.

The authors say, though, that an important limitation of the process involves the case where the hand holding the phone is stationary. The researchers acknowledge the limits—in realtime the phone users holding the phone may not remain stationary, especially with larger displays.

The paper is titled, “Your or Mine? Fusing Body, Touch and Device Sensing for Multi-User Device-Display Interaction.”

Microsoft’s Kinect made other news recently in London, where St. Thomas Hospital is testing out Kinect’s gesture controls and voice commands with surgeons. The team interacts with a computer that shows a 3-D image of the part of the body being operated on. Using Kinect, there is less risk of contamination from touching computer peripherals during an operation. Standing straight, arms raised, the surgeon issues commands to a Kinect sensor beneath a monitor displaying a 3-D image of the patient's damaged body part. As such, the surgeon can pan across, zoom in and out, rotate images, lock the image and make markers.

Explore further: Google's new self-driving cars cruising Silicon Valley roads

More information: Research paper: research.microsoft.com/pubs/162080/ShakeIDchi12.pdf

Related Stories

Transparent phone display has front-and-back touch

Jun 01, 2012

(Phys.org) -- Japanese wireless carrier NTT DoCoMo and Fujitsu attracted attention at this week’s 2012 Wireless Japan expo, with their transparent, dual-sided smartphone touchscreen. This is a see through ...

Microsoft Kinect makes moves on computers

Jun 17, 2011

Microsoft on Thursday began letting software developers imbue computers with voice and motion-sensing technology from its Kinect controller for the Xbox 360 videogame console.

Microsoft to release a free SDK for Kinect this spring

Feb 22, 2011

(PhysOrg.com) -- Kinect, Microsoft's attempt to bring motion controls to the Xbox 360 video game console, is soon to have a non-commercial SDK released for it that will hopefully allow third-party developers ...

Recommended for you

Most internet anonymity software leaks users' details

5 hours ago

Virtual Private Networks (VPNs) are legal and increasingly popular for individuals wanting to circumvent censorship, avoid mass surveillance or access geographically limited services like Netflix and BBC ...

In the UK, bPay offers fob, band or sticker options

6 hours ago

Method of payment: "Cash or credit?" The two options sound so yesterday. In the UK, technology support in banking offers a new type of menu—band on the wrist, fob or sticker. The three new devices from ...

WikiLeaks says NSA spied on French business

6 hours ago

WikiLeaks has released documents that it says show that the U.S. National Security Agency eavesdropped on France's top finance officials and high-stakes French export bids over a decade in what the group called targeted economic ...

Feds shut down background check database over flaw

8 hours ago

The federal personnel agency whose records were plundered by hackers linked to China announced on Monday the temporary shutdown of a massive database used to update and store background investigation records ...

Disney merges consumer product, interactive divisions

8 hours ago

Disney is merging its consumer product and interactive divisions, a move that acknowledges the shared goals of important product lines like the Disney Infinity video game franchise and the upcoming line of wearable toys called ...

Google gets extended deadline to answer EU case

8 hours ago

Brussels has given Google an extension until mid-August to answer an anti-trust case alleging that the tech giant abuses its search engine's market dominance, a company spokesman said Monday.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.