Microsoft camera-based stylus seeks accuracy in sea of pixels

Jul 24, 2012 by Nancy Owano weblog

(Phys.org) -- To the multitouch screen generation, the stylus PDA tool of the past century seems like a quaint relic. While most mobile devices and laptops then moved away from stylus-friendly touchscreens, signs are here that touch interaction using the stylus is due for a comeback. The stylus has become a focus for innovation. Samsung has offered a stylus accessory for its Galaxy devices and there are stylus accessories for the iPad. The latest stylus news, though, belongs in Microsoft’s corner where researchers at Microsoft Research are working to make the stylus more accurate and more useful than ever before.

Their idea is a stylus that could work on all screens, even nontouch screens, on laptops, tablets, and phones. They are aiming for not only screen flexibility but also for accuracy. Microsoft’s stylus can accurately track individual pixels on an LCD display The real differentiators in the Microsoft design are the location tricks the stylus can use to “find” itself in a sea of pixels. A camera in the stylus determines which pixels are in and out of focus, and sends the information back to software which translates where the stylus is being placed on the screen, including the angle. The camera captures images of the display at a resolution of 512×512 pixels. By using the grid of pixels that make up the display, the stylus can count the pixels as they move past the camera’s field of view in order to precisely track movement in any direction. The grid of pixels is turned into a navigational guide. The camera, in tracking at a pixel level, allows for a more accurate stylus. Andreas Nowatzyk and Anoop Gupta got the idea of using this grid of pixels that make up a display as a navigational system.

Still in development, though, the camera-based stylus requires work ahead. The hurdle that Microsoft researchers need to resolve now is pressure sensitivity and the risk of cracked screens, especially displays fused to thin layers of glass.

According to Technology Review, another bridge to cross has to do with the image sensor to test prototypes. Compared to a good-quality wireless mouse using a compact image sensor with a resolution of 30x30 pixels, the stylus design that the Microsoft researchers have in mind would require one with a resolution of 512x512 pixels, to see the details as small as a tenth of a millimeter and to capture images at a high rate to track motion smoothly. The next development step “requires making that chip," said Nowatzyk. He also said that no decision has been made on whether or not to develop the design into a product.

Explore further: Gift Guide: Strong photo, video gear options

More information:
via Technology Review

Related Stories

Bridgestone is demonstrating its AeroBee e-reader

Apr 18, 2011

(PhysOrg.com) -- Most e-readers are E-Ink. On devices, such as the very popular Amazon Kindle, they allow users to have a clear and paper-like viewing experience, and no glare in high light or outdoor situations. ...

The worlds smallest 3D HD display

May 16, 2011

(PhysOrg.com) -- It seems like small displays are all of the rage these days, and they just keep getting more and more advanced. In October of last year Ortus Technology created a 4.8-inch liquid crystal ...

LG Electronics Introduces LG Viewty Mobile Phone

Oct 15, 2007

LG Electronics, a worldwide technology leader in mobile communications, introduced its new LG Viewty, LG-KU990 mobile phone with advanced digital camera features and the ability to record video at up to 120 ...

Samsung bringing super-size smartphone to US

Jan 10, 2012

South Korean electronics giant Samsung announced plans Monday to bring its super-size smartphone, the Galaxy Note, which also features a stylus for taking notes, to the United States.

JDI develops a 2.3 inch LCD display packed at 651ppi

Jun 06, 2012

(Phys.org) -- Japan Display Inc. has created a small direct-view display that is packed with so many pixels that it features twice the resolution of the current iPhone 4 with its Retina display. And while ...

Recommended for you

Ear-check via phone can ease path to diagnosis

Dec 18, 2014

Ear infections are common in babies and young children. That it is a frequent reason for young children's visit to doctors comes as no consolation for the parents of babies tugging at their ears and crying ...

Gift Guide: Home products come with connectivity

Dec 18, 2014

Do you really need an app to tell you to brush and floss? It seems every household appliance is getting some smarts these days, meaning some connection to a phone app and the broader Internet. But then what?

BlackBerry launches Classic in last-ditch effort

Dec 17, 2014

(AP)—BlackBerry is returning to its roots with a new phone that features a traditional keyboard at a time when rival Apple and Android phones—and most smartphone customers—have embraced touch screens.

Tag Heuer changes tune, now looking at smartwatches

Dec 16, 2014

Barely a few months after dismissing Apple's smartwatch, the new chief executive of luxury Swiss watchmaker Tag Heuer conceded Tuesday that such a hi-tech gadget might after all have a place in his firm's ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

daqman
not rated yet Jul 24, 2012
My goodness, look at that, it's a light pen. I used to use something like that back in the 1970's. Ok, this is more advanced but it's still a light sensor on the end of a pen that detects location on a screen optically.
Satene
not rated yet Jul 24, 2012
My goodness, look at that, it's a light pen.
Adding a camera to a stylus could let it interact with any deviceeven one without a touch screen.
PPihkala
not rated yet Jul 25, 2012
There are 640x480 (VGA) resolution cameras used in many devices, but this `optical mouse` for displays might need differently built one. One challenge is to make it energy efficient, because wired stylus is less usable. Light pen was one pixel light sensor that worked with CRT screens. It would not work with LCDs, because only CRT gives the needed kind of `heart beat` pattern of pixel brightness it used to be able to work. It also didn`t work at non-lit pixels.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.