Microsoft camera-based stylus seeks accuracy in sea of pixels

Jul 24, 2012 by Nancy Owano weblog

(Phys.org) -- To the multitouch screen generation, the stylus PDA tool of the past century seems like a quaint relic. While most mobile devices and laptops then moved away from stylus-friendly touchscreens, signs are here that touch interaction using the stylus is due for a comeback. The stylus has become a focus for innovation. Samsung has offered a stylus accessory for its Galaxy devices and there are stylus accessories for the iPad. The latest stylus news, though, belongs in Microsoft’s corner where researchers at Microsoft Research are working to make the stylus more accurate and more useful than ever before.

Their idea is a stylus that could work on all screens, even nontouch screens, on laptops, tablets, and phones. They are aiming for not only screen flexibility but also for accuracy. Microsoft’s stylus can accurately track individual pixels on an LCD display The real differentiators in the Microsoft design are the location tricks the stylus can use to “find” itself in a sea of pixels. A camera in the stylus determines which pixels are in and out of focus, and sends the information back to software which translates where the stylus is being placed on the screen, including the angle. The camera captures images of the display at a resolution of 512×512 pixels. By using the grid of pixels that make up the display, the stylus can count the pixels as they move past the camera’s field of view in order to precisely track movement in any direction. The grid of pixels is turned into a navigational guide. The camera, in tracking at a pixel level, allows for a more accurate stylus. Andreas Nowatzyk and Anoop Gupta got the idea of using this grid of pixels that make up a display as a navigational system.

Still in development, though, the camera-based stylus requires work ahead. The hurdle that Microsoft researchers need to resolve now is pressure sensitivity and the risk of cracked screens, especially displays fused to thin layers of glass.

According to Technology Review, another bridge to cross has to do with the image sensor to test prototypes. Compared to a good-quality wireless mouse using a compact image sensor with a resolution of 30x30 pixels, the stylus design that the Microsoft researchers have in mind would require one with a resolution of 512x512 pixels, to see the details as small as a tenth of a millimeter and to capture images at a high rate to track motion smoothly. The next development step “requires making that chip," said Nowatzyk. He also said that no decision has been made on whether or not to develop the design into a product.

Explore further: Giant tablets aimed at families

More information:
via Technology Review

Related Stories

Bridgestone is demonstrating its AeroBee e-reader

Apr 18, 2011

(PhysOrg.com) -- Most e-readers are E-Ink. On devices, such as the very popular Amazon Kindle, they allow users to have a clear and paper-like viewing experience, and no glare in high light or outdoor situations. ...

The worlds smallest 3D HD display

May 16, 2011

(PhysOrg.com) -- It seems like small displays are all of the rage these days, and they just keep getting more and more advanced. In October of last year Ortus Technology created a 4.8-inch liquid crystal ...

LG Electronics Introduces LG Viewty Mobile Phone

Oct 15, 2007

LG Electronics, a worldwide technology leader in mobile communications, introduced its new LG Viewty, LG-KU990 mobile phone with advanced digital camera features and the ability to record video at up to 120 ...

Samsung bringing super-size smartphone to US

Jan 10, 2012

South Korean electronics giant Samsung announced plans Monday to bring its super-size smartphone, the Galaxy Note, which also features a stylus for taking notes, to the United States.

JDI develops a 2.3 inch LCD display packed at 651ppi

Jun 06, 2012

(Phys.org) -- Japan Display Inc. has created a small direct-view display that is packed with so many pixels that it features twice the resolution of the current iPhone 4 with its Retina display. And while ...

Recommended for you

Giant tablets aimed at families

20 hours ago

Costing a little more than an iPad but standing more than twice as tall, a new pair of giant tablets wants families to share cozier group experiences with technology.

Myo armband and smartglasses set for deskless workplace

Aug 20, 2014

Thalmic Labs, Canada-based makers of the Myo armband, has announced the integration of Myo with smartglasses, with the partnership help of a number of companies pairing the Myo with their products. The gesture-control ...

Sharp Aquos Crystal phone: Where's the bezel?

Aug 18, 2014

Just when you thought a fashionable gadget must be somewhat thin, Sharp is going to charm the smartphone fashion-conscious with a crazily thin phone, and it is arriving in the US quite soon. Gorgeous. Cool. ...

User comments : 3

Adjust slider to filter visible comments by rank

Display comments: newest first

daqman
not rated yet Jul 24, 2012
My goodness, look at that, it's a light pen. I used to use something like that back in the 1970's. Ok, this is more advanced but it's still a light sensor on the end of a pen that detects location on a screen optically.
Satene
not rated yet Jul 24, 2012
My goodness, look at that, it's a light pen.
Adding a camera to a stylus could let it interact with any deviceeven one without a touch screen.
PPihkala
not rated yet Jul 25, 2012
There are 640x480 (VGA) resolution cameras used in many devices, but this `optical mouse` for displays might need differently built one. One challenge is to make it energy efficient, because wired stylus is less usable. Light pen was one pixel light sensor that worked with CRT screens. It would not work with LCDs, because only CRT gives the needed kind of `heart beat` pattern of pixel brightness it used to be able to work. It also didn`t work at non-lit pixels.