Spy software can see smartphone texting realtime (w/ Video)

November 4, 2011 by Nancy Owano, Phys.org report

(PhysOrg.com) -- Last month, there was news from video provider Qumu of their discomforting survey that at least half of Americans would use smartphones to secretly spy on others. Now there is rattling news that spy software can easily do that kind of job. The software can reveal what others are texting in their personal emails or text messages sent forth on their smartphones just by the snooper using a smartphone camera or advanced camera like a digital SLR that shoots HD video, which could read a screen up to 60 metres away.

Researchers from the University of North Carolina Chapel Hill have used iSpy, the program, as proof that keying a private email message or text message in public, whether on a near-empty train or at the far end of a park bench away from everyone else, is still risky business.

They successfully were able to compromise the privacy of users typing on virtual keyboards with iSpy. They say iSpy can identify all the text typed on a smartphone display using of the screen.

The UNC research team, Rahul Raguram, Andrew White, Dibenyendu Goswami, Fabian Monrose and Jan-Michael Frahm, discovered they could be on the second floor of a building and read a phone on the ground, leave alone sitting on a bus and catching all the text of a nearby passenger.

How much text at how far a distance depends on the spy device used, whether it is a regular smartphone camera or more advanced camera with lenses.

The team report their findings in the paper, “iSpy: Automatic Reconstruction of Typed Input From Compromising Reflections” and presented their work at the Conference on Computer and Communications Security (CCS) in Chicago.

One of the nice features in smartphones, designed to help users type on small touchscreens, is magnified keys. Letters on the virtual keyboard rise up in bubbles. That is also one of the features that made it so easy for the snoopers to view footage and identify the letters based on the bubble locations. The program correctly identified letters over 90 percent of the time.

Obviously, the UNC team did not do their research in order to promote a mass rush for technology that can spy on what people are saying on their mobile devices.

Their aim is to call attention to the fact that with the freedom of mobile technologies comes the burden of adjusting to the digital life, where special privacy measures may be needed.

“Using footage captured in realistic environments (e.g., on a bus), we show that we are able to reconstruct fluent translations of recorded data in almost all of the test cases, correcting users’ typing mistakes at the same time. We believe these results highlight the importance of adjusting privacy expectations in response to emerging technologies,” say the researchers.

The direction of topics and discussions at this year’s CCS 2011 of the ACM, the world’s largest educational and scientific computing society, is squarely on the side of examining privacy in response to emerging technologies. The event proceedings recognized smartphone security as an emerging area ripe venues where researchers can swap ideas.

“Mobile devices such as smartphones and Internet tablets have achieved computing and networking capabilities comparable to traditional personal computers. Their successful consumerization has also become source of pain for adopting users and organizations,” said the CCS in program notes.

The goal of its workshop on security and privacy goal, said the ACM, was "to deepen our understanding to various security and privacy issues on smartphones, specifically the platforms such as iOS and Android.”

Explore further: Google adds voice and video to Google Talk on Android smartphones

More information: iSpy: Automatic Reconstruction of Typed Input from Compromising Reflections, ACM Conference on Computer and Communications Security (CCS), 2011, cs.unc.edu/~rraguram/papers/CCS2011.pdf

Related Stories

Spy software watches BlackBerry email/photos

April 27, 2010

US software firm Retina-X Studios on Tuesday released a more vigilant version of its Mobile Spy program that captures every email and picture from BlackBerry smartphones.

Britons addicted to their 'CrackBerries': study

August 4, 2011

Many Britons are welded to their smartphones 24 hours a day and refuse to turn them off in cinemas and theatres, according to a study Thursday showing how the devices are changing social behaviour.

Recommended for you

Google Assistant adds more languages in global push

February 23, 2018

Google said Friday its digital assistant software would be available in more than 30 languages by the end of the years as it steps up its artificial intelligence efforts against Amazon and others.

Researchers find tweeting in cities lower than expected

February 20, 2018

Studying data from Twitter, University of Illinois researchers found that less people tweet per capita from larger cities than in smaller ones, indicating an unexpected trend that has implications in understanding urban pace ...

Augmented reality takes 3-D printing to next level

February 20, 2018

Cornell researchers are taking 3-D printing and 3-D modeling to a new level by using augmented reality (AR) to allow designers to design in physical space while a robotic arm rapidly prints the work.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Nov 04, 2011
So you have to be in a clear line of vision.

Not particularly great and extremely easy to block

Only slack idiots are at risk

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.