Georgia Tech develops braille-like texting app (w/ video)

Feb 17, 2012
Georgia Tech researchers have designed a texting solution that could become a modern substitute for passing notes under the table. BrailleTouch is a prototype texting app that requires only finger gestures to key in letters on touch screen devices - no sight required. Credit: The Georgia Institute of Technology

Imagine if smartphone and tablet users could text a note under the table during a meeting without anyone being the wiser. Mobile gadget users might also be enabled to text while walking, watching TV or socializing without taking their eyes off what they're doing.

Georgia Tech researchers have built a prototype for touch-screen mobile devices that is vying to be a complete solution for texting without the need to look at a mobile gadget's screen.

"Research has shown that chorded, or gesture-based, texting is a viable solution for eyes-free written communication in the future, making obsolete the need for users to look at their devices while inputting text on them," said Mario Romero, Postdoctoral Fellow in the School of (IC) and the project's principal investigator.

The free open-source app, called BrailleTouch, incorporates the Braille writing system used by the . It has been conceived as a texting tool for any of the millions of smartphone worldwide.

Early studies with visually impaired participants proficient in Braille typing have demonstrated that users can input at least six times the number of words per minute when compared to other research prototypes for eyes-free texting on a touch screen. Users reach up to 32 words per minute with 92 percent accuracy with the prototype app for the .

This video is not supported by your browser at this time.
Georgia Tech researchers have designed a texting solution that could become a modern substitute for passing notes under the table. BrailleTouch is a prototype texting app that requires only finger gestures to key in letters on touch screen devices - no sight required. Credit: The Georgia Institute of Technology

"We are currently designing a study to formally evaluate BrailleTouch through both quantitative and qualitative methods," said Caleb Southern, an IC graduate student. "We will measure the typing speed and accuracy of visually impaired users and capture the feedback from in areas such as comfort, ease of use and perceived value."

For sighted users, the research team is exploring how BrailleTouch could be a universal eyes-free mobile texting app that replaces soft QWERTY keyboards and other texting technologies.

"BrailleTouch is an out-of-the-box solution that will work with smartphones and tablets and allow users to start learning the Braille alphabet in a few minutes," said Romero. "It also reduces the need for expensive proprietary Braille keyboard devices, which typically cost thousands of dollars."

The researchers have designed BrailleTouch to address the limitations of soft keyboards, which do not provide tactile feedback, as well as physical keyboards, which often use small and numerous fixed buttons. BrailleTouch is the only iPhone app in existence that uses a six-finger chording process that replicates the traditional Braille keyboard.

The app uses a gesture-based solution by turning the iPhone's touchscreen into a soft-touch keyboard programmed for Braille and requiring only six keys, making it a practical solution for the limited screen real estate on smartphones.

The key feature of the BrailleTouch technology is the use of the six-key configuration so that the keyboard fits on the screen and users keep their fingers in a relatively fixed position while texting. This design allows to hold their device with the screen facing away from them ¬– cradling the device with their palms or pinkies and thumbs – and to type with a majority of their fingers, identical to typing Braille on a standard keyboard.

The team behind BrailleTouch is led by Romero and IC Professor Gregory Abowd, co-principal investigator. Former IC affiliate Brian Frey conceived the original idea and developed the first prototype and Southern created an improved design. They are conducting usability studies together with James Clawson, a Ph.D. candidate in IC, and Kate Rosier, a master's graduate in Digital Media and bachelor's graduate in Computational Media.

The research group has developed iPhone and iPad versions of BrailleTouch and is currently working on Android versions. The app recently won the MobileHCI 2011 competition for design at the MobileHCI conference in Stockholm, Sweden.

Explore further: Beyond GoPro: Skiers and snowboarders can measure everything with apps, hardware

Related Stories

New mobile app, ShoeBox, helps scan old photos

Nov 02, 2011

(AP) -- A new smartphone app will help you transition your old paper photos into the digital age. Called ShoeBox, the free app lets you use your iPhone's camera as a photo scanner.

Chips and apps on tap for Super Bowl

Feb 04, 2012

Millions of American football fans will be watching the Super Bowl on television Sunday with one hand in the potato chips and the other holding a smartphone.

Keeping your hands on the wheel, off the keyboard

Jan 25, 2011

In our continuing series on tech to help meet your New Year's resolutions, we hope you vowed in 2011 to quit the dangerous habit of texting while driving. If willpower alone is not enough, there are a few smart-phone ...

Snail Braille reader could read books to the blind

May 06, 2011

(PhysOrg.com) -- To most of us, Braille is largely a mystery. It feels really cool, but the idea of actually reading it is kind of a pipe dream. Our sense of touch simply is not as sensitive as that of a blind ...

Recommended for you

Team infuses science into 'Minecraft' modification

19 hours ago

The 3-D world of the popular "Minecraft" video game just became more entertaining, perilous and educational, thanks to a comprehensive code modification kit, "Polycraft World," created by University of Texas at Dallas professors, ...

Microsoft's Garage becomes an incubator of consumer apps

21 hours ago

For five years now, The Garage has served as Microsoft's incubator for employees' passion projects, an internal community of engineers, designers, hardware tinkerers and others from all different parts of the company who ...

Students win challenge for real-time traffic app

21 hours ago

Three University of Texas at Arlington Computer Science and Engineering students have won a $10,000 prize in the NTx Apps Challenge for a smart traffic light network that adjusts traffic light schedules to ...

Blink, point, solve an equation: Introducing PhotoMath

Oct 22, 2014

"Ma, can I go now? My phone did my homework." PhotoMath, from the software development company MicroBlink, will make the student's phone do math homework. Just point the camera towards the mathematical expression, ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

acliff
not rated yet Feb 20, 2012
It is about time that someone starts to address the problem of the Achilles heel of the iPhone, and probably many Android phones as well. Their lacking of a physical keyboard really is fatally flawed when comes to texting. You will have to look at the tiny keys to type, instead of looking on the screen of what you are writing. Even with the utmost of care you can still make many mistakes by hitting the wrong key on an iPhone. Another app tries to help iPhone users lookup contacts, called PhoneBook Plus, uses a bigger numerical keypad, but it is only limited to searching names, numbers and groups, not for texting. But still, it is easy to see a big difference PhoneBook already made. Siri may be a partial solution, but would be very interesting to see whether there can be a new revolution way of typing on a touch screen.