OpenGlass apps show support for visually impaired (w/ Video)

Aug 05, 2013 by Nancy Owano weblog

A two-person team behind a company called Dapper Vision is pioneering an OpenGlass Project that could tweak perceptions about Google Glass. Rather than seeing Google's wearable as a marketing and infotainment luxury item, the hands-free device could become known as an information vehicle for the visually impaired. The two doctoral students behind Dapper Vision recently released the latest in a series of videos showing OpenGlass apps at work. The latest video in the series, posted last month, offers two explorations into how Google Glass might behave as a support system for identifying objects for the visually impaired.

The video first shows a demo with a Question-Answer app. This app turns to Amazon's Mechanical Turk and Twitter for help in identifying objects. Users take a picture with a question attached, which is sent for answers on Twitter or Amazon's Mechanical Turk. In this scenario the visually impaired user asks Google Glass what an object is ("What is this a can of?") and gets a reply.

The other app, called Memento, carries images and annotations that a sighted user first creates so that the information can then be heard by the visually impaired user. The sighted person creates and describes the scene. Once that is done, the person, wearing Glass, can know what items are in the room. Glass recognizes the scene and reads back the sighted person's earlier commentary. Memento can warn users about dangerous equipment, for example. These are test demos in preparation for further user testing down the road.

This video is not supported by your browser at this time.

In introducing themselves as the two students behind OpenGlass project, Dapper Vision's Brandyn White and Andrew Miller said they have had extensive experience working with MapReduce/Hadoop and Computer Vision. (Hadoop MapReduce is a for easily writing applications processing large amounts of data in-parallel on large clusters of commodity hardware.) The two developed Hadoopy (a Python wrapper for Hadoop Streaming written in Cython) along with Picarus, a library of web-scale algorithms and REST API for Computer Vision, Annotation, Crawling, and Machine Learning. (REST stands for Representational State Transfer, an architectural style using HTTP.)

Explore further: Many docs believe mobile health apps can improve patient care

More information: www.openglass.us/
www.cultofandroid.com/37917/op… e-visually-impaired/

Related Stories

Facebook, Twitter announce apps for Google's Glass

May 17, 2013

Google says it's still figuring out the best ways to use Glass, but the company announced Thursday that Facebook, Twitter and several other media firms have built their own applications for the futuristic-looking wearable ...

Phone camera app with audio cues clicks with blind

May 13, 2013

(Phys.org) —Picture-taking is not a comfortable subject for those with vision impairments or who are blind. Having a resume-type photo for an online bio page or sharing a photo of a trip with friends are ...

Smartphones a big help to visually impaired

May 16, 2012

iPhones and other smartphones can be a huge help to the visually impaired, but few vision doctors are recommending them to patients, according to a study co-authored by a Loyola University Chicago Stritch School of Medicine ...

iPhone app uses crowd sourcing to help the blind

May 13, 2011

(PhysOrg.com) -- A team of innovative thinkers from several universities working together on a joint project to merge existing technology (the iPhone) with a real-world crowd sourcing application to help blind ...

New device puts vision impaired in the picture

Apr 28, 2011

(PhysOrg.com) -- Visually impaired people may soon have greater access to graphical information thanks to a new device developed by Monash University’s Faculty of Information and Technology.

Recommended for you

When the ATM runs Windows, how safe is your money?

Oct 13, 2014

How safe is Microsoft Windows? After all, the list of malware that has caused major headaches worldwide over the last 15 years is long – viruses, worms and Trojans have forced computers to shut down, knocked South Korea offl ...

User comments : 0