OpenGlass apps show support for visually impaired (w/ Video)

Aug 05, 2013 by Nancy Owano weblog

A two-person team behind a company called Dapper Vision is pioneering an OpenGlass Project that could tweak perceptions about Google Glass. Rather than seeing Google's wearable as a marketing and infotainment luxury item, the hands-free device could become known as an information vehicle for the visually impaired. The two doctoral students behind Dapper Vision recently released the latest in a series of videos showing OpenGlass apps at work. The latest video in the series, posted last month, offers two explorations into how Google Glass might behave as a support system for identifying objects for the visually impaired.

The video first shows a demo with a Question-Answer app. This app turns to Amazon's Mechanical Turk and Twitter for help in identifying objects. Users take a picture with a question attached, which is sent for answers on Twitter or Amazon's Mechanical Turk. In this scenario the visually impaired user asks Google Glass what an object is ("What is this a can of?") and gets a reply.

The other app, called Memento, carries images and annotations that a sighted user first creates so that the information can then be heard by the visually impaired user. The sighted person creates and describes the scene. Once that is done, the person, wearing Glass, can know what items are in the room. Glass recognizes the scene and reads back the sighted person's earlier commentary. Memento can warn users about dangerous equipment, for example. These are test demos in preparation for further user testing down the road.

This video is not supported by your browser at this time.

In introducing themselves as the two students behind OpenGlass project, Dapper Vision's Brandyn White and Andrew Miller said they have had extensive experience working with MapReduce/Hadoop and Computer Vision. (Hadoop MapReduce is a for easily writing applications processing large amounts of data in-parallel on large clusters of commodity hardware.) The two developed Hadoopy (a Python wrapper for Hadoop Streaming written in Cython) along with Picarus, a library of web-scale algorithms and REST API for Computer Vision, Annotation, Crawling, and Machine Learning. (REST stands for Representational State Transfer, an architectural style using HTTP.)

Explore further: Facebook, Twitter announce apps for Google's Glass

More information: www.openglass.us/
www.cultofandroid.com/37917/openglass-project-shows-off-how-useful-glass-can-be-if-youre-visually-impaired/

Related Stories

Facebook, Twitter announce apps for Google's Glass

May 17, 2013

Google says it's still figuring out the best ways to use Glass, but the company announced Thursday that Facebook, Twitter and several other media firms have built their own applications for the futuristic-looking wearable ...

Phone camera app with audio cues clicks with blind

May 13, 2013

(Phys.org) —Picture-taking is not a comfortable subject for those with vision impairments or who are blind. Having a resume-type photo for an online bio page or sharing a photo of a trip with friends are ...

Smartphones a big help to visually impaired

May 16, 2012

iPhones and other smartphones can be a huge help to the visually impaired, but few vision doctors are recommending them to patients, according to a study co-authored by a Loyola University Chicago Stritch School of Medicine ...

iPhone app uses crowd sourcing to help the blind

May 13, 2011

(PhysOrg.com) -- A team of innovative thinkers from several universities working together on a joint project to merge existing technology (the iPhone) with a real-world crowd sourcing application to help blind ...

New device puts vision impaired in the picture

Apr 28, 2011

(PhysOrg.com) -- Visually impaired people may soon have greater access to graphical information thanks to a new device developed by Monash University’s Faculty of Information and Technology.

Recommended for you

Android gains in US, basic phones almost extinct

7 hours ago

The Google Android platform grabbed the majority of mobile phones in the US market in early 2014, as consumers all but abandoned non-smartphone handsets, a survey showed Friday.

Hackathon team's GoogolPlex gives Siri extra powers

Apr 17, 2014

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

LinkedIn membership hits 300 million

The career-focused social network LinkedIn announced Friday it has 300 million members, with more than half the total outside the United States.

Researchers uncover likely creator of Bitcoin

The primary author of the celebrated Bitcoin paper, and therefore probable creator of Bitcoin, is most likely Nick Szabo, a blogger and former George Washington University law professor, according to students ...

Impact glass stores biodata for millions of years

(Phys.org) —Bits of plant life encapsulated in molten glass by asteroid and comet impacts millions of years ago give geologists information about climate and life forms on the ancient Earth. Scientists ...