OpenGlass apps show support for visually impaired (w/ Video)

August 5, 2013 by Nancy Owano weblog

A two-person team behind a company called Dapper Vision is pioneering an OpenGlass Project that could tweak perceptions about Google Glass. Rather than seeing Google's wearable as a marketing and infotainment luxury item, the hands-free device could become known as an information vehicle for the visually impaired. The two doctoral students behind Dapper Vision recently released the latest in a series of videos showing OpenGlass apps at work. The latest video in the series, posted last month, offers two explorations into how Google Glass might behave as a support system for identifying objects for the visually impaired.

The video first shows a demo with a Question-Answer app. This app turns to Amazon's Mechanical Turk and Twitter for help in identifying objects. Users take a picture with a question attached, which is sent for answers on Twitter or Amazon's Mechanical Turk. In this scenario the visually impaired user asks Google Glass what an object is ("What is this a can of?") and gets a reply.

The other app, called Memento, carries images and annotations that a sighted user first creates so that the information can then be heard by the visually impaired user. The sighted person creates and describes the scene. Once that is done, the person, wearing Glass, can know what items are in the room. Glass recognizes the scene and reads back the sighted person's earlier commentary. Memento can warn users about dangerous equipment, for example. These are test demos in preparation for further user testing down the road.

The video will load shortly

In introducing themselves as the two students behind OpenGlass project, Dapper Vision's Brandyn White and Andrew Miller said they have had extensive experience working with MapReduce/Hadoop and Computer Vision. (Hadoop MapReduce is a for easily writing applications processing large amounts of data in-parallel on large clusters of commodity hardware.) The two developed Hadoopy (a Python wrapper for Hadoop Streaming written in Cython) along with Picarus, a library of web-scale algorithms and REST API for Computer Vision, Annotation, Crawling, and Machine Learning. (REST stands for Representational State Transfer, an architectural style using HTTP.)

Explore further: Facebook, Twitter announce apps for Google's Glass

More information: www.openglass.us/
www.cultofandroid.com/37917/openglass-project-shows-off-how-useful-glass-can-be-if-youre-visually-impaired/

Related Stories

Facebook, Twitter announce apps for Google's Glass

May 17, 2013

Google says it's still figuring out the best ways to use Glass, but the company announced Thursday that Facebook, Twitter and several other media firms have built their own applications for the futuristic-looking wearable ...

Phone camera app with audio cues clicks with blind

May 13, 2013

(Phys.org) —Picture-taking is not a comfortable subject for those with vision impairments or who are blind. Having a resume-type photo for an online bio page or sharing a photo of a trip with friends are activities that ...

Smartphones a big help to visually impaired

May 16, 2012

iPhones and other smartphones can be a huge help to the visually impaired, but few vision doctors are recommending them to patients, according to a study co-authored by a Loyola University Chicago Stritch School of Medicine ...

iPhone app uses crowd sourcing to help the blind

May 13, 2011

(PhysOrg.com) -- A team of innovative thinkers from several universities working together on a joint project to merge existing technology (the iPhone) with a real-world crowd sourcing application to help blind people make ...

New device puts vision impaired in the picture

April 28, 2011

(PhysOrg.com) -- Visually impaired people may soon have greater access to graphical information thanks to a new device developed by Monash University’s Faculty of Information and Technology.

Recommended for you

Swiss unveil stratospheric solar plane

December 7, 2016

Just months after two Swiss pilots completed a historic round-the-world trip in a Sun-powered plane, another Swiss adventurer on Wednesday unveiled a solar plane aimed at reaching the stratosphere.

Solar panels repay their energy 'debt': study

December 6, 2016

The climate-friendly electricity generated by solar panels in the past 40 years has all but cancelled out the polluting energy used to produce them, a study said Tuesday.

Wall-jumping robot is most vertically agile ever built

December 6, 2016

Roboticists at UC Berkeley have designed a small robot that can leap into the air and then spring off a wall, or perform multiple vertical jumps in a row, resulting in the highest robotic vertical jumping agility ever recorded. ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.