Automatic live subtitling system being trialed in academic conferences

September 11, 2015, Kyoto University
Automatic live subtitling system being trialed in academic conferences
Conceptual diagram

An automatic subtitling system powered by the speech recognition technology which is under development at Kyoto University made its debut on 22 August at the inaugural meeting of the Assistive and Accessible Computing (AAC) Study Group of the Information Processing Society of Japan (IPSJ). The system is intended to help people with hearing difficulties and is scheduled to be trialed over an extended term in academic conferences.

Long-term trial use of a high-accuracy speech recognition system in academic conferences represents an unprecedented step which it is hoped will eventually lead to the establishment of a dramatically lower-cost alternative to the conventional method of providing subtitles for the deaf and hard-of-hearing (SDH), which involves two or more specially trained and experienced typists working together.

A new accessibility law scheduled to take effect in Japan next year mandates provision of "reasonable accommodation" to persons with disabilities. With the number of students with special needs rising steadily, universities and conference organizers are under increasing pressure to find ways to ensure accessibility of their lectures and presentations. In the context of assisting deaf and hard-of-hearing people, this usually means providing subtitles and text summaries. However, persons capable of summarizing highly technical information and typing it out in real time continue to be in limited supply, posing a serious human resources challenge for many universities and academic institutions.

Against this backdrop, two KU researchers working on natural speech recognition—Professor Tatsuya Kawahara of the Graduate School of Informatics and Dr Yuya Akita, a Lecturer at the Graduate School of Economics—have succeeded in developing a system that automatically generates subtitles for speeches and lectures as they are delivered.

In order to achieve the highest possible degree of accuracy, the system needs to be customized in advance by familiarizing it with the vocabulary and topic of the talk in question, requiring the operator to obtain the proceedings paper beforehand. In addition, the output will inevitably contain some errors that need to be manually corrected.

Automatic live subtitling system being trialed in academic conferences
Live subtitling system being demonstrated

That said, for a reasonably successful session, the amount of correction required should be within the capacity of a single person, making the procedure much less expensive—less than one-tenth by some estimates—than manual subtitling.

Through trialing the system in academic conferences on a continuous basis with the cooperation of participating speakers—who will be asked to submit proceedings papers in advance, speak slowly and clearly, and repeat questions from the audience—the project team is hoping to keep improving the performance of the system and to continue accumulating operational know-how.

Explore further: Sony unveils new eyeglasses for displaying movie subtitles

Related Stories

Sony unveils new eyeglasses for displaying movie subtitles

August 26, 2011

( -- Granted, movie subtitles aren’t something most people think about. In fact most groan when they find a movie they’ve paid to see suddenly starts projecting text at the bottom of the screen as it ...

Speech recognition from brain activity

June 16, 2015

Speech is produced in the human cerebral cortex. Brain waves associated with speech processes can be directly recorded with electrodes located on the surface of the cortex. It has now been shown for the first time that is ...

Recommended for you

Technology near for real-time TV political fact checks

January 18, 2019

A Duke University team expects to have a product available for election year that will allow television networks to offer real-time fact checks onscreen when a politician makes a questionable claim during a speech or debate.

Privacy becomes a selling point at tech show

January 7, 2019

Apple is not among the exhibitors at the 2019 Consumer Electronics Show, but that didn't prevent the iPhone maker from sending a message to attendees on a large billboard.

China's Huawei unveils chip for global big data market

January 7, 2019

Huawei Technologies Ltd. showed off a new processor chip for data centers and cloud computing Monday, expanding into new and growing markets despite Western warnings the company might be a security risk.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.