UB Engineers Modify Headphones to Translate Sign Language via Doppler| University at Buffalo

Подробнее о видео

A University at Buffalo-led research team has modified noise-cancelling headphones, enabling the common electronic device to “see” and translate American Sign Language when paired with a smartphone.

The system uses Doppler technology to sense tiny fluctuations, or echoes, in acoustic soundwaves that are created by the hands of someone signing.
Dubbed SonicASL, the system proved 93.8% effective in tests performed indoors and outdoors involving 42 words. Word examples include “love,” “space,” and “camera.” Under the same conditions involving 30 simple sentences – for example, “Nice to meet you.” – SonicASL was 90.6% effective.

Before such technology is commercially available, much work must be done, he stressed. For example, SonicASL’s vocabulary must be greatly expanded. Also, the system must be able to read facial expressions, a major component of ASL.

For more information, visit: .

Explore #UBuffalo on Social Media:






ABOUT UB:
The University at Buffalo is a premier, research-intensive public university dedicated to academic excellence. Our thinking, research, creative activity and people positively impact the world. UB is New York State's flagship university and a proud member of AAU. For more info, go to buffalo.edu