Wearable-Tech Glove Translates Sign Language Into Speech in Real Time
June 29, 2020 | UCLA NewsroomEstimated reading time: 2 minutes
UCLA bioengineers have designed a glove-like device that can translate American Sign Language into English speech in real time though a smartphone app. Their research is published in the journal Nature Electronics.
“Our hope is that this opens up an easy way for people who use sign language to communicate directly with non-signers without needing someone else to translate for them,” said Jun Chen, an assistant professor of bioengineering at the UCLA Samueli School of Engineering and the principal investigator on the research. “In addition, we hope it can help more people learn sign language themselves.”
The system includes a pair of gloves with thin, stretchable sensors that run the length of each of the five fingers. These sensors, made from electrically conducting yarns, pick up hand motions and finger placements that stand for individual letters, numbers, words and phrases.
The device then turns the finger movements into electrical signals, which are sent to a dollar-coin–sized circuit board worn on the wrist. The board transmits those signals wirelessly to a smartphone that translates them into spoken words at the rate of about a one word per second.
The researchers also added adhesive sensors to testers’ faces — in between their eyebrows and on one side of their mouths — to capture facial expressions that are a part of American Sign Language.
Previous wearable systems that offered translation from American Sign Language were limited by bulky and heavy device designs or were uncomfortable to wear, Chen said.
The device developed by the UCLA team is made from lightweight and inexpensive but long-lasting, stretchable polymers. The electronic sensors are also very flexible and inexpensive.
In testing the device, the researchers worked with four people who are deaf and use American Sign Language. The wearers repeated each hand gesture 15 times. A custom machine-learning algorithm turned these gestures into the letters, numbers and words they represented. The system recognized 660 signs, including each letter of the alphabet and numbers 0 through 9.
In addition to Chen, the study’s UCLA authors are co-lead author Zhihao Zhao, Kyle Chen, Songlin Zhang, Yihao Zhou and Weili Deng. All are members of Chen’s Wearable Bioelectronics Research Group at UCLA. The other corresponding author is Jin Yang, of China’s Chongqing University.
UCLA has filed for a patent on the technology. A commercial model based on this technology would require added vocabulary and an even faster translation time, Chen said.
Read the original article here.
Suggested Items
Global Citizenship: Training the Next Generation of Talent
03/19/2025 | Tom Yang -- Column: Global CitizenshipI believe that the most important assets of any company are the people. Business is all about the people whether it be our customers, suppliers or, most importantly, our own team members. All business is based on people-to-people relationships. Whether you own a three-person hot dog stand or a multi-billion-dollar corporation with thousands of employees, these transactions are based on how we work with one another.
It’s Only Common Sense: Why Building a Strong Personal Brand Is Critical
03/17/2025 | Dan Beaulieu -- Column: It's Only Common Sense“Your reputation precedes you.” This is one of those clichés that happens to be entirely true. Whether you’re stepping into a room full of potential clients, meeting a new colleague for the first time, or connecting online, people often know something about you before you say a word. That “something” is your personal brand—your reputation, your promise, and your legacy all rolled into one. In today’s competitive world, your personal brand is one of the most powerful assets you can cultivate.
How to Discover and Equip the Next Generation of Talent
02/18/2025 | Stephen V. Chavez, Siemens EDAThe demand for skilled PCB designers is at an all-time high, with one-third of engineering jobs in the United States going unfilled. Addressing this talent gap involves solving two interconnected challenges: discovering where to find the next generation of PCB designers and equipping them with the necessary skills to thrive in a rapidly evolving field.
Dan’s Biz Bookshelf: 'Leaders Eat Last'
02/13/2025 | Dan Beaulieu -- Column: Dan's Biz BookshelfSimon Sinek’s "Leaders Eat Last: Why Some Teams Pull Together and Others Don't" is a manifesto on trust and leadership. He explores what makes teams resilient, successful, and happy to be part of something greater than themselves. From CEOs to team leaders, there’s something for everyone, and Sinek’s main takeaway is that people are your most valuable assets.
Global Citizenship: Cultural Nuances Around the World
02/12/2025 | Tom Yang -- Column: Global CitizenshipBusinesses operate across diverse cultural landscapes, so it’s important to understand and embrace cultural nuances. Doing so facilitates smoother operations and can strengthen relationships and success in global markets.