Wearable-Tech Glove Translates Sign Language Into Speech in Real Time
June 29, 2020 | UCLA NewsroomEstimated reading time: 2 minutes
UCLA bioengineers have designed a glove-like device that can translate American Sign Language into English speech in real time though a smartphone app. Their research is published in the journal Nature Electronics.
“Our hope is that this opens up an easy way for people who use sign language to communicate directly with non-signers without needing someone else to translate for them,” said Jun Chen, an assistant professor of bioengineering at the UCLA Samueli School of Engineering and the principal investigator on the research. “In addition, we hope it can help more people learn sign language themselves.”
The system includes a pair of gloves with thin, stretchable sensors that run the length of each of the five fingers. These sensors, made from electrically conducting yarns, pick up hand motions and finger placements that stand for individual letters, numbers, words and phrases.
The device then turns the finger movements into electrical signals, which are sent to a dollar-coin–sized circuit board worn on the wrist. The board transmits those signals wirelessly to a smartphone that translates them into spoken words at the rate of about a one word per second.
The researchers also added adhesive sensors to testers’ faces — in between their eyebrows and on one side of their mouths — to capture facial expressions that are a part of American Sign Language.
Previous wearable systems that offered translation from American Sign Language were limited by bulky and heavy device designs or were uncomfortable to wear, Chen said.
The device developed by the UCLA team is made from lightweight and inexpensive but long-lasting, stretchable polymers. The electronic sensors are also very flexible and inexpensive.
In testing the device, the researchers worked with four people who are deaf and use American Sign Language. The wearers repeated each hand gesture 15 times. A custom machine-learning algorithm turned these gestures into the letters, numbers and words they represented. The system recognized 660 signs, including each letter of the alphabet and numbers 0 through 9.
In addition to Chen, the study’s UCLA authors are co-lead author Zhihao Zhao, Kyle Chen, Songlin Zhang, Yihao Zhou and Weili Deng. All are members of Chen’s Wearable Bioelectronics Research Group at UCLA. The other corresponding author is Jin Yang, of China’s Chongqing University.
UCLA has filed for a patent on the technology. A commercial model based on this technology would require added vocabulary and an even faster translation time, Chen said.
Read the original article here.
Suggested Items
Meet Polar's New Product Specialist Jess Hollenbaugh
11/21/2024 | Andy Shaughnessy, I-Connect007At PCB West, I spoke with Jess Hollenbaugh, a recent college graduate who has now joined Polar Instruments. In this interview, she shares her journey from a physics student focused on high-energy astrophysics to her new role at Polar. Her insights provide a glimpse into the dynamic opportunities awaiting those who venture into this evolving industry.
Hon Hai’s Efforts to Create a Friendlier Workplace Environment Were Recognized by the American Ragan Award
11/11/2024 | Hon Hai Technology GroupThe Ragan CSR & DIVERSITY AWARDS awards were held grandly at the Yale Club in New York a few days ago. Hon Hai Technology Group, the world’s largest technology manufacturer and service provider Participated in the selection with the "Diverse, Fair and Inclusive Disability Service Plan" and stood out from the competition, winning the award in the ESG activity category.
AEMS: Expanding Del Mar’s Vibe into Anaheim
10/21/2024 | Andy Shaughnessy, Design007 MagazineIn the final hours of the Anaheim Electronics & Manufacturing Show (AEMS), I spoke with show managers Doug Bodenstab and Connor Good. Doug, a longtime surfer, is also the founder and manager of the Del Mar Electronics & Manufacturing Show at the Del Mar Fairgrounds. I asked Doug and Connor to discuss how the Anaheim show got started and the impact it’s making on the industry.
It’s Only Common Sense: Motivate Your Team by Giving Them What They Crave
10/14/2024 | Dan Beaulieu -- Column: It's Only Common SenseThe business world is teeming with challenges, and whether you’re in manufacturing, service, or technology, one universal truth holds steady: people are the backbone of any successful operation. If you’re not tapping into what your people crave, you’re missing a massive opportunity. It’s not just about salary or benefits anymore; it’s about something deeper, something that Gregg Lederman outlines perfectly in his book, "Crave: You Can Enhance Employee Motivation in 10 Minutes by Friday."
Dan’s Biz Bookshelf: ‘From Bud to Boss: Secrets to a Successful Transition to Remarkable Leadership’
10/09/2024 | Dan Beaulieu -- Column: Dan's Biz BookshelfBecoming the boss of people you have worked with for years is rarely spoken or written about. However, it’s an important subject given that this happens a lot in companies, and this book effectively deals with this issue that affects the bosses and employees who find themselves in this situation.