Sound, Vibration Recognition Boost Context-Aware Computing
October 16, 2018 | Carnegie Mellon UniversityEstimated reading time: 1 minute
Smart devices can seem dumb if they don't understand where they are or what people around them are doing. Carnegie Mellon University researchers say this environmental awareness can be enhanced by complementary methods for analyzing sound and vibrations.
"A smart speaker sitting on a kitchen countertop cannot figure out if it is in a kitchen, let alone know what a person is doing in a kitchen," said Chris Harrison, assistant professor in CMU's Human-Computer Interaction Institute (HCII). "But if these devices understood what was happening around them, they could be much more helpful."
Harrison and colleagues in the Future Interfaces Group will report today at the Association for Computing Machinery's User Interface Software and Technology Symposium in Berlin about two approaches to this problem — one that uses the most ubiquitous of sensors, the microphone, and another that employs a modern-day version of eavesdropping technology used by the KGB in the 1950s.
In the first case, the researchers have sought to develop a sound-based activity recognition system, called Ubicoustics. This system would use the existing microphones in smart speakers, smartphones and smartwatches, enabling them to recognize sounds associated with places, such as bedrooms, kitchens, workshops, entrances and offices.
"The main idea here is to leverage the professional sound-effect libraries typically used in the entertainment industry," said Gierad Laput, a Ph.D. student in HCII. "They are clean, properly labeled, well-segmented and diverse. Plus, we can transform and project them into hundreds of different variations, creating volumes of data perfect for training deep-learning models.
"This system could be deployed to an existing device as a software update and work immediately," he added.
Suggested Items
I-Connect007 Editor’s Choice: Five Must-Reads for the Week
05/03/2024 | Nolan Johnson, I-Connect007This week’s most important news is strategic—and telling. When one puts together the IPC industry reports, we simply have to include the recent conversation with Shawn DuBravac and Tom Kastner. On the design side, check out the latest “On The Line With…” podcast featuring Brad Griffin from Cadence Design Systems, discussing SI and PI in the realm of intelligent system design.
Industrial PC Market Size to Record $1.75 Billion Growth from 2023-2027
05/03/2024 | PRNewswireThe global industrial pc market size is estimated to grow by USD 1.75 billion from 2023 to 2027, according to Technavio. This growth is expected to occur at a Compound Annual Growth Rate (CAGR) of almost 6.29% during the forecast period.
Real Time with… IPC APEX EXPO 2024: Sigma Engineering's Recycling and Regeneration Systems for PCB Etching
05/02/2024 | Real Time with...IPC APEX EXPOEvan Howard of Schmoll America interviews Kristoffer Bjorklund, Sigma Engineering's supply chain manager. We learn about Sigma's recycling and regeneration systems for PCB industry etching and the benefits and challenges of implementing these systems in existing factories.
Boeing T-7A Red Hawk Triples Progress
05/01/2024 | BoeingThe Boeing T-7A Red Hawk achieved three recent milestones, propelling the advanced pilot trainer for the U.S. Air Force forward.
Merlin Flex invests in New Schmoll Direct Imaging System
04/30/2024 | Merlin Flex LtdMerlin Flex has fully installed and commissioned its 2nd Schmoll MDI Direct Imaging system. This new machine includes a twin bed, 4 head system which enhances Merlin Flex’s direct imaging capability for its 1.4M long flexible circuits.