Robots Learn by Watching How-to Videos
January 4, 2016 | Cornell UniversityEstimated reading time: 2 minutes
The computer scans the videos frame by frame, looking for objects that appear often, and reads the accompanying narration - using subtitles – looking for frequently repeated words. Using these markers it matches similar segments in the various videos and orders them into a single sequence. From the subtitles of that sequence it can produce written instructions. In other research, robots have learned to perform tasks by listening to verbal instructions from a human. In the future, information from other sources such as Wikipedia might be added.
The learned knowledge from the YouTube videos is made available via RoboBrain, an online knowledge base robots anywhere can consult to help them do their jobs.
The research is supported in part by the Office of Naval Research and a Google Research Award.
Page 2 of 2Suggested Items
New Database of Materials Accelerates Electronics Innovation
05/02/2025 | ACN NewswireIn a collaboration between Murata Manufacturing Co., Ltd., and the National Institute for Materials Science (NIMS), researchers have built a comprehensive new database of dielectric material properties curated from thousands of scientific papers.
Meet Thiago Guimaraes, IPC's New Director of Industry Intelligence
05/05/2025 | Chris Mitchell, IPC VP, Global Government RelationsThe fast pace of innovation in the electronics manufacturing industry means business owners must continuously adapt their processes and capabilities to meet changing customer demands and market trends. To that end, IPC has hired Thiago Guimaraes as the new director of Industry Intelligence. In this interview, Thiago shares key goals and objectives that could revolutionize the industry as he helps stakeholders navigate industry trends and challenges.
Honeywell Advances Technology for the European Defense Sector
04/29/2025 | HoneywellHoneywell has received two research grants to execute projects aimed at advancing avionics and cybersecurity capabilities for the European defense sector.
Real Time with... IPC APEX EXPO 2025: Winner of the IPC Best Student Poster Award
04/29/2025 | Real Time with...IPC APEX EXPOSebastian Carrillo, winner of the Best Student Technical Poster Award, shares insights on his research in nanotechnology and plasmonics. His work on a metal insulator nano array focuses on light-matter interactions at the nanoscale. With advancements in manufacturing, applications include sensing technologies and photovoltaic systems. Sebastian discusses his project involving simulations and optical experiments. His career goals are in research, and he encourages students to seize academic opportunities.
ITRI Named a Top 100 Global Innovator for the Ninth Time
04/28/2025 | PRNewswireThe Industrial Technology Research Institute (ITRI) was officially honored at the 2025 Top 100 Global Innovators Award Ceremony hosted by Clarivate in Taipei.