Robots Learn by Watching How-to Videos
January 4, 2016 | Cornell UniversityEstimated reading time: 2 minutes
The computer scans the videos frame by frame, looking for objects that appear often, and reads the accompanying narration - using subtitles – looking for frequently repeated words. Using these markers it matches similar segments in the various videos and orders them into a single sequence. From the subtitles of that sequence it can produce written instructions. In other research, robots have learned to perform tasks by listening to verbal instructions from a human. In the future, information from other sources such as Wikipedia might be added.
The learned knowledge from the YouTube videos is made available via RoboBrain, an online knowledge base robots anywhere can consult to help them do their jobs.
The research is supported in part by the Office of Naval Research and a Google Research Award.
Page 2 of 2Suggested Items
Hon Hai Research Institute Achieves Breakthrough in Quantum Cryptography Recognized by Leading Global Conference
06/17/2025 | FoxconnHon Hai Research Institute (HHRI), the research arm of Hon Hai Technology Group (Foxconn), the world’s largest electronics manufacturer and technology service provider, has achieved a significant breakthrough in quantum computing.
VIAVI, Hanyang University Sign Memorandum of Understanding to Advance 6G Research
06/10/2025 | PRNewswireVIAVI Solutions Inc. and Hanyang University, one of South Korea's leading academic institutions, today announced a Memorandum of Understanding to collaborate on AI-RAN, 5G and 6G research at the university's Beyond-G Global Innovation Center.
IDC Increases its PC and Tablet Forecasts Despite Tariff Uncertainty
06/02/2025 | IDCAfter recording strong results in the first quarter of 2025, IDC is increasing its traditional PC forecast for 2025 — this comes despite the significant impact that US tariffs have had on its trading partners’ market sentiment.
IonQ Signs MoU with KISTI to Accelerate South Korea’s Role in the Global Quantum Race
06/02/2025 | IonQIonQ, a leading commercial quantum computing and networking company, today announced the signing of a memorandum of understanding (MoU) with the Korea Institute of Science and Technology Information (KISTI), a leading national science and technology research institute and supercomputing center.
Stephen Winchell Appointed DARPA Director
06/02/2025 | DARPAStephen Winchell was sworn in today as the 24th director of the Defense Advanced Research Projects Agency.