Researchers Selected to Develop Novel Approaches to Lifelong Machine Learning
May 7, 2018 | DARPAEstimated reading time: 3 minutes
Machine learning (ML) and artificial intelligence (AI) systems have significantly advanced in recent years. However, they are currently limited to executing only those tasks they are specifically designed to perform and are unable to adapt when encountering situations outside their programming or training. DARPA’s Lifelong Learning Machines (L2M) program, drawing inspiration from biological systems, seeks to develop fundamentally new ML approaches that allow systems to adapt continually to new circumstances without forgetting previous learning.
Image caption: Today's machine learning and AI systems are limited to executing only tasks they are specifically programmed to perform, without being able to adapt to new situations outside of their training. DARPA's L2M program aims to generate new methodologies that will allow these systems to learn and improve during tasks, apply previous skills and knowledge to new situations, incorporate innate system limits, and enhance safety in automated assignments.
First announced in 2017, DARPA’s L2M program has selected the research teams who will work under its two technical areas. The first technical area focuses on the development of complete systems and their components, and the second will explore learning mechanisms in biological organisms with the goal of translating them into computational processes. Discoveries in both technical areas are expected to generate new methodologies that will allow AI systems to learn and improve during tasks, apply previous skills and knowledge to new situations, incorporate innate system limits, and enhance safety in automated assignments.
The L2M research teams are now focusing their diverse expertise on understanding how a computational system can adapt to new circumstances in real time and without losing its previous knowledge. One group, the team at University of California, Irvine plans to study the dual memory architecture of the hippocampus and cortex. The team seeks to create an ML system capable of predicting potential outcomes by comparing inputs to existing memories, which should allow the system to become more adaptable while retaining previous learnings. The Tufts University team is examining a regeneration mechanism observed in animals like salamanders to create flexible robots that are capable of altering their structure and function on the fly to adapt to changes in their environment. Adapting methods from biological memory reconsolidation, a team from University of Wyoming will work on developing a computational system that uses context to identify appropriate modular memories that can be reassembled with new sensory input to rapidly form behaviors to suit novel circumstances.
“With the L2M program, we are not looking for incremental improvements in state-of-the-art AI and neural networks, but rather paradigm-changing approaches to machine learning that will enable systems to continuously improve based on experience,” said Dr. Hava Siegelmann, the program manager leading L2M. “Teams selected to take on this novel research are comprised of a cross-section of some of the world’s top researchers in a variety of scientific disciplines, and their approaches are equally diverse.”
While still in its early stages, the L2M program has already seen results from a team led by Dr. Hod Lipson at Columbia University’s Engineering School. Dr. Lipson and his team recently identified and solved challenges associated with building and training a self-reproducing neural network, publishing their findings in Arvix Sanity. While neural networks are trainable to produce almost any kind of pattern, training a network to reproduce its own structure is paradoxically difficult. As the network learns, it changes, and therefore the goal continuously shifts. The continued efforts of the team will focus on developing a system that can adapt and improve by using knowledge of its own structure. “The research team’s work with self-replicating neural networks is just one of many possible approaches that will lead to breakthroughs in lifelong learning,” said Siegelmann.
“We are on the threshold of a major jump in AI technology,” stated Siegelmann. “The L2M program will require significantly more ingenuity and effort than incremental changes to current systems. L2M seeks to enable AI systems to learn from experience and become smarter, safer, and more reliable than existing AI.”
Suggested Items
Reducing Nitrogen Consumption in Convection Soldering with Rehm Thermal Systems' Patented Mechatronic Curtain
03/28/2024 | Rehm Thermal SystemsCurrent developments indicate a need for larger throughput heights due to the trend towards e-mobility, which in turn increases nitrogen consumption for process inertization. Rehm Thermal Systems responds to this issue with an innovative solution: the mechatronic curtain.
Intel Announces New Program for AI PC Software Developers and Hardware Vendors
03/27/2024 | Intel CorporationIntel Corporation announced the creation of two new artificial intelligence (AI) initiatives as part of the AI PC Acceleration Program: the AI PC Developer Program and the addition of independent hardware vendors to the program.
SEMI ESD Alliance 2024 CEO Executive Outlook to Explore the Evolving RISC-V Movement and Semiconductor Design Ecosystem
03/27/2024 | SEMIKey executives from leading semiconductor EDA and IP companies will gather to discuss the latest industry trends, challenges and opportunities Thursday, May 9, in Santa Clara, California at the annual CEO Executive Outlook, hosted by the Electronic System Design Alliance (ESD Alliance), a SEMI Technology Community, and Keysight Technologies. Registration opens soon.
CentraTEQ to Showcase Wide Range of Vibration & Environmental Test Systems at Battery Tech Expo 24
03/26/2024 | CentraTEQEnvironmental and vibration test specialists CentraTEQ are excited to be exhibiting at the upcoming Battery Tech Expo, scheduled to take place at Silverstone on April 25, 2024.
SEMI 3D & Systems Summit To Spotlight Trends In Hybrid Bonding, Chiplet Design And Environmental Sustainability
03/26/2024 | SEMILeading experts in 3D integration and systems for semiconductor manufacturing applications will gather at the annual SEMI 3D & Systems Summit, 12-14 June, 2024,