ACE Program’s AI Agents Transition from Simulation to Live Flight
February 14, 2023 | DARPAEstimated reading time: 3 minutes
In less than three years, artificial intelligence (AI) algorithms developed under DARPA’s Air Combat Evolution (ACE) program have progressed from controlling simulated F-16s flying aerial dogfights on computer screens to controlling an actual F-16 in flight.
In early December 2022, ACE algorithm developers uploaded their AI software into a specially modified F-16 test aircraft known as the X-62A or VISTA (Variable In-flight Simulator Test Aircraft), at the Air Force Test Pilot School (TPS) at Edwards Air Force Base, California, and flew multiple flights over several days. The flights demonstrated that AI agents can control a full-scale fighter jet and provided invaluable live-flight data.
The ACE AI flights were a part of a successful broader test event including DARPA, TPS, and the Air Force Research Laboratory, enabling multiple Defense Department organizations to work closely together with AI-development contractors toward shared objectives.
“Thanks to the outstanding teamwork and coordination between DARPA, the Air Force Test Pilot School, the Air Force Research Laboratory, and our performer teams, we’ve made rapid progress in Phase 2 across all areas of the ACE program,” said Air Force Lt. Col. Ryan “Hal” Hefron, the DARPA program manager for ACE. “VISTA allowed us to streamline the program by skipping the planned subscale phase and proceeding directly to a full-scale implementation, saving a year or more and providing performance feedback under real flight conditions.”
DARPA performers EpiSci, PhysicsAI, Shield AI, and the Johns Hopkins Applied Physics Laboratory flew different F-16 AI algorithms on the X-62A. The aircraft, a highly modified two-seat F-16, can be programmed to demonstrate the flight-handling characteristics of a variety of different aircraft types. VISTA was upgraded recently with the System for Autonomous Control of Simulation (SACS), making the aircraft a perfect platform to test ACE’s autonomous F-16 AI agents. A safety pilot was on board the VISTA aircraft to take control if anything went awry.
“We conducted multiple sorties [takeoffs and landings] with numerous test points performed on each sortie to test the algorithms under varying starting conditions, against various simulated adversaries, and with simulated weapons capabilities,” Hefron said. “We didn’t run into any major issues but did encounter some differences compared to simulation-based results, which is to be expected when transitioning from virtual to live. This highlights the importance of not only flight testing advanced autonomous capabilities but doing so on testbeds like VISTA, which allowed us to rapidly learn lessons and iterate at a much faster rate than with other air vehicles.”
The Test Pilot School is also supporting the ACE program in measuring how well pilots trust the AI agent to conduct within-visual-range air combat (called a dogfight) while the human pilot focuses on larger battle management tasks in the cockpit. Air Force test pilots have flown numerous live flights in L-29 jet trainers at the University of Iowa Technology Institute’s Operator Performance Laboratory (OPL), an ACE performer. The two-seat L-29 jets at OPL are outfitted with sensors in the cockpit to measure pilot physiological responses, giving researchers clues as to whether the pilot is trusting the AI or not. The TPS recently hosted an ACE Trust Capstone event in late January 2023 using simulators to gauge pilot-agent alignment with follow-on trust-calibration flights in the X-62A planned for later this year.
Begun in 2019, ACE aims to develop trusted, scalable, human-level, AI-driven autonomy for air combat by using human-machine collaborative dogfighting as its challenge problem. In August 2020, the ACE program’s AlphaDogfight Trials pitted AI agents against each other flying simulated F-16s in a virtual dogfighting competition that culminated with the winning AI defeating an experienced F-16 fighter pilot flying in a simulator.
Suggested Items
TRI Opens New Manufacturing Facility
05/16/2024 | TRITest Research, Inc. (TRI), the leading test and inspection systems provider for the electronics manufacturing industry, announced that it has opened a state-of-the-art R&D and manufacturing facility.
Real Time with… IPC APEX EXPO 2024: Circuit Board Testing Strategies and the Impact of AI
05/08/2024 |Editor Marcy LaRont speaks with Bert Horner, president of The Test Connection, about the importance of strategic planning and design-for-test (DFT). Bert touches on some common mistakes that occur when DFT is not adequately considered early on. The discussion outlines an overarching industry need for a culture shift toward increasingly higher levels of integration and collaboration. Bert mentions that AI now has an influence on testing, as everywhere else, and announces his forthcoming book.
Real Time with… IPC APEX EXPO 2024: Understanding Objective Evidence in Manufacturing Processes
05/07/2024 | Real Time with...IPC APEX EXPOGraham Naisbitt explains the importance of objective evidence in manufacturing processes, debunking the common misconception that the ROSE test is a cleanliness test. He also discusses the introduction of Rev J, a requirement for measuring ionic contamination on circuit assemblies, and the challenges in accurately measuring contamination. Alternative methods like ion chromatography and the need for updating standards like the ROSE test are mentioned.
U.S. Air Force Secretary Kendall Flies in AI-Piloted X-62A VISTA
05/06/2024 | Lockheed MartinLockheed Martin Skunk Works joined the U.S. Air Force Test Pilot School and other government and industry partners in hosting U.S. Secretary of the Air Force Frank Kendall to fly in the X-62A Variable In-flight Simulation Test Aircraft (VISTA), a one-of-a-kind aircraft modified to test artificial intelligence (AI) and autonomy capabilities.
Real Time with… IPC APEX EXPO 2024: Software Solutions for Circuit Board Challenges
05/03/2024 | Real Time with...IPC APEX EXPONolan Johnson speaks with Will Webb from Aster Technologies about their software solutions for design teams, manufacturing, test engineers, and process engineers. Aster's software addresses the increasing complexities of circuit boards and the need for alternative testing methods.