Developing Trustworthy AI to Inform Decisions When Every Moment Counts
June 8, 2023 | DARPAEstimated reading time: 2 minutes
DARPA has selected performers for the In the Moment (ITM) program to create the foundation for trusted algorithmic decision-making in challenging domains, such as medical triage.
ITM has two phases that address decision-making at different degrees of complexity. The first phase will look at triage for small military units in austere environments, and the second phase will scale up the complexity of decision-making by looking at triage for mass casualty events. The program is separated into four technical areas that the following teams will support:
- Raytheon BBN Technologies and Soar Technology, Inc. will develop decision-maker characterization techniques that identify and quantify key human decision-maker attributes in difficult domains.
- Kitware, Inc. and Parallax Inc. will develop algorithmic decision-makers that demonstrate alignment with key attributes of trusted human decision-makers.
- CACI International Inc. will design and execute the program evaluation, focusing on how key human attributes may lead to the trusted delegation of decision-making.
- The University of Maryland Applied Research Laboratory for Intelligence and Security and the Institute for Defense Analyses will be responsible for policy/practice integration and outreach, including ethical, legal, and societal implications (ELSI) experts to advise throughout the research process.
- ITM will produce a framework for developing algorithms that can express key attributes that are aligned with trusted humans. If the foundational ITM technology is successful, the framework will inform future operational systems that rely on trusted decision-making algorithms.
“Key attributes might include how an algorithm evaluates a situation, how it relies on domain knowledge, how it responds to time pressures, and what principles or values it uses to prioritize care,” said Dr. Matt Turek, DARPA’s ITM program manager and deputy director of the Information Innovation Office. “From a technical standpoint, difficult decisions made in medical triage will likely require approaches that do not rely primarily on training data for their implementation, as those approaches can be notoriously brittle.”
Turek previously described difficult decisions as those where trusted decision-makers disagree; no correct answer exists; and uncertainty, time pressure, and conflicting values create significant decision-making challenges.
“The triage domain allows us to get at core issues around trust and delegating decision-making to go beyond the state of the art in AI,” he said. “The focus on triage will encourage research teams to work directly on some of the hardest decision-making challenges possible.”
Turek says he anticipates ITM advances will ultimately support fully automated and semi-automated decision-making where humans can choose to override the algorithm.
Suggested Items
IPC Announces New Training Course: PCB Design for Military & Aerospace Applications
12/23/2024 | IPCIPC announced the launch of a new training course: PCB Design for Military & Aerospace Applications.
Seventh Lockheed Martin-Built GPS III Satellite Launches
12/17/2024 | Lockheed MartinThe seventh Lockheed Martin-designed and -built Global Positioning System (GPS) III space vehicle, GPS III SV07, launched from Cape Canaveral Space Force Station, Florida, into orbit 12,550 miles above earth.
Kickstart 2025 With Advanced PCB Design Skills
12/17/2024 | Corey Lynn, IPCAs the new year approaches, it's the perfect time to set your professional goals and enhance your expertise in the dynamic field of electronics. IPC's January and February 2025 lineup offers a variety of courses designed to meet the needs of professionals at every level of their career, from beginners to seasoned experts. Whether you're looking to delve into the intricacies of radio frequency PCB design, tackle the challenges of military and aerospace applications, or start from the basics with our introductory courses, there's something for everyone. Enroll today and take the next step toward mastering your craft in the electronics industry.
Constellis Earns 2025 Military Friendly Employer Gold Designation
12/04/2024 | PRNewswireConstellis, a leading provider of essential risk management and mission support services to government and commercial clients worldwide, announced today that the company received a Military Friendly® Employer Gold Designation for 2025.
Infleqtion Secures $11 Million DoD APFIT Award to Accelerate Deployment of Quantum Timing for Defense Applications
12/04/2024 | BUSINESS WIREInfleqtion, the world’s leading quantum information company, today announced its receipt of $11 million in funding from the U.S. Department of Defense (DoD) as part of the latest tranche of awards under the Accelerate the Procurement and Fielding of Innovative Technologies (APFIT) program.