Beware the Killer Robots
March 10, 2017 | Professor Toby Walsh, UNSW SydneyEstimated reading time: 4 minutes

Autonomous weapons have moved from science fiction to become a clear and present danger. But there is still time to stop them.
In July 2015, thousands of researchers working in artificial intelligence (AI) and robotics united to issue an open letter calling for a pre-emptive ban on such weapons. I was one of the organisers of the letter, and I have spoken several times at the United Nations to reinforce our call for a ban.
The reason I have been motivated to do this is simple. If we don’t get a ban in place, there will be an arms race. And the end point of this race will look much like the dystopian future painted by Hollywood movies like The Terminator.
In fact, the arms race is already underway, although it is largely undeclared. For example, the US Department of Defense has a US$18 billion weapons program in development and most of them are autonomous.
However, there is now considerable international political pressure for such a ban. At least 19 governments, including those of Pakistan, Mexico, Zimbabwe, Cuba and the Vatican, have formally called for a ban, and Human Rights Watch is leading a group of non-government organisations in a “Campaign to Stop Killer Robots.”
In December, nine members of the US House of Congress wrote to Secretary of State John Kerry and Defense Secretary Ash Carter calling for the US to vote for a ban at a UN conference on disarmament in Geneva that month. In their letter they said lethal robots “would not simply be another weapon in the world’s arsenals, but would constitute a new method of warfare.” To give their claim an historical framework, it is important to understand we are contemplating a third revolution in the history of warfare. The first was the invention of gunpowder by the Chinese, the second was the invention of the nuclear bomb, and the third – if we let it happen – will be autonomous weapons. Each is a steep change in the speed and efficiency with which we can kill the other side.
There are many problems. One is we don’t know how to build ethical robots. Another is that we don’t know how to build robots that can’t be hacked. That means such weapons can easily fall into the hands of terrorists and rogue nations. These people will have no qualms about removing any safeguards, or using them against us.
“The US Department of Defense has a US$18 billion weapons program in development and most of them are autonomous.”
And it won’t simply be robots fighting robots. Conflicts today are asymmetric. It will mostly be robots against humans. Unlike what some proponents might claim, many of those humans will be innocent civilians.
But governments still have time to choose a different future. The world has decided collectively not to weaponise other technologies. We have bans on biological and chemical weapons. Most recently, we banned certain types of blinding lasers and anti-personnel mines.
These bans have not prevented related technologies from being developed.
If you go into a hospital today, a ‘blinding’ laser will actually be used to fix your eyes. But arms companies will not sell you one. And you will not find them on any battlefield.
The same should be true for autonomous weapons. Any ban would not stop the development of the broad technology that has many other positive uses, like in autonomous vehicles.
But if we get a UN ban in place, autonomous weapons will have no place on the battlefield.
Last December in Geneva, 123 nations met for the Fifth Review Conference of the UN Convention on Certain Conventional Weapons and agreed to begin formal discussions on a possible ban of lethal, autonomous weapons. Those talks will begin in April or August, and 88 countries have agreed to attend.
Australia has led the way in many arms control negotiations – the nuclear non-proliferation treaty, and those around biological and chemical weapons. But Australian diplomats are some of the most resistant in the discussions about autonomous weapons. And we don’t have long. If these technologies get a foothold in our militaries, a Pandora’s box will be opened and we won’t be able to close it.
Our future is full of robots and intelligent machines. We can choose a good path, where these machines will take the sweat and we will be healthier, wealthier and happier. But if we choose another path that allows computers to make decisions that only humans should make, we risk giving up an important part of our humanity.
In his famous novel 2001, A Space Odyssey, the novelist Arthur C. Clarke delivered one of science fiction’s most prescient quotes. When the astronaut orders the onboard computer ‘HAL’ to disconnect itself, HAL replies: “I’m sorry, Dave. I’m afraid I can’t do that.” The time has come for humans to assert themselves and say to the computers: “Sorry, I can’t let you do that.”
To read the full article visit: unsw.edu.au/news/
About Professor Walsh
Toby Walsh is a leading researcher in Artificial Intelligence. He was recently named in the inaugural Knowledge Nation 100, the one hundred "rock stars" of Australia's digital revolution. He is Guest Professor at TU Berlin, Scientia Professor of Artificial Intelligence at UNSW and leads the Algorithmic Decision Theory group at Data61, Australia's Centre of Excellence for ICT Research. He has been elected a fellow of the Australian Academy of Science, and has won the prestigious Humboldt research award as well as the 2016 NSW Premier's Prize for Excellence in Engineering and ICT. He has previously held research positions in England, Scotland, France, Germany, Italy, Ireland and Sweden. He regularly appears in the media talking about the impact of AI and robotics.
Suggested Items
PCBAA Wins Summit Silver Award from the American Society of Association Executives
07/18/2025 | PCBAAPCBAA was one of 38 associations that earned Silver Awards for outstanding contributions for an entry titled: Chips Don’t Float: More Printed Circuit Boards Must be Made in America.
TT Electronics Secures Multi-Million-Pound Defense Contract with Ultra PCS
07/18/2025 | TT ElectronicsTT Electronics, a leading provider of global manufacturing solutions and engineered technologies, announced that it has been awarded a significant new contract with long-standing customer Ultra PCS Ltd (Ultra Precision Control Systems).
HANZA Accelerates the LYNX Program Through Acquisition of Defense Manufacturer
07/18/2025 | HANZAHANZA AB has signed an agreement to acquire the contract manufacturing division of Milectria, a group of companies focused on the defense sector.
The Government Circuit: Three Inescapable Conclusions About Global Trade Policies
07/17/2025 | Chris Mitchell -- Column: The Government CircuitAmid a series of recent moves by U.S. President Donald Trump to escalate trade policy pressure on key U.S. partners, including Europe, Canada, Mexico, Japan, and Malaysia, the Global Electronics Association’s recent report on global trade flows in the electronics industry is overflowing with relevant insights. The main message is that electronics supply chains are more globally integrated than any other industry, surpassing even the automotive sector in cross-border complexity.
AIRO to Expand U.S. Manufacturing Footprint to Accelerate Advanced Drone Innovation and Strengthen Global Defense Capabilities
07/14/2025 | BUSINESS WIREAIRO, a global leader in advanced aerospace and defense technologies, announced plans to expand its U.S. footprint with the addition of a new manufacturing and engineering development facility.