A new generation of weapons systems that can operate autonomously is being developed and deployed. This raises various legal, ethical and security concerns. To ensure humans remain in control over the use of violence in warfare an international treaty is urgently needed. It is crucial for states to take action on this matter, not only to safeguard legal and ethical norms, but also in the interest of international peace and security. Killer robots (fully autonomous weapons) are fundamentally unacceptable and should be prohibited. Other autonomous weapons should be regulated to ensure they are used in line with legal and ethical norms.
What are autonomous weapons?
Autonomous weapons are weapons systems that detect and attack a target based on sensor inputs, rather than direct human inputs. After the human user activates the weapons system, there is a period of time where the weapon system can attack a target without direct human approval. This development will have an enormous effect on the way war is conducted and has been called the third revolution in warfare, after gunpowder and the atomic bomb.
An example of autonomous weapons that received a lot of international media attention was the use of the Kargu in Libya. The Kargu is a small quadcopter drone that carries an explosive. According to a UN report these weapons systems “were programmed to attack targets without requiring data connectivity between the operator and the munition”. But also in the war in Ukraine weapons are being used with increasing levels of autonomy. It is deeply concerning that these weapons are being developed and used without a clear regulatory framework.
What are the concerns?
Autonomous weapons without meaningful human control raise several ethical, legal, and security concerns:
- Ethical: It is unacceptable to delegate life and death decisions to a machine.
- Legal: Experts agree that the use of autonomous weapons, without meaningful human control, does not meet the requirements of the law of war. In addition, it is unclear who is responsible when violations of the law of war are committed.
- Security: If autonomous weapons are deployed without regulation, it will lead to more conflict and instability in the world. It will lower the threshold for warfare and lead to a new arms race. Wide proliferation will make these weapons more readily available to a wide range of actors. There are risks of unintended initiations and escalations of conflict by autonomous weapons (“accidental war”).
Who are concerned?
UN Secretary-General António Guterres has repeatedly stated that lethal autonomous weapons are politically unacceptable and morally reprehensible and that they should be prohibited internationally. The International Committee of the Red Cross calls on states to adopt new legally binding rules on autonomous weapons systems. Thousands of artificial intelligence scientists from around the world have warned about this development and called for a treaty. In 2018 and 2021, the European Parliament passed resolutions calling for an international treaty. Others calling for a treaty include the German Federation of Industries (BDI). Over 90 states are calling for an international treaty.
PAX believes there is an urgent need for a treaty that ensures meaningful human control over the use of force, that defends humanity and rejects the automation of killing. It should include:
- A prohibition on autonomous weapons systems that:
- cannot be used with meaningful human control;
- have a human as the target profile.
- The regulation of other autonomous weapons to ensure they are used with meaningful human control
Debate within the UN
Since 2014, autonomous weapon systems have been discussed within the UN Convention on Certain Conventional Weapons (CCW). It is now clear that a majority of states want to guarantee human control over the use of force and see the need for new regulation to safeguard this. States also agree that certain autonomous weapons should be prohibited, while the use of others must be regulated. Unfortunately, this shared ambition has not translated into significant political steps, as the CCW decides by consensus and a small minority of states has obstructed progress. Therefore, there is increasing attention in other international fora to address this topic like the Human Rights Council and the UN General Assembly.
What does PAX do?
PAX first wrote on the topic of autonomous weapons in 2011. In 2013, PAX joined forces with a group of international NGOs to set up the Campaign to Stop Killer Robots. This coalition now consists of over 200 NGO’s in over 60 countries. PAX has also been involved in talks with the UN in Geneva about this subject since 2014. We do research, advocacy and campaigning to work towards an international treaty that guarantees meaningful human control over the use of violence.
Daan Kayser, project leader autonomous weapons, email@example.com
- The State of AI - Artificial Intelligence, the Military and Increasingly Autonomous Weapons
- Dont be Evil - A survey of the tech sector’s stance on lethal autonomous weapons
- Slippery Slope - The arms industry and increasingly autonomous weapons (2019)
- Increasing autonomy in weapons systems
- Killer Robots - What are they and what are the concerns?