Categories
News

The agreements on killer robots do not go far enough

International support for new standards against autonomous weapons systems is growing. Following a successful presidency, the Netherlands must now commit itself fully to this cause.

Image: Flying Camera/Shutterstock.

‘Important international agreements reached on killer robots’, read the NOS headline on Saturday 5 September. Unfortunately, we are not quite there yet. Although a step in the right direction has been taken, the real negotiations on internationally legally binding agreements concerning killer robots have yet to begin. And a great deal depends on this.

In Geneva in early September, following a week of negotiations between states chaired by the Netherlands, a text containing ‘elements for an instrument’ on autonomous weapons systems was adopted. Right up until the last minute, it remained uncertain whether the 128 countries party to the Convention on Conventional Weapons (CCW) would reach an agreement.

Urgency

But they did eventually reach agreement, and this could prove to be a very significant step for international law. However, this will only be the case if these elements are further refined and translated into an internationally legally binding agreement. Given the rapid developments in the field of weapons technology, the urgency is unprecedented, and there is certainly political momentum at international level, partly due to the Netherlands’ chairmanship.

In total, countries have been discussing autonomous weapons systems at the UN for more than ten years. Over those same ten years, autonomous systems and the growing use of artificial intelligence (AI) in military applications have taken off enormously. This is not a problem when it comes to tasks such as clearing explosive ordnance or evacuating wounded soldiers. However, AI is playing an increasingly important role in decision-making regarding air strikes and other uses of military force, whereby soldiers are becoming increasingly removed from the action and well-informed choices are becoming ever rarer.

This leads to ethically unacceptable situations, in which the reasoned decision to use force – required under the laws of war – is increasingly pushed into the background. From Ukraine to Gaza and Iran, we are seeing how the use of force is increasingly being entrusted to algorithms.

A broader issue

The talks in Geneva focused explicitly on autonomous weapons systems alone, and not on the broader issue of the use of AI in decisions regarding the use of force. That certainly does not make the talks any less urgent. As recently as three weeks ago, The New York Times reported that three people were killed in an attack involving an autonomous weapon system targeting propane cylinders at a petrol station in the Ukrainian town of Zaporizhzhia. This means, therefore, that the discussions on autonomous weapons address only part of the problem.

Furthermore, it is worrying that, according to reports, the text agreed behind closed doors reveals that, at the last minute, certain elements which had previously enjoyed broad support were watered down by military superpowers such as Russia, the US and China. The elements as currently agreed must therefore certainly not be seen as the end point, but rather as the basis for negotiations leading to final treaty agreements.

International support

This does not alter the fact that the time is now and that international support for new standards against autonomous weapon systems is growing. Following a successful presidency, the Netherlands must now commit itself fully to this cause.

Pope Leo XIV, UN Secretary-General António Guterres, the President of the International Red Cross and an ever-growing group of countries are now convinced that there must be meaningful human control and that weapons must not be allowed to operate fully autonomously. And there is no time to lose. If we do not want machines to make decisions about life and death, we must act now.

In November, the countries will meet again, and it will be a real make-or-break moment as to whether they decide to close that gap by proceeding to negotiate a strong treaty. It is an opportunity we must not let slip.

Also read