The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
US Navy tests of autonomous maritime drones, developed by Saronic and BlackSea Technologies, suffered multiple AI-related malfunctions, including software glitches that caused a collision between drones and the capsizing of a support boat, throwing its captain into the water. These incidents highlight operational and safety risks from AI system failures.[AI generated]
Why's our monitor labelling this an incident or hazard?
The autonomous drone boats are AI systems as they perform autonomous navigation and decision-making. The software glitch and subsequent collision directly caused harm to property (the vessels). The incident is a direct result of the AI system's malfunction during use, fulfilling the criteria for an AI Incident.[AI generated]