The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
For three years, New Orleans deployed an AI system to triage certain 911 calls—mainly duplicate reports near logged car accidents—without informing callers. The AI, provided by Carbyne, aimed to reduce dispatcher workload but raised concerns over transparency, potential misrouting, and lack of oversight in critical emergency response.[AI generated]
Why's our monitor labelling this an incident or hazard?
An AI system is explicitly involved in emergency call triage, a critical function affecting health and safety. The article details known flaws and vulnerabilities in AI voice systems that could lead to errors in emergency response, which could plausibly cause injury or death. No actual harm is reported yet, but the credible risk of harm in this high-stakes context justifies classification as an AI Hazard rather than an AI Incident. The event is not merely complementary information or unrelated, as it concerns the deployment and risks of an AI system with potential for significant harm.[AI generated]