Rain Causes AI-Driven Vehicle Safety Systems to Fail in AAA Tests

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AAA research found that advanced driver assistance systems (ADAS), including automatic emergency braking and lane keeping, frequently failed in moderate to heavy rain during closed-course tests. Collisions occurred in one-third of emergency braking tests, and lane departures in 69% of cases, highlighting significant AI system malfunctions under adverse weather conditions.[AI generated]

Why's our monitor labelling this an incident or hazard?

ADAS are AI systems that use sensor data to assist driving decisions. The study demonstrates that in simulated rain, these AI systems fail to reliably detect obstacles and lane markers, resulting in crashes and lane departures. This is a direct malfunction of AI systems causing or contributing to harm (crashes). The article highlights realized harm in test conditions, not just potential harm, thus qualifying as an AI Incident under the framework.[AI generated]
AI principles
Robustness & digital securitySafety

Industries
Mobility and autonomous vehicles

Affected stakeholders
Business

Harm types
Physical (injury)Economic/Property

AI system task:
Recognition/object detectionGoal-driven organisation


Articles about this incident or hazard