AAA Study Reveals Safety Risks in Active Driving Assistance AI Systems

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AAA researchers found that vehicles equipped with AI-powered active driving assistance systems experienced frequent malfunctions, including lane-keeping failures, unexpected disengagements, and collisions during testing. These issues, occurring every eight miles on average, pose direct safety risks, prompting AAA to urge manufacturers to improve system reliability before wider deployment.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes advanced driver assistance systems that automate steering and braking, which are AI systems by definition. The study finds these systems are far from fully reliable and frequently disengage, creating dangerous situations if drivers rely too much on them. This indicates that the AI systems' malfunction or limitations have directly led to safety risks, which qualifies as harm to persons or groups. Hence, this is an AI Incident involving the use and malfunction of AI systems causing or contributing to harm.[AI generated]
AI principles
SafetyRobustness & digital securityAccountability

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)

Business function:
Research and development

AI system task:
Recognition/object detectionGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard