MadRadar Hack Causes Self-Driving Cars to Hallucinate Phantom Vehicles

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers demonstrated the MadRadar hack, which manipulates AI-driven radar systems in self-driving cars to create false perceptions—making vehicles appear or disappear. This can cause cars to swerve dangerously or ignore real threats, exposing a critical vulnerability that could lead to accidents or harm if exploited.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI-related system (MadRadar) that manipulates automotive radar systems, which are AI-enabled for driver assistance. The research shows the ability to cause radar hallucinations that could mislead adaptive cruise control and other safety systems. Although no harm has yet occurred, the article explicitly states that such attacks could lead to accidents or other harms in the future. Therefore, this constitutes an AI Hazard because it plausibly could lead to injury or harm to persons due to malfunction or misuse of AI systems in vehicles. It is not an AI Incident because no actual harm has been reported. It is not Complementary Information because the article focuses on the new risk demonstrated, not on responses or updates to prior incidents. It is not Unrelated because the event clearly involves AI systems and potential harm.[AI generated]
AI principles
SafetyRobustness & digital securityAccountability

Industries
Mobility and autonomous vehicles

Affected stakeholders
ConsumersGeneral public

Harm types
Physical (injury)Physical (death)

AI system task:
Recognition/object detection


Articles about this incident or hazard