Apple Crash Detection AI Triggers Surge of False 911 Calls at Bonnaroo Festival

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Apple's AI-powered Crash Detection feature on iPhone 14 and Apple Watch misinterpreted festival-goers' dancing at Bonnaroo as crashes, causing a fivefold increase in false 911 calls. This malfunction disrupted emergency services, straining first responders and prompting authorities to urge users to disable the feature during the event.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (Crash Detection) is explicitly involved, using sensor data and algorithms to detect crashes. Its malfunction (false positives mistaking dancing for crashes) directly led to a spike in false 911 calls, disrupting emergency services, which qualifies as harm to critical infrastructure. The event is not merely a potential risk but a realized harm, so it is an AI Incident rather than a hazard. The article also discusses mitigation steps taken, but the primary event is the false emergency calls caused by the AI system's malfunction.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityDemocracy & human autonomy

Industries
Consumer productsGovernment, security, and defenceHealthcare, drugs, and biotechnology

Affected stakeholders
WorkersGeneral public

Harm types
Public interestEconomic/PropertyPsychologicalReputational

Severity
AI incident

Business function:
Other

AI system task:
Event/anomaly detection


Articles about this incident or hazard

Thumbnail Image

iPhones Mistake Dancing for Car Crashes at Bonnaroo and Dial 911

2023-06-26
Gizmodo
Why's our monitor labelling this an incident or hazard?
The AI system (Crash Detection) is explicitly involved, using sensor data and algorithms to detect crashes. Its malfunction (false positives mistaking dancing for crashes) directly led to a spike in false 911 calls, disrupting emergency services, which qualifies as harm to critical infrastructure. The event is not merely a potential risk but a realized harm, so it is an AI Incident rather than a hazard. The article also discusses mitigation steps taken, but the primary event is the false emergency calls caused by the AI system's malfunction.
Thumbnail Image

Dancing Bonaroo-goers set off Apple's Crash Detection, cause chaos for 911 team

2023-06-26
Android Authority
Why's our monitor labelling this an incident or hazard?
The Crash Detection feature is an AI system that detects crashes based on sensor data and automatically contacts emergency services. The false activations due to dancing represent a malfunction or misuse of the AI system. The resulting flood of false emergency calls caused disruption to emergency services, which fits the definition of harm under disruption of critical infrastructure management and operation. However, since no injury or other harm occurred, and the emergency services were still able to perform their duties, this is a realized harm but limited to operational disruption. Therefore, this event qualifies as an AI Incident due to the AI system's malfunction directly leading to disruption of critical infrastructure (emergency response).
Thumbnail Image

1,000 accidental 911 calls from music festival bombard call center, police blame iPhones thinking people were in car accidents

2023-06-26
TheBlaze
Why's our monitor labelling this an incident or hazard?
The Crash Detection feature is an AI system that infers from sensor data whether a severe car crash has occurred and autonomously initiates emergency calls. The malfunction or misinterpretation of this AI system's outputs (false positives triggered by festival conditions) directly led to a significant disruption of critical infrastructure (emergency response services). Therefore, this qualifies as an AI Incident due to the direct harm caused by the AI system's malfunction leading to operational disruption of critical infrastructure.
Thumbnail Image

False 911 Calls Spike During Bonnaroo After iPhone 14 Mistakenly Detects Dancing As Car Crash

2023-06-26
HYPEBEAST
Why's our monitor labelling this an incident or hazard?
The iPhone's automatic car crash detection feature uses AI to detect rapid movements indicative of a crash and automatically contacts emergency services. The false activations caused disruption through false emergency calls, but no injury, property damage, or rights violations occurred. Since the event caused no direct or indirect harm but involved malfunction of an AI system that could plausibly lead to harm if unmitigated, it qualifies as an AI Hazard rather than an AI Incident. The authorities' response and warnings to disable the feature during dancing further support this classification as a hazard with potential for harm rather than realized harm.
Thumbnail Image

iPhone 14's Crash Detection blamed for 5x increase in false 911 calls at Bonnaroo festival

2023-06-24
9to5Mac
Why's our monitor labelling this an incident or hazard?
The Crash Detection feature is an AI system that malfunctioned by generating false emergency calls, directly causing disruption to emergency services, which is harm under category (b) - disruption of critical infrastructure management. The article reports realized harm (increased false calls and burden on responders), not just potential harm. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

iPhone's Crash Detection Feature Is Getting Falsely Triggered At A Music Festival, But First Responders' Efforts Were Not Impacted

2023-06-26
Wccftech
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Crash Detection feature) whose malfunction (false triggers) indirectly led to a disruption in emergency alert management, which could be considered a disruption of critical infrastructure operation (emergency response). Although no injury or harm occurred, the false alarms strained emergency services, representing a clear harm scenario. Since the harm was realized (false emergency calls causing operational disruption), this qualifies as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

The iPhone's crash detection feature caused chaos for emergency teams at this music festival

2023-06-26
iMore
Why's our monitor labelling this an incident or hazard?
The Crash Detection feature is an AI system embedded in iPhones and Apple Watches that infers from sensor data whether a crash has occurred and automatically calls emergency services. During the festival, the system malfunctioned by falsely detecting crashes from dancing movements, leading to a surge in false 911 calls. This caused disruption to emergency management operations, which qualifies as harm under the framework. Although no injuries or direct harm to people occurred, the disruption to critical infrastructure (emergency response) is a recognized harm category. Therefore, this event meets the criteria for an AI Incident due to the AI system's malfunction directly leading to disruption of critical infrastructure.
Thumbnail Image

iPhone Crash Detection doesn't like dancing at Bonnaroo - iPhone Discussions on AppleInsider Forums

2023-06-26
AppleInsider Forums
Why's our monitor labelling this an incident or hazard?
The iPhone's Crash Detection feature is an AI system designed to detect car crashes and automatically call emergency services. In this case, the system malfunctioned by falsely detecting emergencies due to dancing movements at the festival, leading to a surge in false 911 calls. This caused disruption to emergency responders, which qualifies as indirect harm under disruption of critical infrastructure management. However, since no injuries or direct harm occurred and the emergency services managed the situation without failure, this event constitutes an AI Incident due to the realized disruption caused by the AI system's malfunction.
Thumbnail Image

iPhones at Bonaroo kept mistaking dancing for car crashes and calling 911

2023-06-26
BGR
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Crash Detection feature) whose malfunction caused a surge in false emergency calls, thereby disrupting the management and operation of critical infrastructure (emergency response services). This fits the definition of an AI Incident because the AI system's malfunction directly led to harm (disruption of critical infrastructure). Although no physical injury occurred, the operational disruption and resource misallocation constitute significant harm under the framework. Therefore, this event is classified as an AI Incident.
Thumbnail Image

How Apple's Crash Detection Turned a Music Festival Into a False 911 Call Party

2023-06-26
autoevolution
Why's our monitor labelling this an incident or hazard?
The Apple Watch's Crash Detection feature is an AI system that analyzes sensor data to detect crashes and automatically call emergency services if the user does not respond. At the Bonnaroo music festival, the system malfunctioned by misinterpreting dance movements as crashes, leading to numerous false emergency calls. This caused disruption to the management and operation of critical emergency infrastructure (911 services). The harm is direct and materialized, as emergency resources were unnecessarily engaged, potentially delaying responses to real emergencies. The event involves the AI system's malfunction leading to harm, fitting the definition of an AI Incident.
Thumbnail Image

Apple's 'Crash Detection Mode' Triggers Spike in False 911 Calls at Bonnaroo Music Fest

2023-06-26
Tech Times
Why's our monitor labelling this an incident or hazard?
The 'Crash Detection Mode' is an AI system that infers from sensor inputs to generate emergency calls. The false activations at the festival directly led to a surge in false emergency calls, straining first responders and disrupting emergency management operations. Although no physical injuries were reported, the disruption to critical infrastructure (emergency response) is a recognized harm under the framework. The event involves the AI system's use phase malfunctioning by generating erroneous outputs. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

New Apple feature spurs false 911 calls at Bonnaroo Music Festival

2023-06-24
WKRN News 2
Why's our monitor labelling this an incident or hazard?
The Apple feature involves AI or algorithmic detection to trigger emergency calls based on rapid movement, qualifying it as an AI system. The false 911 calls are a malfunction or unintended consequence of the AI system's use, indirectly causing disruption to emergency services. However, since no actual harm or failure to respond to real emergencies occurred, and the problem was mitigated, this event is best classified as an AI Hazard, reflecting a credible risk of harm from the AI system's operation rather than an AI Incident.
Thumbnail Image

provoked influx false calls to 911 service due to their dancing because of Apple Crash Detection feature

2023-06-26
Latest Mobiles / Latest Smartphone Launches | New Mobiles | Technology News
Why's our monitor labelling this an incident or hazard?
The Crash Detection feature is an AI system that infers from sensor data whether a crash has occurred and initiates emergency calls. Its malfunction in this context (false positives triggered by crowd movement) directly led to a disruption of critical infrastructure management, namely emergency response services. The false calls represent a harm to the operation of critical infrastructure (emergency services), fulfilling the criteria for an AI Incident. The involvement is a malfunction of the AI system's use, causing realized harm through disruption of emergency services.
Thumbnail Image

iPhone 14 collision detection responsible for 5x increase in false 911 calls at Bonnaroo Festival

2023-06-24
tittlepress.com
Why's our monitor labelling this an incident or hazard?
The collision detection feature is an AI system that infers from sensor data to detect collisions and trigger emergency calls. Its malfunction in this context (false positives triggered by festival activities) has directly led to a significant increase in false 911 calls, disrupting emergency services management. This disruption fits the definition of harm (b) "Disruption of the management and operation of critical infrastructure" since emergency response is critical infrastructure. The article confirms the AI system's role is pivotal and the harm is realized, not just potential. Hence, the event is classified as an AI Incident.
Thumbnail Image

iPhone误报频频 田纳西州警方正努力降低误报率

2023-06-26
中关村在线
Why's our monitor labelling this an incident or hazard?
The iPhone's car crash detection feature is an AI system designed to detect accidents and alert emergency services. The article reports that this AI system's malfunction (false positives) has directly caused a significant increase in false emergency calls, disrupting emergency response operations. This fits the definition of an AI Incident because the AI system's malfunction has directly led to harm in the form of disruption to critical infrastructure management and operation (emergency services).
Thumbnail Image

iPhone碰撞检测导致911误报上升40%-60%!

2023-06-26
ZOL手机频道
Why's our monitor labelling this an incident or hazard?
The iPhone collision detection feature is an AI system that infers from sensor data whether a crash has occurred and automatically contacts emergency services. In this case, the system's use during a large public event led to a substantial increase in false emergency calls, directly disrupting the management and operation of critical infrastructure (emergency response services). Although no physical injury is reported, the disruption to emergency services is a recognized harm under the framework. Therefore, this event qualifies as an AI Incident due to the AI system's malfunction leading to harm (disruption).
Thumbnail Image

iPhone"车祸检测"功能误报率翻五倍,噱头功能为何苹果还不下架?-钛媒体官方网站

2023-06-26
tmtpost.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system ('Crash Detection') integrated into Apple devices that uses AI algorithms and sensor data to detect emergencies. The malfunction of this AI system, specifically its high false positive rate, has directly caused harm by overwhelming emergency response centers with false alarms, thus disrupting critical infrastructure (emergency services) and potentially delaying real emergency responses. This fits the definition of an AI Incident because the AI system's malfunction has directly led to harm (disruption of critical infrastructure and misuse of emergency resources).
Thumbnail Image

iPhone车祸检测又出问题:音乐节"太嗨"导致误报数翻5倍

2023-06-25
驱动之家
Why's our monitor labelling this an incident or hazard?
The iPhone car crash detection feature is an AI system that analyzes sensor data to detect accidents. The event involves malfunction or misinterpretation of data by this AI system, causing a surge in false emergency alerts. While this has disrupted emergency services, there is no indication of actual injury or harm to people or property. The disruption to emergency management is a plausible harm, but since no direct harm has occurred, it fits the definition of an AI Hazard rather than an AI Incident. The event highlights a credible risk of operational disruption due to AI malfunction in a real-world setting.
Thumbnail Image

苹果极力宣传的Apple Watch车祸检测功能频繁闹乌龙!让人头大

2023-06-28
驱动之家
Why's our monitor labelling this an incident or hazard?
The Apple Watch's car crash detection feature is an AI system that uses algorithms to detect accidents and automatically call for help. The article reports multiple false activations of this system during a concert, causing unnecessary emergency calls and resource strain. This is a direct harm linked to the AI system's malfunction. Although the feature has saved lives in other cases, the current event involves realized harm due to false alarms. Hence, it meets the criteria for an AI Incident.
Thumbnail Image

iPhone"车祸检测"误报率翻五倍 苹果噱头功能终于露馅了

2023-06-25
凤凰网(凤凰新媒体)
Why's our monitor labelling this an incident or hazard?
The "Crash Detection" feature is an AI system that uses sensor data and AI algorithms to detect accidents and trigger emergency calls. The article details multiple instances where the system's malfunction (false positives) has caused a fivefold increase in emergency calls, wasting rescue resources and causing operational disruption to emergency services. This constitutes harm under the definition of AI Incident, specifically disruption of critical infrastructure (emergency response) and harm to communities due to resource misallocation. The system's malfunction is directly linked to these harms, fulfilling the criteria for an AI Incident.
Thumbnail Image

iPhone车祸检测又出问题:音乐节"太嗨"导致误报数翻5倍 - Apple iPhone - cnBeta.COM

2023-06-25
cnBeta.COM
Why's our monitor labelling this an incident or hazard?
The iPhone's car crash detection feature is an AI system designed to detect accidents and alert emergency services. In this case, the AI system malfunctioned by misinterpreting vigorous movements as car crashes, leading to a high volume of false emergency calls. This caused disruption to emergency response operations, which qualifies as harm under the disruption of critical infrastructure management and operation. Therefore, this event meets the criteria of an AI Incident due to the AI system's malfunction directly leading to harm (disruption).