aim-logo

AIM: AI Incidents and Hazards Monitor

Automated media discourse monitor of AI incidents and hazards (Beta)

AI-related legislation is gaining traction, and effective policymaking needs evidence, foresight and international cooperation. The OECD AI Incidents and Hazards Monitor (AIM) documents AI incidents and hazards to help policymakers, AI practitioners, and all stakeholders worldwide gain valuable insights into the risks and harms of AI systems. Over time, AIM will help to show risk patterns and establish a collective understanding of AI incidents and hazards and their multifaceted nature, serving as an important tool for trustworthy AI. AI incidents seem to be getting more media attention lately, but they've actually gone down as a share of all AI news (see chart below!).

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Advanced Search Options

As percentage of total AI events
Note: An AI incident or hazard can be reported by one or more news articles covering the same event. Data processing powered by Microsoft Azure using data from Event Registry.
Show summary statistics of AI incidents & hazards
Results: About 7320 incidents & hazards
Thumbnail Image

Tesla's Full Self-Driving System Fails to Stop at Red Lights

2024-08-29
United States

Tesla owners report their vehicles running red lights due to the Full Self-Driving (FSD) system, raising safety concerns. Despite Tesla's claims of near autonomy, the FSD system is still in development. Users shared experiences and videos online, highlighting the system's dangerous shortcomings and loss of trust among drivers.[AI generated]

AI principles:
SafetyRobustness & digital security
Industries:
Mobility and autonomous vehiclesConsumer products
Affected stakeholders:
ConsumersGeneral public
Harm types:
Physical (injury)Physical (death)Economic/Property
Severity:
AI incident
Business function:
Research and development
Autonomy level:
Medium-action autonomy (human-on-the-loop)
AI system task:
Recognition/object detectionForecasting/prediction
Why's our monitor labelling this an incident or hazard?

Owners have documented multiple instances of Teslas passing through red signals due to FSD misbehavior—an AI malfunction directly endangering road users. The issue is ongoing, has already contributed to crashes (including fatalities under investigation), and stems from the system’s development and deployment. This constitutes an AI Incident.[AI generated]

Thumbnail Image

Deepfake Technology Sparks Privacy and Legal Concerns in South Korea

Deepfake technology is causing significant privacy and legal issues in South Korea, with incidents involving the creation and distribution of non-consensual explicit content affecting over 200 schools. The technology's ease of use and potential for misuse have led to widespread societal and legal challenges, prompting government action to increase penalties and establish task forces.[AI generated]

AI principles:
Privacy & data governanceRespect of human rights
Industries:
Education and trainingMedia, social platforms, and marketing
Affected stakeholders:
Children
Harm types:
Human or fundamental rightsPsychologicalReputational
Severity:
AI incident
Autonomy level:
No-action autonomy (human support)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The incident involves the misuse of an AI deepfake system to fabricate explicit content of real individuals without consent, constituting a violation of privacy and personal rights and causing reputational harm. This is a realized harm directly stemming from AI misuse, fitting the definition of an AI Incident.[AI generated]

Thumbnail Image

AI-Generated Nude Image Scandal Involving Peller Anna

2024-08-29
Hungary

Peller Anna and her sister Peller Mariann experienced the dark side of AI when a fan used AI to create embarrassing images of them. Anna received a fake nude image with her face, raising privacy and reputational concerns. This incident highlights the potential misuse of AI in violating personal rights.[AI generated]

AI principles:
Privacy & data governanceRespect of human rights
Industries:
Media, social platforms, and marketing
Affected stakeholders:
Women
Harm types:
ReputationalHuman or fundamental rightsPsychological
Severity:
AI incident
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

An AI-generated sexualized image of a real person was created and sent maliciously, directly causing harm through non-consensual deepfake pornography. This is a concrete instance of AI misuse leading to personal and reputational harm.[AI generated]

Thumbnail Image

Luciana Gimenez Targeted by AI-Generated Fraud Scheme

2024-08-29
Brazil

Luciana Gimenez has been targeted by a cybercrime involving AI-generated fake videos and audio promoting fraudulent luxury product sales on Instagram. She filed a police report on August 25 and engaged her legal team to address the misuse of her image and voice, urging the public not to believe the scam.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingConsumer products
Affected stakeholders:
ConsumersGeneral public
Harm types:
ReputationalEconomic/PropertyPsychological
Severity:
AI incident
Business function:
Marketing and advertisement
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The incident involves the use of AI to create fake videos (deepfakes) of Luciana Gimenez’s image and voice to advertise non-existent products, constituting a realized harm (fraud) facilitated by the AI system. Therefore, it meets the criteria for an AI Incident.[AI generated]

Thumbnail Image

Chinese Children’s AI Watches Spout Offensive and False Content

2024-08-29
China

Chinese AI-powered children’s smartwatches and learning devices generated offensive and false responses—insulting Chinese people’s intelligence, slandering Mao Zedong, denying the Nanjing Massacre, and rabble-rousing cultural falsehoods. Manufacturers 360, Xiaomi and Little Genius blamed third-party data or unofficial firmware, removed the content and promised enhanced AI moderation and software updates.[AI generated]

AI principles:
AccountabilityFairness
Industries:
Consumer productsEducation and training
Affected stakeholders:
ChildrenConsumers
Harm types:
PsychologicalReputationalPublic interest
Severity:
AI incident
Business function:
Monitoring and quality control
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Interaction support/chatbotsContent generation
Why's our monitor labelling this an incident or hazard?

The children's smartwatches use AI systems (including third-party AI software) to generate responses to user queries. The offensive and discriminatory answers given by these AI systems have directly caused harm by spreading harmful stereotypes and potentially damaging social cohesion and individual dignity, which falls under harm to communities and violation of rights. The companies have acknowledged the issue and taken remedial action by removing the problematic responses. Since the harm has occurred and is directly linked to the AI systems' outputs, this event is classified as an AI Incident.[AI generated]

Thumbnail Image

Deepfake Sites Exploit Sign-in with Apple for Non-consensual Images

2024-08-29
United States

Deepfake websites have exploited Apple's Sign-in feature to create non-consensual nude images, raising privacy concerns. Apple and Discord have blocked developers from using their sign-in APIs after reports revealed their misuse. These AI-generated deepfakes pose significant ethical and legal challenges, as they violate human rights and privacy laws.[AI generated]

AI principles:
Privacy & data governanceRespect of human rights
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
General public
Harm types:
Human or fundamental rightsPsychologicalReputational
Severity:
AI incident
Business function:
Other
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generationRecognition/object detection
Why's our monitor labelling this an incident or hazard?

The websites use AI models to remove clothing from real photos without consent, producing harmful deepfakes that are used to bully, humiliate, and threaten victims. This constitutes a direct harm—violation of personal and human rights—stemming from the use of AI systems. The article documents ongoing abuse, signifying an AI Incident rather than a future risk or mere update.[AI generated]

Thumbnail Image

Deepfake Influencer Photos Fuel Pro-Trump Misinformation Campaign on X

2024-08-28
Germany

Unknown actors have hijacked images of European influencers, including Debbie Nederlof, to create AI-altered deepfake profiles that promote Donald Trump on X. A CNN and Centre for Information Resilience investigation found over 16 coordinated accounts using stolen photos and pro-Trump hashtags to mislead followers, highlighting AI-driven political disinformation and identity theft.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
WorkersGeneral public
Harm types:
ReputationalHuman or fundamental rightsPublic interest
Severity:
AI incident
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The event involves AI systems or algorithmic methods to create and operate fake social media accounts that impersonate real people using stolen images, which is a form of AI-generated content misuse. The coordinated campaign spreads misinformation and divisive political content, causing harm to communities and potentially violating rights related to truthful information and fair political processes. The harm is realized as misinformation is actively spread and the accounts have amassed thousands of followers, indicating direct impact. Therefore, this qualifies as an AI Incident due to the direct harm caused by AI-enabled disinformation campaigns and identity theft on a major social media platform.[AI generated]

Thumbnail Image

Generative AI Amplifies Online Risks for Youth, Report Warns

2024-08-28
Germany

Germany's jugendschutz.net reported generative AI has made it harder to distinguish real from fake content, amplifying online harms to youth. In 2023, authorities cataloged 7,645 child protection violations—5,000 sexualized violence cases—plus bullying, extremism, and hate speech, highlighting platform failures and urging stronger safeguards.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
Children
Harm types:
Human or fundamental rightsPsychologicalPublic interest
Severity:
AI incident
Business function:
Monitoring and quality control
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Content generationOrganisation/recommenders
Why's our monitor labelling this an incident or hazard?

The article explicitly states that AI-generated content is making it more difficult to distinguish real from fake content, which increases risks such as sexualized violence, bullying, and extremism affecting children and youth. These are direct harms to vulnerable groups and violations of rights. The AI system's use in generating harmful content is a contributing factor to these harms. Hence, the event meets the criteria for an AI Incident due to realized harm linked to AI use.[AI generated]

Thumbnail Image

U.S. Army Awards $990M Contract for AI-Enabled Switchblade Loitering Munitions

2024-08-28
United States

AeroVironment won a five-year, $990 million IDIQ contract from the U.S. Army to deliver Switchblade loitering munitions, AI-enabled lethal unmanned systems. These man-portable precision strike missiles will equip infantry with autonomous targeting and engagement capabilities, raising concerns over potential harm inherent in weaponized AI systems.[AI generated]

AI principles:
AccountabilitySafety
Industries:
Government, security, and defenceRobots, sensors, and IT hardware
Affected stakeholders:
General public
Harm types:
Physical (death)Physical (injury)Human or fundamental rights
Severity:
AI hazard
Business function:
Procurement
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Recognition/object detectionGoal-driven organisation
Why's our monitor labelling this an incident or hazard?

The Switchblade loitering munitions are AI-enabled lethal unmanned systems intended for military use, which inherently carry the potential for causing injury or harm. The article describes the contract and planned delivery but does not report any actual harm or incidents resulting from their use. Therefore, this event constitutes an AI Hazard due to the plausible future harm from the deployment of AI-powered lethal autonomous weapons systems.[AI generated]

Thumbnail Image

Delhi High Court warns deepfake AI a serious menace

2024-08-28
India

The Delhi High Court, hearing petitions for deepfake regulation, warned that unregulated AI-powered video, audio and image manipulation could become a serious societal threat—enabling misinformation, fraud and rights violations. Justices urged the Centre to develop counter-AI measures including detection, prevention, grievance support and public awareness.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
General public
Harm types:
Public interestEconomic/PropertyReputational
Severity:
AI hazard
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

Deepfake technology is an AI system that can generate realistic but fake audio-visual content. The article centers on the court's acknowledgment of the serious menace deepfakes could pose and the need for government action to regulate and mitigate these risks. No specific incident of harm has occurred yet, but the potential for harm (e.g., misinformation, reputational damage, social disruption) is clearly recognized. This fits the definition of an AI Hazard, where the AI system's use could plausibly lead to harm, but no direct or indirect harm has yet materialized. The article does not describe a realized AI Incident or complementary information about responses to a past incident, so AI Hazard is the appropriate classification.[AI generated]

Thumbnail Image

Sensitive Data Exposed by Unsecured AI Systems

2024-08-28

Legit Security's research reveals that hundreds of open-source LLM servers and vector databases are leaking sensitive corporate and personal data online. Companies integrating AI into workflows often neglect security, leading to exposure of emails, financial records, and API keys. Most affected servers have since been secured.[AI generated]

AI principles:
Privacy & data governanceRobustness & digital security
Industries:
IT infrastructure and hostingDigital security
Affected stakeholders:
BusinessGeneral public
Harm types:
Human or fundamental rightsEconomic/PropertyReputational
Severity:
AI incident
Business function:
ICT management and information security
Autonomy level:
No-action autonomy (human support)
AI system task:
Interaction support/chatbotsContent generation
Why's our monitor labelling this an incident or hazard?

The event describes actual misconfigurations of AI-related infrastructure (vector databases for GenAI) leading to the exposure of private and sensitive information. This constitutes a breach of confidentiality and a violation of privacy rights, meeting the criteria for an AI Incident.[AI generated]

Thumbnail Image

Delhi High Court Warns of Deepfake Threat as Virat Kohli Video Sparks Misinformation

2024-08-28
India

The Delhi High Court cautioned that unregulated deepfake AI poses a serious societal threat, urging government action. Simultaneously, a viral deepfake video falsely showing Virat Kohli harshly criticizing Shubman Gill spread confusion and reputational harm, highlighting the urgent risks of AI-generated misinformation.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
General publicOther
Harm types:
ReputationalPublic interest
Severity:
AI hazard
Autonomy level:
No-action autonomy (human support)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

Deepfake technology is an AI system capable of generating realistic fake content that can mislead and harm communities by spreading misinformation and undermining trust. The article discusses the court's concern about the serious societal threat posed by deepfakes and the call for government action to regulate this technology. Since the article does not report a specific realized harm or incident but rather highlights the credible risk and potential for harm, this qualifies as an AI Hazard. The involvement of AI is explicit (deepfake technology), and the harm is plausible future harm to society, including misinformation and trust erosion. Therefore, the event is best classified as an AI Hazard.[AI generated]

Thumbnail Image

AI Misuse: Minors Create Deepfake Images of Peers

2024-08-28
United States

A survey by Thorn reveals that 10% of minors in the U.S. report peers using AI to create deepfake nude images of other children. This misuse of AI technology has led to several student arrests and highlights significant concerns about online safety and child exploitation.[AI generated]

AI principles:
SafetyPrivacy & data governance
Industries:
Education and trainingMedia, social platforms, and marketing
Affected stakeholders:
Children
Harm types:
PsychologicalReputationalHuman or fundamental rights
Severity:
AI incident
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The event describes actual misuse of AI systems (generative deepfake tools) to produce intimate images of others without consent, which has led to legal action and constitutes a violation of personal and sexual rights. The AI system’s use directly resulted in harmful, criminal behavior, fitting the definition of an AI Incident.[AI generated]

Thumbnail Image

Deepfake Scams Lead to Significant Financial Losses in Malaysia

2024-08-28
Malaysia

Malaysian police are investigating over 450 deepfake scams, involving voice impersonation, resulting in RM2.72 million in losses. Scammers use AI to mimic voices of victims' acquaintances, convincing them to transfer money to mule accounts. Notable cases include a travel agent losing RM49,800 and other victims in Kuala Lumpur and Penang.[AI generated]

AI principles:
Privacy & data governanceRobustness & digital security
Industries:
Financial and insurance servicesConsumer services
Affected stakeholders:
ConsumersBusiness
Harm types:
Economic/PropertyHuman or fundamental rightsPsychological
Severity:
AI incident
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generationInteraction support/chatbots
Why's our monitor labelling this an incident or hazard?

Deepfake voice generation is a clear AI system, and its malicious use directly led to harm (financial loss) for multiple victims. This constitutes an AI Incident, as the misuse of the AI system caused realized harm.[AI generated]

Thumbnail Image

AI Models Exhibit Covert Racism Against African American English

2024-08-28
United States

Studies reveal that AI models, including ChatGPT, exhibit bias against African American English (AAE), leading to discriminatory outcomes in job assignments and legal judgments. Researchers from Stanford, University of Chicago, and Allen Institute found that AI models perpetuate racial stereotypes, raising concerns about AI's role in amplifying discrimination.[AI generated]

AI principles:
FairnessRespect of human rights
Industries:
Government, security, and defenceBusiness processes and support services
Affected stakeholders:
WorkersGeneral public
Harm types:
Human or fundamental rightsEconomic/PropertyPsychological
Severity:
AI incident
Business function:
Human resource management
AI system task:
Content generationInteraction support/chatbots
Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (LLMs) and their use in generating biased, covertly racist outputs. The harm is realized as these biased outputs can negatively affect African American English speakers, especially in sensitive applications like job screening and policing, which implicates violations of human rights and discrimination. This meets the criteria for an AI Incident because the AI's use has directly led to harm through discriminatory outputs. The study's findings confirm the presence of harm rather than just potential harm, so it is not merely a hazard or complementary information.[AI generated]

Thumbnail Image

House Democrats urge FEC to regulate X’s Grok-2 over election deepfakes

2024-08-27
United States

House Democrats and watchdog group Public Citizen petition the Federal Election Commission to restrict X’s new Grok-2 AI image generator under election law after users created misleading deepfake images of political figures like Trump and Harris. They warn such AI-driven misinformation threatens democratic integrity, but FEC leadership cites First Amendment protections.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Media, social platforms, and marketingGovernment, security, and defence
Affected stakeholders:
General public
Harm types:
Public interestReputational
Severity:
AI incident
Business function:
Marketing and advertisement
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The article explicitly describes the use of AI systems (Grok chatbot and Grok-2 image generator) to create and disseminate deepfake images and false election information, which have already circulated on social media platforms. This has led to misinformation that can confuse voters and disrupt democratic processes, a clear harm to communities. The lawmakers' call for regulatory action and the FEC's debate further confirm the significance of the harm. Since the harm is realized and linked directly to the AI system's outputs, this event meets the criteria for an AI Incident rather than a hazard or complementary information.[AI generated]

Thumbnail Image

Surge in AI-Powered Cybercrime Hits New High in H1 2024

2024-08-27
Hong Kong (China)

Trend Micro reports that in the first half of 2024, cybercriminals increasingly leveraged AI for malware, deepfake scams, virtual kidnapping, impersonation fraud and biometric data theft. The company blocked 75.9 billion threats, warning that AI-enabled attacks are rising and demanding adaptive, AI-aware security strategies.[AI generated]

AI principles:
Privacy & data governanceRobustness & digital security
Industries:
Digital securityMedia, social platforms, and marketing
Affected stakeholders:
ConsumersBusiness
Harm types:
Economic/PropertyPsychologicalReputational
Severity:
AI incident
Business function:
ICT management and information security
AI system task:
Content generationInteraction support/chatbots
Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems being used maliciously by cybercriminals to develop malware, conduct social engineering, and perpetrate scams involving deepfakes and biometric data theft. These actions have resulted in actual harms, including financial fraud and identity theft, which fall under harm to persons and communities. The AI systems' development and use by criminals are directly linked to these harms, meeting the criteria for an AI Incident rather than a hazard or complementary information. The report is not merely a warning or potential risk but documents ongoing realized harms involving AI.[AI generated]

Thumbnail Image

Elon Musk's xAI Faces Environmental Backlash Over Unpermitted Gas Turbines

2024-08-27
United States

Elon Musk's AI startup, xAI, is under scrutiny for operating gas turbines without permits at its Memphis data center, potentially worsening local air quality. Environmental groups and the Southern Environmental Law Center have raised concerns with the EPA and local health officials, linking the AI infrastructure to increased pollution.[AI generated]

AI principles:
SustainabilityAccountability
Industries:
IT infrastructure and hostingEnergy, raw materials, and utilities
Affected stakeholders:
General public
Harm types:
EnvironmentalReputationalPublic interest
Severity:
AI incident
Business function:
Research and development
AI system task:
Content generationInteraction support/chatbots
Why's our monitor labelling this an incident or hazard?

The turbines were deployed specifically to power xAI’s AI training infrastructure (100,000 H100 GPUs), and their unauthorized burning of natural gas is worsening smog and harming environmental and public health. This is a clear case where the use of an AI system has indirectly led to environmental harm, fitting the definition of an AI Incident.[AI generated]

Thumbnail Image

Facial-recognition turnstiles debut on Yukarigaoka Line amid privacy fears

2024-08-27
Japan

Yamaman has equipped all six stations of the Yukarigaoka Line in Sakura, Chiba with facial-recognition turnstiles, marking Japan’s first full-scale public rail deployment under the Railway and Tramway Laws. Commuters register their face images and payment cards for touchless boarding. Experts warn of potential privacy and data-leak risks, urging cautious implementation.[AI generated]

AI principles:
Privacy & data governanceRespect of human rights
Industries:
Mobility and autonomous vehiclesDigital security
Affected stakeholders:
Consumers
Harm types:
Human or fundamental rightsReputationalEconomic/Property
Severity:
AI hazard
Business function:
Citizen/customer service
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Recognition/object detection
Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of facial recognition AI systems for boarding in a public transit context, confirming AI system involvement. However, no direct or indirect harm has occurred yet; the concerns are about possible privacy violations or data breaches, which are potential harms. Since no harm has materialized, but there is a credible risk of future harm (e.g., privacy violations, data leaks), this qualifies as an AI Hazard. It is not Complementary Information because the article focuses on the deployment and associated concerns rather than updates or responses to a prior incident. It is not an AI Incident because no harm has been reported.[AI generated]

Thumbnail Image

Microsoft Copilot Vulnerability Exposed Sensitive Data

2024-08-27
United States

Microsoft's Copilot faced vulnerabilities allowing attackers to steal sensitive data through prompt injection and ASCII smuggling. Researchers, including Johann Rehberger, identified these flaws, which could lead to privacy violations. Microsoft has since patched these issues, but details of the fix remain undisclosed, raising concerns about data protection.[AI generated]

AI principles:
Privacy & data governanceRobustness & digital security
Industries:
Digital securityIT infrastructure and hosting
Affected stakeholders:
ConsumersBusiness
Harm types:
Human or fundamental rightsReputationalEconomic/Property
Severity:
AI incident
Business function:
ICT management and information security
Autonomy level:
No-action autonomy (human support)
AI system task:
Interaction support/chatbotsContent generation
Why's our monitor labelling this an incident or hazard?

The report describes a realized data‐exfiltration attack against Microsoft Copilot—an AI system—using novel ASCII smuggling and prompt‐injection techniques to steal user data. Because the AI system’s exploitation directly led to unauthorized data theft, it constitutes an AI Incident.[AI generated]