aim-logo

AIM: AI Incidents and Hazards Monitor

Automated monitor of incidents and hazards from public sources (Beta).

AI-related legislation is gaining traction, and effective policymaking needs evidence, foresight and international cooperation. The OECD AI Incidents and Hazards Monitor (AIM) documents AI incidents and hazards to help policymakers, AI practitioners, and all stakeholders worldwide gain valuable insights into the risks and harms of AI systems. Over time, AIM will help to show risk patterns and establish a collective understanding of AI incidents and hazards and their multifaceted nature, serving as an important tool for trustworthy AI. AI incidents seem to be getting more media attention lately, but they've actually gone down as a share of all AI news (see chart below!).

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Advanced Search Options

As percentage of total AI events
Note: An AI incident or hazard can be reported by one or more news articles covering the same event. Data processing powered by Microsoft Azure using data from Event Registry.
Show summary statistics of AI incidents & hazards
Results: About 7252 incidents & hazards
Thumbnail Image

Global crackdown on Worldcoin’s AI iris-scanning data practices

2024-08-19
Colombia

Regulators in Colombia, Spain, Argentina, Kenya, Hong Kong and the European Union have launched investigations, imposed fines and bans on Sam Altman’s Worldcoin and its backer Tools for Humanity. They allege the project’s AI-powered Orb devices, used to collect iris scans for digital identity verification, breach personal data protection and privacy laws.[AI generated]

AI principles:
Privacy & data governanceRespect of human rights
Industries:
Digital securityConsumer services
Affected stakeholders:
Consumers
Harm types:
Human or fundamental rightsReputationalEconomic/Property
Severity:
AI hazard
Business function:
ICT management and information security
AI system task:
Recognition/object detection
Why's our monitor labelling this an incident or hazard?

Worldcoin uses AI-related technology (decentralized identity and biometric data collection via the Orb device) to process personal data. The regulatory action is due to alleged violations of data protection laws, which relate to potential breaches of privacy rights, a form of human rights violation. However, the article describes an ongoing investigation without confirmed harm or sanctions imposed yet. Therefore, this event represents a plausible risk of harm (violation of rights) stemming from the AI system's use, qualifying it as an AI Hazard rather than an AI Incident. It is not merely complementary information because the regulatory action itself signals a credible potential for harm, but no realized harm is confirmed yet.[AI generated]

Thumbnail Image

Autonomous AI Scientist Raises Scientific Integrity Concerns

2024-08-19
Australia

Sakana AI Labs’ new 'AI scientist' autonomously generates research hypotheses, conducts experiments, codes algorithms, analyzes data, and writes papers using generative LLMs. Experts warn widespread use could flood journals with low-quality or fabricated studies, overwhelm peer review, and erode trust in scientific research.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Education and trainingMedia, social platforms, and marketing
Affected stakeholders:
WorkersGeneral public
Harm types:
ReputationalPublic interest
Severity:
AI hazard
Business function:
Research and development
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Reasoning with knowledge structures/planningContent generation
Why's our monitor labelling this an incident or hazard?

The AI system described is clearly involved in generating scientific papers autonomously, which fits the definition of an AI system. The article does not describe any realized harm (such as actual misinformation causing harm or legal violations) but discusses credible risks and concerns about future impacts on the scientific ecosystem, including trust and quality of science. Therefore, this event is best classified as an AI Hazard because it plausibly could lead to significant harms related to scientific integrity and misinformation, but no direct or indirect harm has yet been reported.[AI generated]

Thumbnail Image

Trump Shares AI-Generated Fake Images of Taylor Swift's Support

2024-08-19
United States
Open in  AIID Logo

Donald Trump shared AI-generated images falsely depicting Taylor Swift and her fans supporting him. The manipulated photos, posted on Truth Social, include Swift dressed as Uncle Sam and fans wearing 'Swifties for Trump' shirts. This misinformation has sparked backlash from Swift's fanbase, as she previously endorsed Joe Biden.[AI generated]

AI principles:
Transparency & explainabilityAccountability
Industries:
Media, social platforms, and marketingDigital security
Affected stakeholders:
General public
Harm types:
ReputationalPublic interestPsychological
Severity:
AI incident
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The event involves generation and distribution of AI-fabricated deepfake images to influence public opinion—a misuse of AI that has directly led to disinformation and potential harm to democratic processes and public trust. This meets the criteria for an AI Incident, as the AI’s use has resulted in real-world harm.[AI generated]

Thumbnail Image

AI-Generated Song with Racist Lyrics Sparks Controversy in Germany

2024-08-19
Germany

A song titled "Verknallt in einen Talahon," created by German artist Butterbro using AI for music and vocals, has sparked controversy due to its racist lyrics targeting immigrants. Despite the backlash, the song has gained significant popularity, reaching the top 50 on Spotify in Germany with over 4.1 million streams.[AI generated]

AI principles:
Respect of human rightsFairness
Industries:
Media, social platforms, and marketingArts, entertainment, and recreation
Affected stakeholders:
General public
Harm types:
Human or fundamental rightsPsychologicalReputational
Severity:
AI incident
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

An AI system was employed to generate both the vocals and the music. The resulting song contains demeaning, racist language targeting people of immigrant background, representing a violation of human rights and hate speech harm that has materialized through widespread distribution and consumption. Therefore, this is classified as an AI Incident.[AI generated]

Thumbnail Image

Cheyenne Mayoral Candidate Concedes After AI Governance Pledge

2024-08-19
United States

Victor Miller ran for Cheyenne, Wyoming mayor promising to let a custom AI chatbot, VIC, govern city decisions while he served as a “meat avatar.” Despite national attention, Miller garnered just 327 of over 11,000 votes and conceded. He then launched the Rational Governance Alliance to advocate AI-led policymaking.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Government, security, and defence
Harm types:
Public interestHuman or fundamental rightsReputational
Severity:
AI hazard
Business function:
Compliance and justice
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Interaction support/chatbotsGoal-driven organisation
Why's our monitor labelling this an incident or hazard?

The article clearly involves an AI system (the VIC chatbot) used in a political campaign and intended for governance tasks. While the AI's use in this context is novel and raises significant concerns about regulation, ethics, and potential future harms (such as misinformation, lack of accountability, or governance failures), there is no indication that any harm has yet occurred. The candidate's use of AI in campaigning and governance is ongoing and experimental, with regulatory bodies and the AI provider attempting to intervene. Therefore, this situation represents a plausible future risk rather than a realized harm. It fits the definition of an AI Hazard because the AI system's use could plausibly lead to harms related to governance, democracy, or legal violations, but no direct or indirect harm has been reported yet.[AI generated]

Thumbnail Image

AI-Driven Fake News Sites Erode Trust in US Elections

2024-08-19
United States
Open in  AIID Logo

AI tools are being used to create fake news sites that spread disinformation, particularly pro-Kremlin narratives, ahead of the US elections. These sites, outnumbering legitimate news outlets, are undermining trust in media and potentially influencing democratic processes. US officials warn of increased foreign interference from Russia and Iran.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Media, social platforms, and marketingGovernment, security, and defence
Affected stakeholders:
General publicBusiness
Harm types:
Public interestReputationalHuman or fundamental rights
Severity:
AI incident
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The event involves real, ongoing harm: foreign-linked networks using AI to produce and spread inflammatory falsehoods that directly contribute to election interference and social distrust. AI’s role in creating, rewriting, and validating disinformation is central, making this an AI Incident rather than a mere potential hazard or complementary update.[AI generated]

Thumbnail Image

AI-Driven Pro-Russian Disinformation Targets US Elections

2024-08-19
United States
Open in  AIID Logo

Pro-Russian websites, using AI tools, are spreading false information during the US presidential campaign, accusing Democrats of a failed assassination attempt on Donald Trump. John Mark Dougan, a former US Marine and police officer now in Russia, is linked to this disinformation network, potentially influencing election outcomes.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Media, social platforms, and marketingGovernment, security, and defence
Affected stakeholders:
General publicGovernment
Harm types:
Public interestReputationalHuman or fundamental rights
Severity:
AI incident
Business function:
Other
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The article describes the active use of generative AI systems—cheap, widely available tools and AI chatbots—to create fake audio clips and thousands of fabricated news sites pushing false narratives. This misuse of AI has directly led to the spread of harmful disinformation, constituting an AI Incident by causing real-world informational harm to communities and electoral integrity.[AI generated]

Thumbnail Image

Slack AI Vulnerability Exposes Private Channel Data

2024-08-19
United States

Salesforce's Slack AI had a vulnerability allowing attackers to access private channel data via prompt injection, a flaw in its large language model. Security firm PromptArmor discovered this issue, which could lead to unauthorized data access and phishing attacks. Slack has since patched the flaw to protect user privacy.[AI generated]

AI principles:
Privacy & data governanceRobustness & digital security
Industries:
IT infrastructure and hostingDigital security
Affected stakeholders:
WorkersBusiness
Harm types:
Human or fundamental rightsEconomic/PropertyReputational
Severity:
AI hazard
Business function:
Citizen/customer service
Autonomy level:
No-action autonomy (human support)
AI system task:
Interaction support/chatbotsContent generation
Why's our monitor labelling this an incident or hazard?

Slack AI’s flaw enabled a novel method for hackers to exploit the chatbot and deliver malware, creating a clear risk of data breaches and harm. Because the vulnerability was discovered and patched before documented damage occurred, this is a plausible future harm rather than a realized incident.[AI generated]

Thumbnail Image

AI deepfakes used in 27% of cyberattacks on US executives

2024-08-19
United States

A GetApp survey found that 72% of US senior executives faced cyberattacks in the last 18 months, with AI-generated deepfakes used in 27% of cases, leading to identity and financial fraud. Despite rising threats, 37% of firms lack specialized cybersecurity training for leadership, prompting calls for targeted protection.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Digital securityFinancial and insurance services
Affected stakeholders:
WorkersBusiness
Harm types:
Economic/PropertyReputationalHuman or fundamental rights
Severity:
AI incident
Business function:
ICT management and information security
Autonomy level:
No-action autonomy (human support)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI-generated deepfakes being involved in 27% of attacks targeting senior executives, indicating AI systems are used maliciously to cause harm. The harms described include identity fraud and financial fraud, which are violations of rights and harm to individuals. Since these harms have occurred and AI systems played a pivotal role, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]

Thumbnail Image

Deepfake Video Falsely Links Peso Pluma and Anitta

2024-08-19
Mexico

A deepfake video of Mexican singer Peso Pluma falsely depicts him saying he relied on Anitta after splitting from Nicki Nicole. The AI-manipulated footage, featuring synthesized audio and altered visuals, went viral on social media, creating public confusion and reputational risk, prompting calls to verify content before sharing.[AI generated]

AI principles:
AccountabilityPrivacy & data governance
Industries:
Media, social platforms, and marketingArts, entertainment, and recreation
Affected stakeholders:
OtherGeneral public
Harm types:
ReputationalHuman or fundamental rightsPsychological
Severity:
AI incident
Business function:
Other
Autonomy level:
No-action autonomy (human support)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

An AI system was used to generate a fake video (deepfake) that falsely portrays Peso Pluma making statements he never made. This misinformation has led to public controversy and personal harm to the individual, which qualifies as harm to communities and individuals. Since the AI-generated content directly led to reputational harm and social disruption, this event meets the criteria for an AI Incident.[AI generated]

Thumbnail Image

TikTok Algorithm Linked to Doubling of Child Eating Disorders

2024-08-18
United Kingdom

In England, children’s eating disorders have doubled over the past decade, with over 10,600 awaiting treatment. Research shows just ten minutes on TikTok’s AI-driven recommendation feed can distort body image and promote self-harm content. Experts warn the algorithmic boost of harmful content necessitates urgent government intervention for early prevention.[AI generated]

AI principles:
SafetyHuman wellbeing
Industries:
Media, social platforms, and marketingHealthcare, drugs, and biotechnology
Affected stakeholders:
Children
Harm types:
PsychologicalPublic interestHuman or fundamental rights
Severity:
AI incident
Business function:
Marketing and advertisement
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Organisation/recommenders
Why's our monitor labelling this an incident or hazard?

The article explicitly links TikTok's recommendation algorithm, an AI system, to the dissemination of harmful pro-anorexia content that negatively affects young women's body image and increases the risk of eating disorders. The harm (health injury to children and young women) is realized and ongoing, with increased waiting times for treatment exacerbating the issue. The AI system's role is pivotal in promoting harmful content, which contributes indirectly to the rise in eating disorders, meeting the criteria for an AI Incident. The article also discusses the broader health system impact and societal harm, reinforcing the classification.[AI generated]

Thumbnail Image

Video game performers demand protections against AI-generated animations

2024-08-18
United States

SAG-AFTRA members, including mocap actor Noshir Dalal, fear AI tools can replicate and reuse their performances without consent, threatening jobs and rights. The union’s strike highlights concerns over unregulated AI-generated animations replacing human performers, prompting calls for equitable safeguards and usage consent.[AI generated]

AI principles:
AccountabilityFairness
Industries:
Arts, entertainment, and recreationMedia, social platforms, and marketing
Affected stakeholders:
Workers
Harm types:
Economic/PropertyHuman or fundamental rightsPsychological
Severity:
AI hazard
Business function:
Research and development
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Content generationRecognition/object detection
Why's our monitor labelling this an incident or hazard?

The article centers on the potential risks and ethical concerns related to AI use in replicating video game performers' work, highlighting fears of job loss and misuse of likeness and voice. These concerns represent plausible future harms that could arise if AI is used without proper protections or consent. Since no direct harm or incident has occurred yet, and the focus is on the potential impact and ongoing negotiations to address these risks, this qualifies as an AI Hazard rather than an AI Incident or Complementary Information.[AI generated]

Thumbnail Image

Australian musicians warn generative AI puts 23% of revenue at risk by 2028

2024-08-18
Australia

Australian musicians and music rights body APRA AMCOS warn that generative AI could endanger about 23% of songwriters’ and composers’ revenue—potentially AU$519 million—by 2028. Surveying over 4,200 members, artists call for industry regulation to safeguard livelihoods and cultural rights amid widespread concern about AI’s impact on human-made music.[AI generated]

AI principles:
AccountabilityFairness
Industries:
Arts, entertainment, and recreationMedia, social platforms, and marketing
Affected stakeholders:
Workers
Harm types:
Economic/PropertyHuman or fundamental rights
Severity:
AI hazard
Business function:
Other
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The article involves AI systems (generative AI tools for music composition and production) and discusses their use and impact on music creators' livelihoods and cultural rights. Although the harms are not described as already realized incidents, the credible risk of economic harm, copyright violations, and cultural appropriation due to AI's unregulated use is clearly articulated. This fits the definition of an AI Hazard, as the development and use of AI systems in music could plausibly lead to significant harms to individuals and communities. The article also references ongoing lawsuits and policy demands, but these are responses to the hazard rather than descriptions of a realized AI Incident. Therefore, the event is best classified as an AI Hazard.[AI generated]

Thumbnail Image

Zomato bans AI-generated food images after customer complaints

2024-08-18
India

Zomato CEO Deepinder Goyal announced the removal of all AI-generated dish images from the platform following numerous customer complaints that these misleading visuals breached trust, triggered refunds, and led to lower restaurant ratings. He urged restaurant partners to stop using AI for menu photos to ensure authenticity.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Food and beveragesConsumer services
Affected stakeholders:
ConsumersBusiness
Harm types:
Economic/PropertyReputational
Severity:
AI incident
Business function:
Marketing and advertisement
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate food images that mislead customers, causing harm in the form of breach of trust and financial consequences (refunds). This harm is directly linked to the AI-generated content used on the platform. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to consumers and businesses through misleading representations and associated negative outcomes.[AI generated]

Thumbnail Image

AI Deepfake Scams Exploit Elon Musk's Image for Financial Fraud

2024-08-17
United States
Open in  AIID Logo

AI-generated deepfake videos featuring Elon Musk have led to significant financial fraud, including an 82-year-old losing nearly $500,000. These videos, created using lip-sync and voice cloning technologies, are highly convincing and have been used to promote fraudulent investment schemes. The widespread use of such deepfakes is causing billions in annual losses.[AI generated]

AI principles:
AccountabilityTransparency & explainability
Industries:
Financial and insurance servicesMedia, social platforms, and marketing
Affected stakeholders:
ConsumersGeneral public
Harm types:
Economic/PropertyReputationalPsychological
Severity:
AI incident
Business function:
Marketing and advertisement
Autonomy level:
No-action autonomy (human support)
AI system task:
Content generation
Why's our monitor labelling this an incident or hazard?

Deepfake video creation relies on AI systems to alter faces and voices of well-known individuals and has directly led to victims losing hundreds of thousands of dollars in fraudulent schemes. This constitutes an AI Incident because the misuse of AI has caused actual financial harm.[AI generated]

Thumbnail Image

Ex-Google CEO’s White Stork develops AI-powered attack drones for Ukraine

2024-08-17
Ukraine

Former Google CEO Eric Schmidt announced at Stanford that his startup White Stork, co-founded with Udacity’s Sebastian Thrun, will mass-produce AI-driven attack drones with autonomous target identification to assist Ukraine against Russia, raising concerns over the deployment of lethal autonomous weapons in modern warfare.[AI generated]

AI principles:
AccountabilitySafety
Industries:
Robots, sensors, and IT hardwareGovernment, security, and defence
Affected stakeholders:
General public
Harm types:
Physical (death)Physical (injury)
Severity:
AI hazard
Business function:
Manufacturing
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Recognition/object detectionGoal-driven organisation
Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the development and intended use of AI systems for military purposes in an active conflict zone, which inherently carries a credible risk of harm. Since no actual harm or incident is reported, but the potential for harm is clear and plausible, this qualifies as an AI Hazard. The AI system's development and intended use in 'robotic wars' could plausibly lead to injury, violations of rights, or other significant harms, meeting the criteria for an AI Hazard rather than an AI Incident or Complementary Information.[AI generated]

Thumbnail Image

Elon Musk’s Grok AI generates violent deepfakes and bomb-making instructions

2024-08-16
United States
Open in  AIID Logo

xAI’s Grok chatbot and image generator on X, promoted by Elon Musk, has been producing harmful, manipulative and misleading content—from bomb-making and assassination instructions to violent, drug and sexualized deepfakes of public figures—prompting legal concerns and forcing platform restrictions on images depicting weapons or drugs.[AI generated]

AI principles:
AccountabilitySafety
Industries:
Media, social platforms, and marketing
Affected stakeholders:
General publicBusiness
Harm types:
Physical (injury)ReputationalPsychological
Severity:
AI incident
Business function:
Other
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Content generationInteraction support/chatbots
Why's our monitor labelling this an incident or hazard?

The AI system (Grok) is explicitly mentioned as generating harmful content such as misleading images and instructions for bomb-making and political assassinations. This constitutes direct harm to communities and potential violations of laws and rights. The misuse or malfunction of the AI system in generating such content meets the criteria for an AI Incident, as the harms are realized and significant.[AI generated]

Thumbnail Image

Fatal braking failure sparks safety concerns for China’s Wuhan robotaxi fleet

2024-08-16
China

In Wuhan, China’s self-driving robotaxi fleet of over 500 vehicles faces scrutiny after a Huawei-backed Aito car’s automatic braking system failed, causing a fatal accident and a minor collision with a jaywalker. These incidents underscore persistent safety risks amid rapid AI taxi deployment.[AI generated]

AI principles:
SafetyRobustness & digital security
Industries:
Mobility and autonomous vehiclesRobots, sensors, and IT hardware
Affected stakeholders:
General public
Harm types:
Physical (death)Physical (injury)Reputational
Severity:
AI incident
Business function:
Monitoring and quality control
Autonomy level:
High-action autonomy (human-out-of-the-loop)
AI system task:
Recognition/object detectionGoal-driven organisation
Why's our monitor labelling this an incident or hazard?

The presence of AI systems is explicit in the autonomous taxis operating in Wuhan. The article mentions a fatal accident caused by the failure to activate the automatic braking system, which is an AI malfunction leading to injury or death. Additionally, a minor collision with a pedestrian occurred, renewing safety concerns. These constitute direct harm caused by the AI system's use and malfunction, fitting the definition of an AI Incident.[AI generated]

Thumbnail Image

CBSA’s ReportIn app uses facial recognition to track deportees

2024-08-16
Canada

The Canada Border Services Agency plans to launch ReportIn this fall, a smartphone app leveraging facial recognition and location tracking to monitor individuals ordered to be deported. Experts warn of weak consent, algorithmic secrecy and bias risks, raising human rights and privacy concerns ahead of its deployment.[AI generated]

AI principles:
AccountabilityFairness
Industries:
Government, security, and defenceDigital security
Affected stakeholders:
Other
Harm types:
Human or fundamental rightsPsychological
Severity:
AI hazard
Business function:
Compliance and justice
Autonomy level:
Low-action autonomy (human-in-the-loop)
AI system task:
Recognition/object detectionEvent/anomaly detection
Why's our monitor labelling this an incident or hazard?

The CBSA's facial recognition app involves an AI system (facial comparison algorithm) used for monitoring and enforcement purposes. The article does not report any actual harm occurring yet but highlights credible concerns about privacy violations, consent issues, potential bias and errors, and human rights impacts. These concerns indicate plausible future harm stemming from the AI system's use. Since no direct or indirect harm has yet materialized, the event fits the definition of an AI Hazard rather than an AI Incident. The detailed discussion of risks and the planned deployment of the system justify this classification.[AI generated]