AIM: AI Incidents and Hazards Monitor

ADAS features rely on AI systems for real-time processing and decision-making to enhance vehicle safety. The software issue causing loss of these features directly impacts the safety of drivers and passengers, representing a harm to health and safety. Since the malfunction has already occurred and prompted a recall, this constitutes an AI Incident due to the realized harm risk from the AI system's malfunction.[AI generated]

The Grok platform is an AI system capable of generating deepfake images, which are being used to create harmful sexualized content without consent, including illegal child sexual abuse material. This has caused psychological harm and harassment to residents, constituting realized harm. Therefore, this event qualifies as an AI Incident due to direct harm caused by the AI system's outputs.[AI generated]

The event explicitly involves AI systems generating fake characters used in a disinformation campaign that is actively influencing and manipulating the population, causing harm to communities. The use of AI-generated personas to deceive and micro-target users directly leads to harm through misinformation and potential fraud. Therefore, this meets the criteria for an AI Incident as the AI system's use has directly led to harm to communities and potential violations of rights through deception and fraud.[AI generated]

The event involves an AI system used to generate a deepfake video that directly leads to harm by deceiving consumers and causing financial fraud, which constitutes harm to communities and individuals. The AI system's use in creating the fake video is central to the incident. Therefore, this qualifies as an AI Incident due to realized harm caused by the AI-generated content.[AI generated]

The event involves the development and deployment of an AI system (Kodiak Driver) integrated into a counter-UAS platform that autonomously detects and neutralizes drone threats. While the system is designed for defense and safety, the article does not report any realized harm or incidents caused by the AI system. However, given the nature of the system—an autonomous weaponized platform capable of neutralizing drones—there is a plausible risk of harm if misused or malfunctioning, such as unintended damage or escalation in conflict scenarios. Therefore, this event represents an AI Hazard due to the credible potential for harm stemming from the autonomous AI-enabled counter-UAS system, even though no harm has yet occurred or been reported.[AI generated]

The event involves AI systems explicitly (ChatGPT, RoentGen, and other LLMs) generating synthetic medical images that are indistinguishable from real ones by experts and AI detectors. This misuse or potential malicious use of AI-generated deepfakes can directly lead to harms such as fraudulent litigation, clinical misdiagnosis, and cybersecurity attacks causing clinical chaos, all of which are harms to health and communities. The study documents these risks with evidence of actual AI-generated images deceiving professionals, thus meeting the criteria for an AI Incident rather than a mere hazard or complementary information.[AI generated]

The event involves an AI system (Anthropic's Claude) used to generate content based on copyrighted song lyrics without permission, which the publishers claim infringes their copyrights. This is a direct violation of intellectual property rights, a category of harm defined under AI Incidents. The lawsuit and allegations indicate that the AI's use has already caused harm by reproducing copyrighted material and competing with the original market. Although the legal outcome is pending, the described harm is materialized and not merely potential, making this an AI Incident rather than a hazard or complementary information.[AI generated]

The event involves the use and misuse of AI systems (generative AI models) to produce illegal and harmful content (CSAM), which constitutes a violation of human rights and causes significant harm to children and communities. The AI systems' outputs have directly led to the dissemination of harmful material, fulfilling the criteria for an AI Incident. The article also references ongoing harm and the need for regulatory responses, confirming that the harm is realized and ongoing rather than merely potential.[AI generated]

The article explicitly mentions that the offenses involve sexual abuse material of minors created or distributed through AI, indicating the use of an AI system in committing the crime. The court conviction confirms that harm has occurred, specifically violations of rights and serious social harm. This meets the criteria for an AI Incident, as the AI system's use directly led to harm. The legal response and sentencing further confirm the materialization of harm rather than a potential risk or complementary information.[AI generated]

The article explicitly mentions the use of AI to generate fake expert recommendations in food advertising, which is a form of AI system use leading to consumer deception and potential health harm. This constitutes a violation of consumer rights and could harm public health, fitting the definition of an AI Incident. The task force's formation is a response to realized harms caused by AI-enabled false advertising, not just a potential risk, so this is an AI Incident rather than a hazard or complementary information.[AI generated]

An AI system is explicitly involved, analyzing real-time sensor data to detect fire hazards before they escalate. The system's use is intended to prevent harm to people and property by early detection and alerting relevant parties. Since the AI system's deployment directly addresses and mitigates risks of injury and property damage, this qualifies as an AI Incident under the definition of an event where AI use has directly led to harm prevention and safety enhancement.[AI generated]

The event involves AI systems in the form of autonomous AI agents conducting transactions (agentic commerce), and the framework is designed to mitigate risks associated with these AI systems. However, the article does not report any realized harm, injury, rights violations, or disruptions caused by AI systems. Instead, it presents a cooperative initiative to address potential risks and improve trust infrastructure in anticipation of future challenges. Therefore, this is a case of an AI Hazard, as the framework aims to prevent plausible future harms related to AI-driven commerce, but no actual AI Incident has occurred yet.[AI generated]

The event explicitly involves AI systems used to create fabricated information that was knowingly passed to a foreign agent, leading to serious security offenses and harm to an innocent individual. The AI-generated content was pivotal in deceiving the agent and fabricating false narratives, which caused real harm (e.g., wrongful arrest). The use of AI in this malicious context and the resulting consequences meet the criteria for an AI Incident, as the AI system's use directly led to violations of rights and harm to individuals and communities.[AI generated]

An AI system is explicitly involved, performing real-time license plate recognition and alerting enforcement officers. The AI system's use directly leads to the identification and seizure of vehicles with unpaid taxes, which is a lawful enforcement action preventing financial harm to the government and ensuring compliance with legal obligations. Although the harm here is not physical injury or property damage, the event involves harm to property rights and enforcement of financial obligations, which falls under harm categories related to legal rights and property. Therefore, this qualifies as an AI Incident due to the AI system's direct role in causing a legally significant outcome involving harm (financial enforcement and property seizure).[AI generated]

The event involves AI systems in the form of AI-generated websites used to offer unauthorized crypto-asset investment services. This use of AI-generated content directly contributes to potential financial harm to consumers (harm to persons/groups). Since the unauthorized offering of financial services without permission is a violation of legal frameworks and exposes users to significant risk of fraud and financial loss, this constitutes an AI Incident. The harm is realized or ongoing as the NBS warns about existing websites and advises consumers about risks and precautions. Therefore, this is an AI Incident due to the direct or indirect role of AI-generated content in facilitating unauthorized and risky financial services leading to harm.[AI generated]

The event involves an AI system insofar as Meta's social media platforms use AI-driven algorithms for content recommendation and user engagement, which are central to the allegations of harm to teens' mental health and safety. The harm described (mental health damage and risk of sexual exploitation) falls under harm to groups of people. Since the harm is alleged to have occurred and is the subject of a legal case, this qualifies as an AI Incident. The event focuses on the use and impact of AI-enabled social media systems leading to harm, not just potential or future harm, nor is it merely complementary information or unrelated news.[AI generated]

The AI system is explicitly mentioned as being developed and tested for autonomous satellite operation. However, the article focuses on the planned deployment and testing phase without any reported harm or malfunction. Since no direct or indirect harm has occurred, and the AI system's use is prospective, this qualifies as an AI Hazard due to the plausible future risk associated with autonomous AI operation in space systems, but not an AI Incident or Complementary Information.[AI generated]

The article explicitly involves AI systems (generative AI chatbots) whose use has directly led to harm to children and teenagers through exposure to harmful content and emotional manipulation. The harms are realized and documented, including mental health impacts and exposure to child sexual exploitation material. The failure of the AI systems' providers to implement robust age checks and content moderation constitutes a malfunction or inadequate use safeguards. This fits the definition of an AI Incident because the AI systems' use has directly led to harm to persons (children and teens).[AI generated]

The event involves the use of AI systems (autonomous driving technology) in real-world testing, which could plausibly lead to harm if the technology malfunctions or is misused. However, no actual harm or incident is reported in the article. Therefore, this qualifies as an AI Hazard, as the deployment of such technology on public roads could plausibly lead to injury or other harms in the future if failures occur.[AI generated]

The event involves AI systems used to impersonate influencers and generate misleading content, which directly led to financial harm through crypto scams (pump-and-dump schemes and fake giveaways). The harm to individuals' property (financial loss) and communities (misinformation and manipulation) is realized. Therefore, this qualifies as an AI Incident due to the direct role of AI in causing harm through malicious use and coordinated scam activity.[AI generated]