AI-Generated Deepfakes Fuel Scams, Extortion, and Misinformation in Indonesia

The event explicitly involves AI systems (deepfake generation technology) being used maliciously to create harmful content that directly causes harm to individuals' privacy, reputation, and finances. The article reports that these harms are occurring, with active demand and supply of such services on the darknet. This meets the criteria for an AI Incident because the AI system's use has directly led to significant harms including financial loss and violations of privacy and rights. The involvement is through malicious use of AI-generated deepfakes, causing realized harm.

The article explicitly discusses AI systems (deepfake technology) being used maliciously to create manipulated videos that have directly caused harm, including financial fraud and emotional distress. The harms are realized and significant, involving violations of privacy, financial losses, and potential political manipulation. The involvement of AI in the development and use of these deepfakes is clear and central to the incident. Hence, this is an AI Incident rather than a hazard or complementary information.

The event involves AI systems explicitly (deepfake video generation) and their use has directly led to harms such as financial fraud, emotional harm from revenge porn, and potential political manipulation. The presence of realized harms (e.g., crypto scams, extortion via pornographic deepfakes) meets the criteria for an AI Incident. The article does not merely warn of potential harm but reports ongoing exploitation causing actual damage, thus it is not an AI Hazard or Complementary Information.

The article explicitly discusses AI systems (deepfake generation technology) being used maliciously on darknet platforms to produce manipulated videos and images for harmful purposes, including crypto asset fraud and security breaches. These activities have directly led to realized harms such as financial scams and potential political manipulation. The presence of AI systems is clear, their use is malicious, and harm is occurring. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information.

Deepfake videos are generated by AI systems that create realistic manipulated content. The article details how these AI-generated deepfakes are actively used in scams causing financial losses and in creating pornographic content for extortion, which constitutes direct harm to individuals and communities. Therefore, this event qualifies as an AI Incident due to realized harms caused by the use of AI systems.

The article clearly identifies deepfake technology as an AI system and describes its use in spreading false information and hoaxes that harm communities and democratic processes. These harms are occurring or ongoing, as the article references real societal impacts and the need for mitigation. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to harm to communities and violations of rights through misinformation and manipulation. The article does not merely warn of potential harm but discusses actual harms and responses, so it is not an AI Hazard or Complementary Information. It is not unrelated because it centers on AI deepfake technology and its societal impacts.