AI-Generated Disturbing and Misleading Images Flood Facebook

The event involves AI systems generating images that are used maliciously by spam accounts to manipulate social media engagement and spread misinformation. This has led to harm to communities by polluting information spaces with AI-generated spam and misleading content, which fits the definition of an AI Incident due to the realized harm to communities and the pivotal role of AI in generating the harmful content. The article details ongoing harm rather than just potential risk or complementary information, so it qualifies as an AI Incident.

The event involves AI systems generating images that are spread on social media platforms, with some images unlabeled and misleading users. The use of AI-generated content by spammers and scammers to manipulate audience growth constitutes indirect harm to communities through misinformation and deception. Although no physical harm is reported, the misleading nature of the content and its potential to distort social interactions and trust qualifies as harm to communities. Therefore, this qualifies as an AI Incident due to realized harm caused by the use of AI systems.

AI-generated images of mutilated and dying children are being actively pushed into users' feeds, causing harm to communities by spreading distressing and potentially misleading content. The AI system's development and use in generating these images directly leads to harm. Facebook's failure to effectively address or label this content further contributes to the ongoing harm. Therefore, this event meets the criteria for an AI Incident as the AI system's use has directly led to harm to communities.