The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Meta CEO Mark Zuckerberg formally apologized to the Indian government after AI-driven moderation systems on Facebook and Instagram failed to prevent the spread of child sexual abuse material and deepfake content. The incident led to governmental intervention and highlighted operational shortcomings in Meta's AI content detection systems.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions deepfake videos, which are AI-generated synthetic media, being disseminated on Meta's platforms. The presence of child sexual abuse material and deepfake content represents a direct violation of human rights and harm to communities. The apology from Meta's CEO and legal actions against company officials indicate that the AI system's use and operational failures led to these harms. Hence, the event meets the criteria for an AI Incident as the AI system's use and malfunction directly caused significant harm.[AI generated]