Meta Criticized for Inadequate AI Deepfake Moderation During Iran-Israel Conflict

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's AI systems failed to adequately detect and label deepfake videos depicting false damage in Israel during the Iran-Israel conflict, leading to the spread of misinformation. The Meta Oversight Board criticized the company's weak moderation and called for stronger safeguards and transparency to prevent harm to public perception during conflicts.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI-generated content (AI system involvement) that has been used to spread false information about a military conflict, which has been viewed millions of times, causing harm to communities by undermining trust in information. The AI system's use (generation of fake videos) directly led to harm through misinformation dissemination. Meta's failure to label or remove the content promptly constitutes a failure in use and moderation of the AI system's outputs, contributing to the harm. The Oversight Board's critique and Meta's delayed response confirm the harm is realized, not just potential. Hence, this is an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Robustness & digital securityTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
Public interest

Business function:
Monitoring and quality control

AI system task:
Recognition/object detection


Articles about this incident or hazard