AI-Generated Deepfake Diet Ads Cause Health Harm to Kathy Hilton

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Kathy Hilton was misled by AI-generated deepfake ads featuring fake celebrity endorsements for a Jell-O diet, leading her to try the diet and suffer negative health effects. The incident highlights the harm caused by deceptive AI-generated content impersonating public figures to promote unsafe products.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly involves AI systems generating deepfake videos impersonating celebrities to promote a false diet. Kathy Hilton was directly harmed by following the diet based on the AI-generated ad, which caused physical health issues. The AI system's misuse directly led to harm to a person, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, and the AI system's role is pivotal in causing the harm through deceptive content.[AI generated]
AI principles
Transparency & explainabilitySafety

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Physical (injury)

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard