Deepfake Doctors Promote Fake Medical Treatments on TikTok

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated deepfake avatars impersonating medical professionals are being used on TikTok and Instagram to promote unproven and dangerous health products. ESET researchers in Latin America detected the campaign, warning that these realistic videos mislead users into making unsafe purchases by presenting false medical advice.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems generating deepfake avatars that impersonate doctors to promote false medical advice and unapproved treatments. This use of AI directly causes harm by deceiving users, potentially leading to health risks and financial loss. The harm is realized, not just potential, as users are targeted and misled. Therefore, this qualifies as an AI Incident under the framework, as the AI system's use has directly led to harm to persons and communities.[AI generated]
AI principles
SafetyTransparency & explainabilityAccountabilityHuman wellbeingRespect of human rightsDemocracy & human autonomyRobustness & digital security
Industries
Media, social platforms, and marketingHealthcare, drugs, and biotechnologyConsumer products
Affected stakeholders
Consumers
Harm types
Physical (injury)Economic/PropertyReputationalPsychologicalPublic interestHuman or fundamental rights
Business function:
Marketing and advertisement
AI system task:
Content generation

Articles about this incident or hazard