AI-Generated Fake Doctors Spread Harmful Health Misinformation Online

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI systems have been used to create realistic fake doctors who spread false medical advice and promote unproven remedies on social media platforms like TikTok and YouTube. These AI-generated personas have reached millions, misleading vulnerable audiences and facilitating the sale of potentially harmful products, posing significant risks to public health in Brazil.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions the use of AI to generate fake medical personas and videos that spread false health information and promote unproven treatments, which have been viewed millions of times and have led to the sale of harmful products. The AI systems' use in creating these deceptive contents directly contributes to harm by misleading people about medical treatments, which can cause injury or harm to health (harm category a) and harm to communities (harm category d). The involvement of AI in the creation and dissemination of this disinformation is clear and central to the harm described. Hence, this event meets the criteria for an AI Incident.[AI generated]
AI principles
SafetyTransparency & explainability

Industries
Media, social platforms, and marketingHealthcare, drugs, and biotechnology

Affected stakeholders
General public

Harm types
Physical (injury)

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Perfis criam médicos falsos e lucram com desinformação nas redes

2026-06-02
Jornal Estado de Minas | Not�cias Online
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to generate fake medical personas and videos that spread false health information and promote unproven treatments, which have been viewed millions of times and have led to the sale of harmful products. The AI systems' use in creating these deceptive contents directly contributes to harm by misleading people about medical treatments, which can cause injury or harm to health (harm category a) and harm to communities (harm category d). The involvement of AI in the creation and dissemination of this disinformation is clear and central to the harm described. Hence, this event meets the criteria for an AI Incident.
Thumbnail Image

Perfis criam médicos falsos e lucram com desinformação nas redes

2026-06-02
Jornal de Brasília
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI-generated voice and images are used to create fake medical professionals spreading false health claims. The dissemination of such misinformation has already occurred at scale, with millions of views and engagement, and has led to the sale of unproven and potentially harmful products. This constitutes direct harm to public health and communities through misinformation and deception. The AI system's use in generating these fake personas and content is central to the harm caused. Hence, this event meets the criteria for an AI Incident, as the AI system's use has directly led to harm to communities and violations of rights related to health information.
Thumbnail Image

Perfis criam médicos falsos e lucram com desinformação nas redes

2026-06-02
Bem Paraná
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI-generated synthetic doctors using voice and image generation technologies to produce false medical advice. The dissemination of this misinformation has already caused harm by misleading large audiences about health treatments, which can result in injury or harm to health (harm category a) and harm to communities (harm category d). The AI systems' use in creating and spreading this disinformation is central to the event. Hence, this qualifies as an AI Incident because the AI system's use has directly led to significant harm through health misinformation and its monetization.
Thumbnail Image

IA cria médicos falsos que lucram com curas milagrosas - 01/06/2026 - Tec - Folha

2026-06-02
Folha de S.Paulo
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems generating fake medical professionals who spread false health claims, leading to misinformation that can harm individuals' health and well-being. The AI-generated content is used to monetize deceptive health products, which can cause physical harm or delay effective treatment. The involvement of AI in creating realistic fake personas and content is central to the harm caused. This meets the definition of an AI Incident because the AI system's use has directly led to harm to people and communities through health misinformation and fraudulent commercial exploitation.
Thumbnail Image

IA cria médicos falsos que difundem curas milagrosas - Diário News

2026-06-02
:: DiÁrio News :
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating false medical content that directly leads to harm by promoting unproven and dangerous health remedies, which constitutes harm to the health of people (a). The AI's role in producing and disseminating this misinformation is pivotal to the harm occurring. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to harm to people's health through misinformation and promotion of harmful products.