AI Digital Humans Impersonate Experts in Medical Product Advertising, Causing Health Risks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-generated digital humans have been used on Chinese online platforms to impersonate medical experts and promote medical products with false claims. This misuse of AI led to deceptive endorsements, violating advertising laws and potentially causing consumers to forgo proper treatment, posing significant health risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (AI digital humans) used to impersonate experts and promote medical products, which is a misuse of AI technology. The AI's role in misleading consumers about medical products and potentially causing them to forgo proper treatment directly leads to harm to health and violates legal advertising regulations. Therefore, this qualifies as an AI Incident due to realized harm and legal violations stemming from AI misuse.[AI generated]
AI principles
SafetyTransparency & explainability
Industries
Healthcare, drugs, and biotechnologyMedia, social platforms, and marketing
Affected stakeholders
Consumers
Harm types
Physical (injury)
Business function:
Marketing and advertisement
AI system task:
Content generation

Articles about this incident or hazard