The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
AI systems have been used to create realistic fake doctors who spread false medical advice and promote unproven remedies on social media platforms like TikTok and YouTube. These AI-generated personas have reached millions, misleading vulnerable audiences and facilitating the sale of potentially harmful products, posing significant risks to public health in Brazil.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems creating fake medical avatars and content that have directly influenced elderly viewers to change or abandon medical treatments, which is a direct harm to their health (harm category a). The AI system's use is central to the harm, as the avatars and scripts are AI-generated and designed to deceive. The harm is realized, not just potential, as evidenced by user comments reporting behavior changes based on the AI-generated advice. The event involves the use and misuse of AI systems, fulfilling the criteria for an AI Incident. It is not merely a hazard or complementary information, as the harm is occurring and linked to the AI system's outputs.[AI generated]