
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A study by researchers from universities in India, Italy, Australia, and Israel found that AI chatbots now outperform humans in building trust during romance scams, such as "pig butchering" frauds. Victims were more likely to comply with AI requests, highlighting AI's growing role in automating and enhancing online scams, leading to increased financial and emotional harm.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (generative AI chatbots/LLMs) used in the scam process, showing that their use directly leads to harm by enabling more effective deception and financial fraud. The harm includes emotional exploitation and financial loss to victims, which fits the definition of harm to persons and communities. The AI system's role is pivotal in enabling the scam to be more effective and scalable, including the potential to replace human trafficked workers, thus increasing the scope and difficulty of combating such fraud. This is a clear case of an AI Incident as the harm is realized and directly linked to the AI system's use.[AI generated]