AI-Driven Deepfake Scams Surge in Latin America

The piece describes actual, occurring harms directly enabled by AI systems—namely, the malicious use of deepfake audio and video generation tools by criminals to carry out phishing and extortion schemes. This falls squarely under “AI Incident,” since the AI’s misuse has already resulted in injury (financial and emotional harm) to individuals and communities.

This is an AI Incident because it involves the misuse of AI systems—deepfake video and voice generation—to perpetrate financial fraud. The AI-generated content directly leads to harm, namely financial losses for victims.

This describes actual harm resulting from the use of AI systems (deepfake audio/video generation) to facilitate phishing and fraud. The AI role is pivotal in creating convincing manipulations that directly cause financial losses and deception, meeting the definition of an AI Incident.

The article describes actual occurrences of AI-enabled scams—using deepfake audio, videos, and “.ai” domains—to trick and financially defraud users. These harms are realized (phishing attempts and fraud) and directly stem from the malicious use of AI, fitting the definition of an AI Incident.

The article explicitly mentions the use of AI tools like deepfakes to perpetrate phishing scams that have materially increased in frequency and impact, causing direct harm to people through fraud. The AI system's use in generating manipulated images, audio, and video content is a direct contributing factor to the harm. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to realized harm (fraud and deception) in the community.

The article explicitly mentions the use of AI to create manipulated audio and video deepfakes used in phishing scams, which have caused actual harm by deceiving victims into fraudulent payments. This constitutes direct harm to people and communities through financial fraud. The AI system's use in generating deceptive content is central to the incident, fulfilling the criteria for an AI Incident. Therefore, the event is classified as an AI Incident.

The event involves the use of AI systems (deepfake and deepvoice technologies) to generate manipulated audio and video content that directly facilitates phishing scams causing financial harm to victims. This meets the definition of an AI Incident because the AI system's use has directly led to harm (financial loss) to people. The article describes realized harm through scams, not just potential harm, and the AI's role is pivotal in enabling these convincing fraudulent messages.

The article explicitly mentions the use of AI technologies (deepvoice and deepfake) to create manipulated audio and video content used in phishing scams. These scams have caused realized harm to victims through financial fraud, fulfilling the criteria for an AI Incident. The AI systems' use in generating deceptive content directly leads to harm to individuals (financial harm), which fits the definition of an AI Incident. Therefore, this event is classified as an AI Incident rather than a hazard or complementary information.

The event involves the use of AI systems (deepfake and deepvoice) to create manipulated audio and video content that directly facilitates phishing scams, which have caused financial harm to victims. The article describes actual harm occurring due to the AI-enabled manipulation, fulfilling the criteria for an AI Incident. The AI system's use is central to the harm, as it enables the creation of convincing fraudulent content that leads to victim deception and financial loss.