Deepfake AI scam impersonates Colombia’s First Lady to promote trading fraud

An AI system was used to generate a manipulated video with the image and voice of Verónica Alcocer, which is being used to promote fraudulent trading platforms. This misuse of AI has directly led to harm by deceiving people and potentially causing financial loss, which qualifies as harm to communities and individuals. Therefore, this event is an AI Incident due to the realized harm caused by the AI-generated deepfake content.

The article explicitly mentions AI-generated deepfake videos used to impersonate the president and first lady to promote a fraudulent trading platform, which is a clear case of harm to people (financial fraud). The AI system's use in creating these videos is central to the incident. Therefore, this qualifies as an AI Incident due to realized harm caused by AI misuse.

The event involves the use of an AI system (generative AI for deepfake creation) in the malicious use of AI to impersonate a public figure and perpetrate a scam. The scam causes direct harm to people who might be defrauded financially, fulfilling the criteria for an AI Incident. The AI system's use directly led to the harm by enabling the creation of a convincing fraudulent video. Therefore, this is classified as an AI Incident.

The video was explicitly created with AI, as stated by the first lady, and it falsely promotes a trading investment scheme that is a scam. This misuse of AI-generated content has already caused harm by misleading the public and potentially causing financial loss. The AI system's role is pivotal in creating the deceptive video, which constitutes a violation of rights through fraud and harm to the community. Hence, this is an AI Incident rather than a hazard or complementary information.

The article explicitly states that AI was used to create a fake video impersonating a public figure to promote a scam, which has led to actual harm by attempting to defraud people. The AI system's use in generating the deepfake video is central to the incident, fulfilling the criteria of an AI Incident involving violation of rights and harm to communities through deception and financial harm. The harm is realized, not just potential, as the scam is active and victims are targeted.

The article explicitly mentions AI-generated deepfake videos falsifying the image and voice of the First Lady and references a similar prior incident involving the President's image and voice. The use of AI to create misleading content that promotes financial schemes can cause harm to communities through misinformation and potential financial fraud. This harm is realized as the videos are being disseminated and impacting social media. Therefore, this qualifies as an AI Incident. The mention of regulatory efforts is complementary information but does not change the primary classification.