AI-Generated Fake Profiles of Nahir Galarza Used for Fraud and Misinformation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Nahir Galarza, an Argentine inmate, reported the creation of fake social media profiles using AI-generated and manipulated images of her. These profiles spread false information and solicit money from users, leading to reputational harm and potential fraud. Galarza and her associates have warned the public against these scams.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system is involved as it is explicitly mentioned that images were created with artificial intelligence. The use of these AI-generated images in fake profiles has led to harm in the form of potential fraud (users being solicited for money under false pretenses), which is a form of harm to individuals and communities. The event describes realized harm through the fraudulent use of AI-generated content, thus qualifying as an AI Incident.[AI generated]
AI principles
Privacy & data governanceTransparency & explainability

Industries
Media, social platforms, and marketing

Affected stakeholders
WomenConsumers

Harm types
ReputationalEconomic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Nahir Galarza denunció perfiles falsos con fotos creadas con I.A

2026-01-30
Perfil
Why's our monitor labelling this an incident or hazard?
An AI system is involved as it is explicitly mentioned that images were created with artificial intelligence. The use of these AI-generated images in fake profiles has led to harm in the form of potential fraud (users being solicited for money under false pretenses), which is a form of harm to individuals and communities. The event describes realized harm through the fraudulent use of AI-generated content, thus qualifying as an AI Incident.
Thumbnail Image

Denuncian perfiles falsos de Nahir Galarza creados con inteligencia artificial

2026-01-30
BAE Negocios
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to create manipulated or generated images for fake profiles that are used to deceive and solicit money, which is a direct harm to people (financial harm) and a violation of rights (fraud, impersonation). The AI system's use is central to the harm, as it enables the creation of realistic fake images that mislead users. This meets the criteria for an AI Incident because the AI's use has directly led to harm through fraudulent activity and deception.
Thumbnail Image

Nahir Galarza denunció cuentas en redes sociales que difunden sus fotos modificadas por IA

2026-01-29
La 100
Why's our monitor labelling this an incident or hazard?
An AI system is involved as the images are explicitly stated to be generated and manipulated using artificial intelligence. The use of these AI-generated images in fake profiles and misleading posts has directly led to harm by spreading false information and potentially defrauding users. This constitutes an AI Incident because the AI-generated content is central to the harm occurring, including reputational damage and fraudulent solicitations, which are harms to communities and violations of rights.
Thumbnail Image

Nahir Galarza denunció perfiles falsos con fotos creadas por IA - Nogoyá Times

2026-01-29
NOGOYA TIMES
Why's our monitor labelling this an incident or hazard?
The event involves AI systems generating fake images used to create false social media profiles that mislead the public and harm the reputation of an individual. The AI system's outputs are directly involved in causing harm through misinformation and identity misuse. This fits the definition of an AI Incident because the AI-generated content has directly led to harm to communities and individuals by spreading false information and violating the individual's rights to their image and reputation. Although the harm is non-physical, it is significant and clearly articulated, meeting the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Nahir Galarza denunció cuentas falsas que usan IA para manipular su imagen - Somos Jujuy

2026-01-29
Somos Jujuy
Why's our monitor labelling this an incident or hazard?
An AI system is involved as it is used to manipulate images and create fake profiles. The harm is realized as these fake accounts spread false information and could lead to fraud, which harms the community and individuals' rights. Therefore, this qualifies as an AI Incident because the AI-generated manipulated content has directly led to harm through deception and potential scams.
Thumbnail Image

Nahir Galarza: denuncian que se crearon unos 50 perfiles falsos con IA

2026-01-31
Perfil
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the creation of over 50 fake profiles using AI-generated images of Nahir Galarza, which are used to mislead and potentially commit fraud. This directly harms the individual's right to identity and image, a recognized human right, and poses risks to the public through possible scams. The AI system's use in generating these images is central to the harm described. The harm is realized, not just potential, as the fake accounts are active and have large followings. Hence, this fits the definition of an AI Incident, as the AI system's use has directly led to violations of rights and potential fraud.