First AI Voice Deepfake Scam Reported in Lucknow

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A 25-year-old man in Lucknow was defrauded of Rs 44,500 after a scammer used AI-generated voice technology to convincingly impersonate his uncle and request urgent financial help. This marks the city's first reported case of financial fraud enabled by AI voice deepfakes.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that the fraudster used an AI-generated voice to impersonate a relative, which led the victim to transfer money to the fraudster. This constitutes direct harm to the person through financial loss, fulfilling the criteria for an AI Incident. The involvement of AI in generating the voice is central to the harm occurring, and the harm is realized, not just potential.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRobustness & digital securitySafetyTransparency & explainabilityHuman wellbeingRespect of human rights

Industries
Digital securityFinancial and insurance services

Affected stakeholders
Consumers

Harm types
Economic/PropertyPsychological

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Lucknow reports first AI generated voice fraud case - ET Government

2023-12-18
ETGovernment.com
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the fraudster used an AI-generated voice to impersonate a relative, which led the victim to transfer money to the fraudster. This constitutes direct harm to the person through financial loss, fulfilling the criteria for an AI Incident. The involvement of AI in generating the voice is central to the harm occurring, and the harm is realized, not just potential.
Thumbnail Image

Man defrauded of 45000 in AI voice scam; Know how to stay safe from fakes

2023-12-19
HT Tech
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated fake voices (deepfakes) to impersonate a family member, which directly led to the victim transferring money to scammers. This constitutes a direct AI Incident because the AI system's use caused financial harm to a person. The harm is materialized and involves deception facilitated by AI technology, fitting the definition of an AI Incident under harm to persons and communities.
Thumbnail Image

Lucknow reports first AI generated voice fraud case

2023-12-18
National Herald
Why's our monitor labelling this an incident or hazard?
The use of an AI-generated voice to impersonate a relative and induce the victim to transfer money constitutes direct harm caused by the AI system's use. The AI system's involvement in generating the fraudulent voice was pivotal in enabling the scam, leading to realized financial harm. Therefore, this qualifies as an AI Incident due to the direct harm to the victim's property (financial loss) caused by the AI system's use in the scam.
Thumbnail Image

AI voice fraud scam: Cyberthug dupes Lucknow man of Rs 45,000

2023-12-19
Economic Times
Why's our monitor labelling this an incident or hazard?
The use of AI to impersonate a voice directly led to financial loss (harm to property) for the victim. The AI system's use in the scam is explicit and central to the incident, fulfilling the criteria for an AI Incident as the AI's use directly caused harm.
Thumbnail Image

In 1st Voice Fraud Case, Man Duped Of ₹44,500 | Lucknow News - Times of India

2023-12-18
The Times of India
Why's our monitor labelling this an incident or hazard?
The fraudster used an AI-generated voice to impersonate a family member, which directly led to the victim transferring money to the fraudster's account. This constitutes harm to the person (financial loss) caused by the use of an AI system, meeting the criteria for an AI Incident.
Thumbnail Image

Lucknow Man Duped By AI-Cloned Voice, Loses 45,000 In Extortion

2023-12-19
NDTV
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system to clone a voice, which was then used maliciously to trick the victim into transferring money. This directly led to financial harm (loss of Rs 45,000) to the victim, constituting harm to a person. Therefore, it meets the criteria of an AI Incident as the AI system's use directly caused harm through fraudulent activity.
Thumbnail Image

India: Lucknow reports first AI generated voice fraud case

2023-12-18
GULF NEWS
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated voice to impersonate a relative and deceive the victim into transferring money, which caused direct financial harm. This fits the definition of an AI Incident as the AI system's use directly led to harm to a person. The event involves the use of AI in a malicious way causing realized harm, not just a potential risk or complementary information.
Thumbnail Image

Artificial Fraudulence: Lucknow man duped of Rs 45K by AI-cloned voice, second such instance in 2 weeks

2023-12-19
Firstpost
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-based voice cloning technology to impersonate victims' relatives, leading to successful scams and financial losses. This is a direct harm caused by the use of an AI system (voice cloning AI) in the commission of fraud. Therefore, this qualifies as an AI Incident because the AI system's use directly led to harm (financial loss) to individuals.
Thumbnail Image

India News | AI Voice Fraud Scam: Cyberthug Dupes Lucknow Man of Rs 45,000 | LatestLY

2023-12-19
LatestLY
Why's our monitor labelling this an incident or hazard?
The use of AI to impersonate a voice and trick the victim into transferring money constitutes the use of an AI system leading directly to harm (financial loss) to a person. This fits the definition of an AI Incident because the AI system's use directly caused harm to the victim. The event involves the use of AI in a fraudulent scam resulting in realized harm, not just a potential risk or complementary information.
Thumbnail Image

AI voice fraud scam: Cyberthug dupes Lucknow man of Rs 45,000

2023-12-19
Asian News International (ANI)
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the fraudster used AI to impersonate the victim's relative's voice, which directly caused the victim to transfer money under false pretenses. This is a clear case of harm to a person (financial loss) caused by the use of an AI system (voice impersonation). Therefore, it meets the criteria for an AI Incident as the AI system's use directly led to harm.
Thumbnail Image

Lucknow reports first AI generated voice fraud case

2023-12-18
Social News XYZ
Why's our monitor labelling this an incident or hazard?
The article explicitly states that the fraudster used an AI-generated voice to impersonate a relative and successfully tricked the victim into transferring money, resulting in financial harm. This meets the criteria for an AI Incident because the AI system's use directly led to harm (financial loss) to a person. The involvement of AI in generating the voice is clear, and the harm has materialized, not just a potential risk.