Tamil Nadu Police Warns of AI Voice Cloning Scam Targeting Public

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Tamil Nadu Police have issued advisories warning that scammers are using AI-based voice cloning to impersonate trusted contacts and deceive victims into transferring money during fake emergencies. The AI technology enables convincing impersonation, leading to financial losses for individuals targeted by these sophisticated frauds.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (voice cloning software) to commit fraud, which directly causes harm to victims by deceiving them into transferring money. The harm is realized and ongoing, as the scam is actively being used. Therefore, it meets the criteria for an AI Incident due to direct harm caused by the AI system's use in a malicious context.[AI generated]
AI principles
Privacy & data governanceRobustness & digital securitySafetyTransparency & explainabilityAccountabilityRespect of human rights
Industries
Digital securityFinancial and insurance servicesGovernment, security, and defence
Affected stakeholders
General public
Harm types
Economic/PropertyPsychologicalHuman or fundamental rightsReputational
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

Beware of voice cloning scam, caution Tamil Nadu cops - Times of India

2024-04-27
The Times of India
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (voice cloning software) to commit fraud, which directly causes harm to victims by deceiving them into transferring money. The harm is realized and ongoing, as the scam is actively being used. Therefore, it meets the criteria for an AI Incident due to direct harm caused by the AI system's use in a malicious context.
Thumbnail Image

T.N. Cyber Crime Police issue advisory on new scam involving AI voice cloning

2024-04-27
The Hindu
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (voice cloning AI) used in the scam. The scam has directly led to harm to people (financial loss and emotional distress), fulfilling the criteria for an AI Incident. The advisory is issued in response to ongoing incidents, indicating harm has already occurred. Therefore, this is classified as an AI Incident.
Thumbnail Image

Victims duped with AI voice cloning in Chennai

2024-04-28
The New Indian Express
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI software to clone voices for fraudulent purposes, which directly leads to harm (financial loss) to victims. This fits the definition of an AI Incident, as the AI system's use has directly led to harm to persons (victims of fraud).
Thumbnail Image

AI Voice Cloning Scam: Tamil Nadu Police Warn People Against Fraudsters Using Artificial Intelligence-Based Voice Cloning | 📰 LatestLY

2024-04-27
LatestLY
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of advanced AI technologies for voice cloning to mimic trusted individuals' voices, which is then used to deceive victims into transferring money under false pretenses. This constitutes direct harm to people through financial fraud enabled by AI. The AI system's role is pivotal in enabling the scam, fulfilling the criteria for an AI Incident as it has directly led to harm to persons (financial loss).
Thumbnail Image

Tamil Nadu Police Issues Advisory On New Scam Using AI-assisted Voice Cloning

2024-04-29
Inc42 Media
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI systems for voice cloning to commit fraud, which has directly led to harm (financial extortion) to individuals. The advisory warns about this ongoing scam, indicating that harm is occurring. The AI system's use in cloning voices and enabling impersonation is central to the scam's success, thus meeting the definition of an AI Incident. The advisory and related examples of deepfake misuse further support the presence of realized harm due to AI misuse.
Thumbnail Image

TN Police warn people against fraudsters using AI-based voice cloning

2024-04-27
Social News XYZ
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of advanced AI technologies for voice cloning to mimic voices of trusted contacts, which is then used to commit fraud by inducing victims to transfer money. This constitutes direct harm to individuals (financial harm) caused by the use of an AI system. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm (fraud and financial loss) to people.
Thumbnail Image

Tamil Nadu Cyber Crime Police Issue Advisory Against Use of AI-Based Voice Cloning by Cyber Criminals: Report

2024-04-29
MediaNama
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-based voice cloning systems by scammers to commit fraud, which has directly led to financial harm to individuals. The AI system's use in cloning voices and enabling convincing impersonation is central to the scam's success, fulfilling the criteria for an AI Incident as the AI system's use has directly led to harm (financial loss) to people. The advisory is a response to an ongoing AI Incident involving cybercrime using AI voice cloning.
Thumbnail Image

Scamsters using AI technology to clone voices and deceive public, warns Tamil Nadu Police

2024-04-27
dtnext.in
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (voice cloning technology) in the commission of scams that directly cause harm to individuals by financial deception. The AI system's use in cloning voices to impersonate victims' contacts and induce urgent financial transfers constitutes an AI Incident because it has directly led to harm (financial loss) to people. The police warning confirms that these scams are active and harmful, not merely potential or hypothetical.