Quantum AI Accused of Fraud Using AI Deepfakes of Elon Musk

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Hong Kong Securities and Futures Commission (SFC) has warned the public about Quantum AI, which allegedly used AI-generated deepfake videos and images of Elon Musk to falsely promote its cryptocurrency services. The SFC suspects Quantum AI of spreading misleading information and has blocked its website and social media pages.[AI generated]

Why's our monitor labelling this an incident or hazard?

Quantum AI's use of AI-generated deepfake content to impersonate a public figure and promote fraudulent cryptocurrency trading services directly leads to harm by deceiving and defrauding the public. The involvement of AI in creating deepfakes is explicit, and the harm (fraud, violation of rights, and harm to communities) is realized, not just potential. Therefore, this event meets the criteria for an AI Incident.[AI generated]
AI principles
AccountabilityTransparency & explainabilitySafetyRespect of human rightsDemocracy & human autonomyRobustness & digital security

Industries
Financial and insurance servicesMedia, social platforms, and marketingDigital security

Affected stakeholders
Consumers

Harm types
Economic/PropertyReputationalPublic interest

Severity
AI incident

Business function:
Marketing and advertisementSales

AI system task:
Content generation

In other databases

Articles about this incident or hazard

Thumbnail Image

香港证监会:Quantum AI涉嫌从事虚拟资产相关欺诈行为

2024-05-08
163.com
Why's our monitor labelling this an incident or hazard?
Quantum AI's use of AI-generated deepfake content to impersonate a public figure and promote fraudulent cryptocurrency trading services directly leads to harm by deceiving and defrauding the public. The involvement of AI in creating deepfakes is explicit, and the harm (fraud, violation of rights, and harm to communities) is realized, not just potential. Therefore, this event meets the criteria for an AI Incident.
Thumbnail Image

【虛擬資產】證監會:Quantum AI擬偽造馬斯克影片欺詐

2024-05-08
ET Net
Why's our monitor labelling this an incident or hazard?
Quantum AI is explicitly described as using AI technology to create deepfake videos and photos to impersonate a public figure, Elon Musk, to mislead the public into believing in false endorsements. This has directly led to fraudulent activities involving virtual assets, which is a clear violation of legal and ethical standards and causes harm to individuals and the community. The involvement of AI in generating deceptive content and enabling fraud meets the criteria for an AI Incident under the definitions provided.
Thumbnail Image

證監會告誡Quantum AI涉虛擬資產欺詐 用AI製作馬斯克肖像宣傳

2024-05-08
std.stheadline.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI to generate deepfake content impersonating Elon Musk, which is used to promote a fraudulent cryptocurrency trading service. This AI involvement is central to the deception and the resulting harm to investors who may suffer financial losses. The event meets the criteria for an AI Incident because the AI system's use has directly led to harm through fraud and misinformation causing financial damage and violation of rights.
Thumbnail Image

證監會:Quantum AI涉嫌從事虛擬資產相關欺詐活動

2024-05-08
Yahoo News
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI technology to create deepfake videos and photos for fraudulent purposes, which directly harms individuals by misleading them into fraudulent virtual asset transactions. The involvement of AI in generating deceptive content and the resulting harm to the public meets the criteria for an AI Incident, as the AI system's use has directly led to violations of rights and harm to communities through fraud and misinformation.
Thumbnail Image

香港证监会:Quantum AI涉嫌从事虚拟资产相关欺诈行为

2024-05-08
东方财富网
Why's our monitor labelling this an incident or hazard?
The event explicitly mentions the use of AI technology to generate deepfake content for fraudulent purposes, which constitutes a violation of rights and causes harm to the community through deception and financial fraud. The Hong Kong Securities and Futures Commission's action to warn the public and block the website confirms that harm has occurred or is ongoing. Therefore, this qualifies as an AI Incident due to the direct involvement of AI in causing harm through fraud.
Thumbnail Image

香港又一虚拟资产交易平台涉嫌欺诈!误导认为马斯克是开发者 _ 东方财富网

2024-05-09
东方财富网
Why's our monitor labelling this an incident or hazard?
The platform explicitly claims to use AI technology and employs AI-generated synthetic media to deceive users, which is a direct misuse of AI systems. This misuse has led to realized harm in the form of financial fraud and economic losses to investors, fulfilling the criteria for an AI Incident. The regulatory response and public harm confirm that the AI system's use was central to the fraudulent activity and resulting harm.
Thumbnail Image

證監會:Quantum AI涉嫌從事虛擬資產相關欺詐活動 - 香港文匯網

2024-05-08
香港文匯網
Why's our monitor labelling this an incident or hazard?
The event describes the use of AI-generated deepfake videos and AI technology in fraudulent cryptocurrency trading activities, which have directly led to harm by deceiving the public and potentially causing financial losses. The involvement of AI in creating misleading content and facilitating fraud meets the criteria for an AI Incident, as it has directly led to harm to people and communities. The regulatory and police actions are responses to this incident, not the main focus of the article, so this is not merely Complementary Information.
Thumbnail Image

智通财经APP获悉,5月8日,香港证监会公告称,告诫公众提防一家以"Quantum AI"名称运作的实体涉嫌从事虚拟资产相关欺诈活动。

2024-05-08
证券之星
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (AI-generated deepfake videos) used maliciously to deceive and defraud the public in the context of virtual asset trading. The harm is financial and affects individuals (harm to persons/groups), and the AI system's misuse is central to the incident. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm through fraudulent activities and deception.
Thumbnail Image

​香港證監會:Quantum AI涉嫌從事虛擬資產欺詐行為

2024-05-09
hkcna.hk
Why's our monitor labelling this an incident or hazard?
Quantum AI explicitly uses AI technology to create deepfake content impersonating a public figure to deceive the public into investing in fraudulent cryptocurrency services. This misuse of AI has directly caused harm by facilitating fraud and misleading the public, fulfilling the criteria for an AI Incident. The involvement of AI-generated deepfakes is central to the harm, and the regulatory and law enforcement response confirms the materialized harm and legal violations.
Thumbnail Image

A Hong Kong-based crypto exchange used deepfakes of Elon Musk to claim the billionaire was its lead developer

2024-05-12
Business Insider
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology) to create realistic fake videos and video calls impersonating Elon Musk. This AI-enabled deception directly led to financial harm to victims through scams. The Hong Kong authorities' intervention and the description of actual losses confirm that harm has occurred. Hence, the event meets the criteria for an AI Incident, as the AI system's use directly caused harm to people via fraud.
Thumbnail Image

Hong Kong Crypto Exchange Uses Elon Musk Deepfake to Promote Him as Lead Developer

2024-05-13
cryptonews.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI systems in the form of deepfake technology used to create realistic fake videos and audio impersonating Elon Musk. These AI-generated deepfakes were used to deceive victims into believing in a fraudulent cryptocurrency platform, leading to financial losses, which constitutes harm to individuals. The use of AI here is central to the scam's effectiveness and the resulting harm. The police intervention and warnings do not negate the fact that harm has occurred. Hence, this is an AI Incident as the AI system's use directly led to harm (financial fraud) and violation of rights (fraudulent deception).
Thumbnail Image

Crypto Scam Uses Elon Musk Deepfake as 'Developer' to Lure Investors - EconoTimes

2024-05-13
EconoTimes
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology) to create realistic fake videos and video calls impersonating Elon Musk. This AI system's use directly led to harm (financial loss) to individuals who were scammed. The harm is realized and significant, involving deception and fraud facilitated by AI-generated content. Therefore, this qualifies as an AI Incident due to the direct link between the AI system's use and the harm caused to people (financial harm and fraud).
Thumbnail Image

A Hong Kong-based crypto exchange used deepfakes of Elon Musk to claim the billionaire was its lead developer

2024-05-12
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (deepfake technology) to create realistic fake videos of Elon Musk, which were then used to perpetrate a cryptocurrency scam. This directly led to financial harm to victims, fulfilling the criteria for an AI Incident under harm to persons or groups (financial harm). The AI system's use was instrumental in the scam's success, and harm has already occurred. Therefore, this is classified as an AI Incident.
Thumbnail Image

Elon Musk Deepfake Used by Hong Kong Crypto Startup, Claims He's Lead Developer

2024-05-13
Tech Times
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (deepfake technology) used in the development and use of fraudulent content that directly leads to harm by misleading people into harmful investments, which constitutes harm to communities and individuals financially. This meets the criteria for an AI Incident because the AI system's use has directly led to realized harm through scams and fraud. Therefore, the classification is AI Incident.
Thumbnail Image

Deepfake Crypto Scam Targets Asia: Elon Musk Face Used!

2024-05-17
Investing.com South Africa
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI systems to create deepfake videos, which are AI-generated synthetic media. The scam has directly caused financial harm to individuals, fulfilling the criteria for an AI Incident under harm to property and communities. The AI system's use in generating convincing fake videos was pivotal in enabling the fraud and resulting losses. Therefore, this qualifies as an AI Incident.
Thumbnail Image

Elon Musk deepfake crypto scam highlights risks to Hong Kong as AI-related fraud rises

2024-05-17
Yahoo! Finance
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated deepfakes to perpetrate scams, which have caused tens of millions of dollars in losses. The AI system's use in creating convincing fake videos directly facilitated fraudulent activities, constituting harm to property and communities. Therefore, this qualifies as an AI Incident because the AI system's use directly led to realized harm through fraud.
Thumbnail Image

Elon Musk deepfake crypto scam highlights risks to Hong Kong

2024-05-16
South China Morning Post
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI systems—specifically generative AI to create deepfake videos and audio—to perpetrate fraud. The scam has directly caused financial harm to victims, including tens of millions of dollars lost, which qualifies as harm to persons and communities. The AI system's use in generating convincing fake content was pivotal to the scam's success. Therefore, this constitutes an AI Incident due to realized harm caused by AI-enabled fraudulent activity.
Thumbnail Image

Elon Musk deepfake crypto scam highlights risks to Hong Kong as AI-related fraud rises

2024-05-17
The Star
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated deepfakes (an AI system) to commit fraud, which has directly caused financial harm to victims, including multi-million dollar losses. The involvement of AI in the creation and dissemination of these fraudulent videos is central to the harm described. Therefore, this qualifies as an AI Incident due to direct harm to people (financial injury) and harm to communities through fraudulent activities enabled by AI misuse.
Thumbnail Image

Elon Musk Deepfake Crypto Scam Raises Alarm In Hong Kong, SFC Responds

2024-05-18
Coingape
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated deepfake videos to perpetrate a cryptocurrency scam, which has caused harm to investors by misleading them into fraudulent investments. This constitutes a violation of rights and harm to communities through financial fraud. The involvement of AI in the scam's execution and the realized harm to victims qualifies this event as an AI Incident rather than a hazard or complementary information. The regulatory response is a reaction to an existing incident, not the main focus of the article.
Thumbnail Image

Hong Kong SFC Warns Against AI-Powered Crypto Scam Featuring Fake Elon Musk | Crypto Live News artificial intelligence | CryptoRank.io

2024-05-18
CryptoRank
Why's our monitor labelling this an incident or hazard?
The scam involves the use of AI-generated deep fake videos, which is an AI system, to perpetrate fraud causing financial harm to victims. This constitutes an AI Incident because the AI system's use has directly led to harm (fraud and financial loss). The involvement of the Hong Kong SFC and police to block access indicates the harm is ongoing and recognized. Therefore, this event is classified as an AI Incident.