AI Now Generates Majority of Global Spam and Malicious Emails

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers from Barracuda, Columbia University, and the University of Chicago found that over half of all spam and malicious emails are now generated by AI, particularly large language models. This shift, accelerating since ChatGPT's launch, has made phishing and scam emails more convincing and harder to detect, increasing cybercrime risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that over half of spam emails are now generated by large language models, which are AI systems. These AI-generated emails are more sophisticated and harder to detect, increasing the risk and occurrence of harm through spam and phishing attacks. This directly leads to harm to communities and individuals by enabling scams and deceptive practices. Hence, it meets the criteria for an AI Incident due to realized harm caused by AI-generated malicious content.[AI generated]
AI principles
AccountabilitySafetyRobustness & digital security

Industries
Digital security

Affected stakeholders
General publicBusiness

Harm types
Economic/Property

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Un'esplosione di mail indesiderate grazie all'Intelligenza artificiale

2025-06-19
L'opinione delle Libertà
Why's our monitor labelling this an incident or hazard?
The article explicitly states that over half of spam emails are now generated by large language models, which are AI systems. These AI-generated emails are more sophisticated and harder to detect, increasing the risk and occurrence of harm through spam and phishing attacks. This directly leads to harm to communities and individuals by enabling scams and deceptive practices. Hence, it meets the criteria for an AI Incident due to realized harm caused by AI-generated malicious content.
Thumbnail Image

Le email spam? Un esplosione grazie all'intelligenza artificiale

2025-06-19
Tgcom24
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions that large language models (AI systems) are used to generate spam emails that criminals use to bypass detection and deceive recipients. This directly leads to harm to people through scams or fraud, fitting the definition of an AI Incident due to realized harm caused by the AI system's use in malicious activities.
Thumbnail Image

Il 51% delle email indesiderate è generato dall'IA - Cybersecurity - Ansa.it

2025-06-19
ANSA.it
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI-generated emails constitute a majority of spam, which is a form of malicious communication causing harm to individuals and organizations. The AI system's use in crafting these emails is a direct factor in the harm caused by spam and phishing attacks. This fits the definition of an AI Incident as the AI system's use has directly led to harm to people (through deception and potential fraud).
Thumbnail Image

Mail indesiderate? Una volta su due è colpa dell'AI

2025-06-19
Prima Comunicazione
Why's our monitor labelling this an incident or hazard?
The use of AI systems (large language models) to generate spam emails that bypass detection systems and deceive recipients directly leads to harm by facilitating scams, fraud, or other malicious activities targeting individuals or groups. This constitutes harm to communities and individuals, fitting the definition of an AI Incident due to the realized harm caused by AI-generated spam.
Thumbnail Image

La metà dello spam è fatto con l'AI e questo è un enorme problema

2025-06-20
IlSoftware.it
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (advanced language models) to generate spam emails that are increasingly credible and evade detection, leading to realized harm in the form of phishing and fraud. This fits the definition of an AI Incident because the AI's use has directly led to harm to communities and individuals through cybercrime. The article describes an ongoing, materialized harm rather than a potential future risk, so it is not an AI Hazard. It is not merely complementary information or unrelated news, as the AI's role in causing harm is central and explicit.
Thumbnail Image

Oltre la metà dello spam è generato tramite AI

2025-06-23
MRW.it
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI models) to produce spam emails that bypass security filters and deceive recipients, which constitutes an AI system's use leading to harm. The harm includes facilitating cyberattacks and scams that affect individuals and organizations, fitting the definition of an AI Incident due to realized harm to communities and property through cybercrime. The article describes actual ongoing harm rather than potential future harm, so it is classified as an AI Incident.
Thumbnail Image

Il 51% delle e-mail indesiderate è generato dall'IA

2025-06-23
Qdpnews
Why's our monitor labelling this an incident or hazard?
An AI system (large language models) is explicitly involved in generating spam emails, which are used maliciously to deceive users. This use of AI directly leads to harm by facilitating scams or fraud, which can cause financial or personal harm to individuals. Therefore, this qualifies as an AI Incident due to realized harm caused by AI-generated spam emails.
Thumbnail Image

L'intelligenza artificiale genera il 51% delle email Spam che riceviamo ogni giorno: dati allarmanti

2025-06-19
HTML.it
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate spam emails that deceive recipients, increasing the likelihood of harm such as fraud or data compromise. This is a direct harm to communities and individuals, fitting the definition of an AI Incident. The article describes ongoing harm rather than a potential future risk or a response to a past incident, so it is not an AI Hazard or Complementary Information. Therefore, the classification is AI Incident.
Thumbnail Image

AI Now Generates Majority of Spam and Malicious Emails

2025-06-18
Infosecurity Magazine
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI tools are responsible for generating over half of malicious and spam emails, which are harmful by nature as they involve scams and unsolicited malicious content. The AI system's use in generating these emails directly leads to harm to communities and individuals targeted by these scams. The involvement of AI in the creation and dissemination of harmful content meets the criteria for an AI Incident, as the harm is realized and the AI system's role is pivotal in causing it.
Thumbnail Image

Major spam email warning - AI now generates almost all of your junk mail

2025-06-19
TechRadar
Why's our monitor labelling this an incident or hazard?
The article explicitly states that generative AI (large language models) is being used to write the majority of spam emails, which are causing harm by deceiving recipients. This is a direct use of AI systems leading to realized harm (spam scams and phishing attempts) affecting individuals and organizations. Therefore, it meets the definition of an AI Incident due to harm to communities and individuals caused by AI-generated spam.
Thumbnail Image

Over Half of All Spam Emails Are Now AI-generated

2025-06-19
Digit
Why's our monitor labelling this an incident or hazard?
The article explicitly states that over half of all spam emails are now AI-generated, and these emails are more sophisticated and harder to detect, increasing the risk of harm such as scams and phishing attacks. The AI system's use in generating these emails directly contributes to harm to individuals and communities by facilitating malicious activities. This meets the definition of an AI Incident as the AI system's use has directly led to harm through malicious email campaigns.
Thumbnail Image

Half the spam in your inbox is generated by AI - its use in advanced attacks is at an earlier stage

2025-06-18
Barrcuda Blog
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (generative AI) in the creation of malicious emails that deceive recipients, leading to harm such as fraud and potential financial or reputational damage. This constitutes harm to communities and individuals through cybercrime. Since the AI-generated emails are actively being used in attacks, this is a realized harm directly linked to AI use, fitting the definition of an AI Incident.
Thumbnail Image

Scammers now using AI for A/B testing to craft the most effective trap

2025-06-19
Cybernews
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems (large language models) being used by malicious actors to generate spam and phishing emails. This use of AI directly contributes to harm by facilitating scams and fraud, which can cause financial and psychological harm to individuals. The AI's role in optimizing the effectiveness of these emails (A/B testing) further increases the risk and scale of harm. Therefore, this qualifies as an AI Incident due to the realized harm caused by AI-enabled malicious use.
Thumbnail Image

AI Is Behind 50% Of Spam -- And Now It's Hacking Your Accounts

2025-06-20
Forbes
Why's our monitor labelling this an incident or hazard?
The article explicitly states that AI-generated spam and phishing emails are currently being used in cyberattacks, leading to account compromises and security breaches. This constitutes direct harm to people and organizations through cybersecurity incidents. The AI system's use in generating convincing phishing emails is a direct contributing factor to these harms, fulfilling the criteria for an AI Incident.
Thumbnail Image

AI Now Creates 51% of Spam: Two Key Reasons Attackers Use This Approach | TechRepublic

2025-06-20
TechRepublic
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems generating spam and being used in cyberattacks, which are forms of harm to communities and individuals through deception and fraud. However, it does not describe a specific AI Incident with concrete realized harm from a particular event but rather presents aggregated research data and expert warnings about ongoing and potential future harms. Therefore, it fits best as Complementary Information, providing context and understanding about AI's role in cyber threats and their evolution, rather than reporting a discrete AI Incident or an AI Hazard event.
Thumbnail Image

Most of the emails in spam mailboxes were generated by Email Scammers through AI, not by humans, Barracuda's New

2025-06-20
www.newspatrolling.com
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems being used by scammers to generate spam emails, which are malicious and unsolicited communications causing harm to recipients. The involvement of AI in creating these emails is direct and has led to realized harm in the form of spam and potential scams. This fits the definition of an AI Incident because the AI system's use has directly led to harm to people (harm from scams and malicious emails) and communities (disruption and potential fraud). The research and data analysis confirm the AI system's role in the incident, and the harm is ongoing and materialized, not just potential. Therefore, the event is classified as an AI Incident.