Generative AI Fuels Misleading Ads and Deepfake Violations in Marketing

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Generative AI is increasingly used to create fabricated and unrealistic advertising content, including deepfake videos and images, leading to consumer deception and unauthorized use of individuals' likenesses. Companies like Instacart and various delivery apps have withdrawn misleading AI-generated ads, while regulators review the growing risks to consumer trust and personal rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use and misuse of generative AI systems to create fabricated advertising content and deepfake videos that have directly led to violations of individuals' rights (unauthorized use of likenesses) and harm to consumers through misleading advertisements. The harms are realized, not just potential, as unauthorized deepfake ads have been distributed widely, causing reputational and personal harm. Therefore, this qualifies as an AI Incident due to the direct link between AI system use and violations of rights and harm to communities (consumers).[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsTransparency & explainabilitySafety

Industries
Media, social platforms, and marketing

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Advertising: Don't believe what you see in the age of AI ads

2024-03-11
MoneyControl
Why's our monitor labelling this an incident or hazard?
The event involves the use and misuse of generative AI systems to create fabricated advertising content and deepfake videos that have directly led to violations of individuals' rights (unauthorized use of likenesses) and harm to consumers through misleading advertisements. The harms are realized, not just potential, as unauthorized deepfake ads have been distributed widely, causing reputational and personal harm. Therefore, this qualifies as an AI Incident due to the direct link between AI system use and violations of rights and harm to communities (consumers).
Thumbnail Image

Don't Believe What You See in the Age of AI Ads

2024-03-11
Bloomberg Business
Why's our monitor labelling this an incident or hazard?
The article describes the use of generative AI systems to create fabricated images for advertising purposes, which can mislead consumers by presenting unrealistic depictions of food. However, there is no direct or indirect harm reported such as injury, rights violations, or disruption. The issue is about misleading advertising, which is a concern but not explicitly linked to legal violations or significant harm in this context. Therefore, it does not meet the threshold for an AI Incident or AI Hazard. It provides contextual information about AI's impact on advertising practices, making it Complementary Information.
Thumbnail Image

Generative AI could give advertising its worst ever crisis of credibility

2024-03-12
mint
Why's our monitor labelling this an incident or hazard?
The event involves the use and misuse of generative AI systems to create deepfake content and fake advertisements that have directly led to harms including unauthorized use of personal likenesses (violations of rights) and misleading consumers (harm to communities). The AI system's role is pivotal in generating these deceptive contents. Therefore, this qualifies as an AI Incident. The discussion of regulatory responses and disclaimers is complementary information but secondary to the primary incident of harm caused by AI misuse.
Thumbnail Image

Don't believe what you see in the age of AI ads

2024-03-11
Deccan Herald
Why's our monitor labelling this an incident or hazard?
The event involves the use of generative AI systems to create fabricated advertising content that misrepresents products. This constitutes a harm to consumers through misleading advertising, which can be considered harm to communities or consumers. Since the AI system's use has directly led to misleading content that affects consumer perception and trust, this qualifies as an AI Incident under the framework's definition of harm to communities or other significant harms where AI's role is pivotal.
Thumbnail Image

Don't believe what you see in the age of AI ads, Columns - THE

2024-03-11
The Business Times
Why's our monitor labelling this an incident or hazard?
The article highlights the use of generative AI in advertising to create unrealistic images, which could mislead consumers. While this raises concerns about misinformation or deceptive advertising, the article does not report any actual harm or legal violations occurring due to these AI-generated ads. There is no indication that the AI use has directly or indirectly caused injury, rights violations, or other harms, nor does it suggest a plausible future harm beyond general caution. Therefore, this is best classified as Complementary Information, providing context and awareness about AI's impact on advertising practices without reporting a specific AI Incident or AI Hazard.