AI-Generated Images Fuel Misinformation and Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-generated image falsely depicting Israeli soldiers celebrating Hanukkah in Gaza went viral, spreading misinformation about the conflict. Separately, Meta has been found to scrape users' photos from Facebook and Instagram without clear consent to train its AI image generator, raising significant privacy and consent concerns.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly states that Meta scrapes about one billion images from users' social media feeds without clear consent to train and operate an AI image generator. This involves the development and use of an AI system that indirectly harms users by violating their privacy and consent rights, which are fundamental rights protected under applicable law. The harm is realized as users become unwilling participants in AI training without informed consent, constituting a violation of rights. Although no physical injury or direct property harm is described, the privacy breach and lack of consent are significant harms under the framework. Hence, this event is best classified as an AI Incident.[AI generated]
AI principles
Privacy & data governanceTransparency & explainabilityAccountabilityRespect of human rightsDemocracy & human autonomySafety

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rightsPublic interestReputational

Severity
AI incident

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Meta Is Scraping Our Photos From Facebook And Instagram To Create AI Images

2023-12-12
Forbes
Why's our monitor labelling this an incident or hazard?
The article explicitly states that Meta scrapes about one billion images from users' social media feeds without clear consent to train and operate an AI image generator. This involves the development and use of an AI system that indirectly harms users by violating their privacy and consent rights, which are fundamental rights protected under applicable law. The harm is realized as users become unwilling participants in AI training without informed consent, constituting a violation of rights. Although no physical injury or direct property harm is described, the privacy breach and lack of consent are significant harms under the framework. Hence, this event is best classified as an AI Incident.
Thumbnail Image

How To Detect AI-Generated Images? Don't Be Fooled, Here Are Some Easy Ways To Spot A Fake

2023-12-14
english
Why's our monitor labelling this an incident or hazard?
The article focuses on raising awareness about AI-generated images and their potential misuse for disinformation, which is a recognized harm. However, it does not report a concrete incident of harm caused by a particular AI system, nor does it describe a specific event where harm has occurred or a near miss. It also does not present a new credible warning about a specific AI hazard beyond general concerns. Therefore, it fits best as Complementary Information, providing context and guidance related to AI-generated content and its societal implications without reporting a new AI Incident or AI Hazard.
Thumbnail Image

FACT CHECK: Image Of Israeli Soldiers Celebrating Hanukkah Appears To Be AI-Generated

2023-12-14
Check Your Fact
Why's our monitor labelling this an incident or hazard?
The image was generated by an AI system (a generative AI tool) and is being used to spread false information about a sensitive conflict situation. This constitutes harm to communities through misinformation, which is a recognized form of harm under the AI Incident definition. The AI system's use directly led to the creation and dissemination of misleading content, fulfilling the criteria for an AI Incident.