California Enacts Laws Against AI-Generated Child Sexual Abuse Imagery

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

California Governor Gavin Newsom signed bipartisan bills criminalizing the creation, possession, and distribution of AI-generated child sexual abuse images and deepfake nudes. The new laws close legal loopholes, making such content illegal even if not depicting real individuals, in response to increasing misuse of generative AI tools.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly, specifically AI tools used to generate harmful sexual imagery and deepfakes. The misuse of these AI systems has directly led to harms including violations of human rights and sexual exploitation of minors and adults, which are clear harms under the AI Incident definition. The laws are a response to realized harms caused by AI-generated content, not just potential future harms. Therefore, this event qualifies as an AI Incident because it concerns the direct use of AI systems to produce illegal and harmful content affecting individuals' rights and safety.[AI generated]
AI principles
Respect of human rightsPrivacy & data governanceSafetyAccountabilityHuman wellbeing

Industries
Media, social platforms, and marketingGovernment, security, and defenceDigital security

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputationalPublic interest

AI system task:
Content generation


Articles about this incident or hazard