Protesters Warn of AI Risks at Anthropic's IPO in San Francisco

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

On the day of Anthropic's IPO in San Francisco, around 100 protesters, including AI safety researchers and former employees, demonstrated against the company's pursuit of increasingly powerful AI. They called for a ban on recursive self-improvement in AI, citing existential risks if such technology becomes uncontrollable.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (Claude by Anthropic) and concerns about its development trajectory, specifically the risk of recursive self-improvement leading to uncontrollable AI. While no direct or indirect harm has occurred yet, the protesters and experts highlight plausible future risks of existential harm. The article's main focus is on the potential for harm and the need for regulation, not on any realized incident. Hence, it fits the definition of an AI Hazard, as it plausibly could lead to an AI Incident in the future if unchecked.[AI generated]
AI principles
SafetyDemocracy & human autonomy

Industries
General or personal use

Affected stakeholders
General public

Harm types
Public interest

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard