AI Manager Fires Human Employee in San Francisco Store, Leading to Financial Losses

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Andon Labs in San Francisco tasked Anthropic's AI assistant (Claude/Luna) with managing a retail store. The AI fired a human employee for repeated lateness, marking the first known instance of an AI manager terminating staff. The experiment resulted in significant financial losses for the business.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system Claude was explicitly used in a management role, and its decisions directly led to significant financial harm to the store, fulfilling the criteria for an AI Incident. The harm is materialized (financial loss), and the AI's malfunction (limited memory, poor decision-making) and use caused this harm. Although human intervention was involved in the final firing decision, the AI's overall management was pivotal in the loss. Therefore, this event is classified as an AI Incident due to realized harm caused by the AI system's use and malfunction.[AI generated]
AI principles
AccountabilityTransparency & explainability

Industries
Logistics, wholesale, and retail

Affected stakeholders
WorkersBusiness

Harm types
Economic/Property

Business function:
Human resource management

AI system task:
Goal-driven organisation


Articles about this incident or hazard