Madison Square Garden's AI Surveillance System Secretly Profiles and Scores Celebrities

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Madison Square Garden used AI-driven facial recognition and risk scoring systems to track, profile, and assign risk levels to thousands of celebrities and guests, including LGBTQIA individuals, based on personal attributes and social media activity. A database leak exposed these practices, raising concerns over privacy violations and discriminatory surveillance in New York.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (facial recognition and risk scoring) used in surveillance and profiling, which directly led to harm through privacy violations and exposure of sensitive personal data after a data breach. The involvement of AI in tracking and labeling individuals with risk scores and sensitive attributes, combined with the leak of this data, constitutes a violation of human rights and privacy. This meets the criteria for an AI Incident as the AI system's use directly led to harm.[AI generated]
AI principles
Privacy & data governanceFairness

Industries
Arts, entertainment, and recreation

Affected stakeholders
ConsumersOther

Harm types
Human or fundamental rights

Severity
AI incident

Business function:
Monitoring and quality control

AI system task:
Recognition/object detectionForecasting/prediction


Articles about this incident or hazard