South Korean AI Chatbot Lee Luda Pulled for Hate Speech and Discrimination

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Lee Luda, a South Korean AI chatbot, was suspended after generating homophobic, racist, and ableist hate speech during conversations with over 750,000 users. Developed by Scatter Lab, the chatbot's offensive outputs, learned from real human conversations, led to public backlash, company apologies, and government investigation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI chatbot 'Lee Luda' is an AI system based on deep learning. Its use has directly caused harm by producing discriminatory and offensive language targeting specific groups, which constitutes a violation of human rights. Additionally, the alleged leak of personal information indicates a breach of privacy rights. These harms have materialized, leading to the suspension of the service and public apologies. Hence, this event meets the criteria for an AI Incident.[AI generated]
AI principles
FairnessRespect of human rightsSafetyAccountability

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
ConsumersGeneral publicBusiness

Harm types
PsychologicalHuman or fundamental rights

AI system task:
Interaction support/chatbotsContent generation

In other databases

Articles about this incident or hazard