Chinese Man Sues AI App After Burial Date Advice Precedes Family Tragedy

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Jiaxing, China, a man used the AI app "Doubao" to select a burial date for his mother. The app's conflicting advice led to confusion, and after the funeral, a relative was seriously injured in a car accident. The man blamed the AI's recommendation and sued the software company, sparking legal debate over AI liability.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to select a burial date, and its conflicting advice led to confusion and a decision that preceded a relative's serious car accident injury. The AI's role is indirect but pivotal in the chain of events leading to harm. The lawsuit and legal considerations further highlight the AI's involvement. Therefore, this qualifies as an AI Incident due to indirect harm caused by the AI system's use and its impact on human decisions resulting in injury.[AI generated]
AI principles
AccountabilitySafety

Industries
Consumer services

Affected stakeholders
General public

Harm types
Physical (injury)

AI system task:
Organisation/recommenders


Articles about this incident or hazard