AI Misidentification of Mushroom Leads to User Poisoning in China

The AI system was used in a safety-critical context (wild mushroom identification) and its output directly influenced a user's harmful action (consuming a poisonous mushroom). The harm (acute kidney failure) is a serious injury to health caused indirectly by the AI system's use. Although the AI provided warnings, the user's blind trust and reliance on the AI led to the harm. This fits the definition of an AI Incident because the AI system's use directly or indirectly led to injury or harm to a person. The event is not merely a hazard or complementary information, as the harm has already occurred.

The AI system '豆包' was used to identify mushrooms, and its misclassification contributed to a user consuming a toxic mushroom, causing poisoning. This constitutes injury or harm to a person's health caused directly or indirectly by the AI system's use. Although the system included warnings, the misidentification and reliance on the AI output led to harm. Therefore, this qualifies as an AI Incident under the definition of harm to health caused by AI system use.

The AI system ('豆包') was used to identify wild mushrooms, and its misclassification led to a user consuming poisonous mushrooms, resulting in poisoning. This constitutes harm to a person's health caused indirectly by the AI system's use. The AI system's involvement in the incident is explicit, and the harm is realized. Therefore, this event qualifies as an AI Incident under the definition of injury or harm to a person's health caused directly or indirectly by the use of an AI system.

The AI system '豆包' was used to identify mushrooms, a task involving AI-based image recognition and classification. Although the AI included disclaimers about possible errors and risks, the user relied on the AI's output to consume a mushroom that was actually toxic, causing acute kidney failure. This is a direct harm to health caused indirectly by the AI system's use and the user's overreliance on it. Therefore, this event meets the criteria for an AI Incident as it involves injury to a person resulting from the use of an AI system.

An AI system is involved as the mushroom identification relies on image recognition AI. The event involves the use of the AI system and highlights a risk of harm to health due to misidentification leading to potential poisoning. Although no specific harm is reported as having occurred, the risk of harm (misidentification causing poisoning) is clearly stated and plausible. Therefore, this constitutes an AI Hazard because the AI system's use could plausibly lead to injury or harm to health, but no actual incident of harm is described.

An AI system (the mushroom identification tool) was used and provided an output with an explicit warning about the risk of misidentification. The user relied on the AI's output but ignored the warning, leading to serious health harm (acute kidney failure). This constitutes an AI Incident because the AI system's use directly contributed to the harm, even though the system included warnings. The event meets the criteria for an AI Incident as it involves injury to a person caused indirectly by the AI system's use and its limitations in safety-critical applications.