AI Chatbots Generate False Information, Leading to Real-World Harm

The article explicitly involves AI systems (large language model chatbots) whose malfunction (hallucination) has directly led to the dissemination of false information, including fabricated legal cases used in a real court submission, which constitutes harm to communities and potentially to individuals relying on this information. The presence of AI is clear, the malfunction is described in detail, and the harms are realized and significant. Hence, this is an AI Incident rather than a hazard or complementary information.

The event involves AI systems (chatbots) and their malfunction in generating false information, which can lead to harm if users rely on incorrect outputs, particularly in sensitive contexts. However, the article reports on the general occurrence and research findings about hallucinations without describing a specific incident causing realized harm or a particular event where harm occurred. Therefore, it does not describe a concrete AI Incident or a specific AI Hazard but rather provides complementary information about a known AI system limitation and its implications.

The event involves AI systems (chatbots) whose use leads to the generation of false information, which can plausibly cause harm if relied upon in critical contexts such as legal or medical domains. However, the article does not report a concrete harm event but rather quantifies the frequency of hallucinations and warns about the risks. Therefore, this constitutes an AI Hazard, as the development and use of these AI systems could plausibly lead to incidents of misinformation causing harm, but no specific harm has been documented in this report.

The article clearly involves AI systems (large language models powering chatbots) and discusses their use and malfunction (hallucination leading to false information). The hallucinations have led to misinformation being generated and used in contexts such as legal briefs, which can cause harm to individuals or groups relying on accurate information, thus constituting harm to communities and potentially violations of rights to accurate information. Since the hallucinations are occurring and have caused real misinformation, this qualifies as an AI Incident. The article does not merely warn about potential future harm but documents ongoing harm caused by AI system outputs.

The article explicitly involves AI systems (large language model chatbots) and their malfunction in the form of hallucination—generating false information. While no specific harm event is reported, the article clearly outlines the plausible risk of harm in sensitive applications (legal briefs, medical info, business data). This fits the definition of an AI Hazard: an event or circumstance where AI system malfunction could plausibly lead to harm. The article's focus is on the risk and prevalence of hallucination, not on a realized incident, so it is not an AI Incident. It is also not merely complementary information, as it centers on the hazard itself rather than responses or ecosystem updates. Hence, the classification is AI Hazard.

The article explicitly involves AI systems (large language model chatbots) and their use leading to the generation of false information ('hallucinations'). This misinformation can cause harm to individuals and communities, especially when used in sensitive contexts such as legal or medical domains. The harm is realized as the chatbots have already produced false outputs that have been used (e.g., fabricated legal cases submitted to courts). Hence, this qualifies as an AI Incident due to direct harm caused by the AI systems' outputs. The article does not merely warn about potential future harm but documents ongoing issues and their impacts.

The article describes the use and malfunction (hallucination) of AI systems (chatbots based on large language models) that produce false information. Although no specific incident of harm is reported, the article emphasizes the plausible risk that such hallucinations could cause harm in legal, medical, or business settings if the false information is trusted and acted upon. This fits the definition of an AI Hazard, as the development and use of these AI systems could plausibly lead to harms such as misinformation causing harm to individuals or communities, or violations of rights through incorrect legal or medical advice. The article does not report a realized harm or incident, nor does it focus on governance responses or complementary information primarily. Therefore, the correct classification is AI Hazard.