AI Recipe Generators Pose Health Risks with Dangerous Outputs

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered recipe generators integrated into devices from Apple, Samsung, and Google have produced hazardous recipes, including one combining bleach and ammonia, which can create deadly chlorine gas. This raises serious health concerns and highlights the risks of relying on AI-generated cooking advice.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly references an AI recipe generator producing a recipe that could cause deadly chlorine gas, which is a direct harm to health. This meets the criteria for an AI Incident as the AI system's use has directly led to a significant harm. While the article also discusses broader societal and economic concerns, the presence of a concrete example of dangerous AI-generated content causing potential physical harm is decisive. The involvement of AI in recipe generation and the resulting health risk is clear and direct, fulfilling the definition of an AI Incident.[AI generated]
AI principles
SafetyRobustness & digital securityAccountabilityTransparency & explainabilityHuman wellbeing

Industries
Consumer productsFood and beveragesHealthcare, drugs, and biotechnology

Affected stakeholders
ConsumersGeneral publicBusiness

Harm types
Physical (injury)Physical (death)Economic/PropertyReputational

Severity
AI incident

Business function:
Citizen/customer service

AI system task:
Content generationInteraction support/chatbots


Articles about this incident or hazard

Thumbnail Image

AI can generate recipes that can be deadly. Food bloggers are not happy

2024-09-23
NPR
Why's our monitor labelling this an incident or hazard?
The article explicitly references an AI recipe generator producing a recipe that could cause deadly chlorine gas, which is a direct harm to health. This meets the criteria for an AI Incident as the AI system's use has directly led to a significant harm. While the article also discusses broader societal and economic concerns, the presence of a concrete example of dangerous AI-generated content causing potential physical harm is decisive. The involvement of AI in recipe generation and the resulting health risk is clear and direct, fulfilling the definition of an AI Incident.
Thumbnail Image

AI can generate recipes that can be deadly. Food bloggers are not happy

2024-09-23
KUOW-FM (94.9, Seattle)
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions an AI recipe generator producing a recipe involving water, bleach, and ammonia that could create deadly chlorine gas, which is a direct health hazard. This shows that the AI system's use has led to a potential or actual harm scenario. Additionally, the article discusses the broader negative impact on food bloggers' livelihoods, which is a form of harm to communities or economic harm. Therefore, this qualifies as an AI Incident due to the realized or plausible harm caused by the AI system's outputs.
Thumbnail Image

AI can generate recipes that can be deadly. Food bloggers are not happy

2024-09-23
KOSU
Why's our monitor labelling this an incident or hazard?
The article explicitly references an AI recipe generator producing a recipe that could cause deadly chlorine gas, which is a direct health hazard to users following such instructions. This meets the definition of an AI Incident as the AI system's use has directly led to harm to health (a). The discussion about the threat to food bloggers' livelihoods and cultural concerns, while important, does not constitute direct harm but contextualizes the impact. The presence of AI systems generating recipes and the documented dangerous output justifies the classification as an AI Incident rather than a hazard or complementary information.