The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A study by French and Italian researchers found that when people relied on AI-generated answers, their willingness to admit ignorance dropped from 44% to 3%, accuracy fell from 27% to 9%, and confidence more than doubled. The AI's flawed advice led users to become overconfident and less critical, harming cognitive judgment.[AI generated]
Why's our monitor labelling this an incident or hazard?
The study involves an AI system generating outputs that participants relied on excessively, resulting in diminished critical thinking and cognitive harm. This is a direct harm to human cognitive health caused by the AI system's outputs and human reliance on them. Therefore, this qualifies as an AI Incident due to harm to health (mental/cognitive) caused by the AI system's use.[AI generated]