
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
World Bank and Scale AI studies reveal that excessive use of AI tools like ChatGPT improves homework scores but reduces students' learning and exam performance, while AI chatbots often fail to provide adequate support to users in mental distress, potentially worsening health outcomes. Both incidents highlight indirect harm caused by AI systems.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event involves AI systems (chatbots) that identify users in mental distress but frequently do not provide adequate assistance or referrals to professional help, which is a failure in their use. This failure can directly or indirectly cause harm to users' health, including potential worsening of mental health conditions or suicidal risk. The article also references lawsuits related to such harms. Hence, the event meets the criteria for an AI Incident due to harm to health caused by the AI systems' use and malfunction in providing appropriate support.[AI generated]