Therapists Warn of Risks from Overreliance on Digital Health Apps

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Mental health professionals in Germany caution against high expectations for digital health apps, warning that reliance on unproven or misleading AI-driven self-help tools could worsen conditions like depression. They stress the need for quality assessment and proper integration with professional therapy to prevent potential harm to vulnerable users.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article discusses the use of digital health apps, which can be considered AI systems if they involve AI-based therapeutic interventions or recommendations. However, the article does not report any actual harm caused by these apps, nor does it describe a specific incident or malfunction. Instead, it highlights potential risks and the need for quality assessment, which implies a plausible risk of harm in the future but no realized harm yet. Therefore, this qualifies as an AI Hazard, as the use or development of these apps could plausibly lead to harm if misleading or ineffective apps are used by vulnerable individuals.[AI generated]
AI principles
SafetyRobustness & digital securityTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Psychological

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbotsOrganisation/recommenders


Articles about this incident or hazard