The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Connie Ansaldi's startup launched 'CUX', an AI-based mental health app, contracted by Trenque Lauquen municipality to provide psychological support without professional oversight. Mental health experts warned of legal and safety risks, prompting public backlash and eventual cancellation of the service despite Ansaldi's defense as a non-diagnostic tool.[AI generated]
Why's our monitor labelling this an incident or hazard?
The app is an AI system providing mental health assistance, which is a sensitive domain where misuse or malfunction can lead to harm to users' health. The professionals' recommendation to stop using the service suggests concerns about possible harm or inadequacy. However, the article does not report any actual injury, health harm, or rights violation that has occurred. Therefore, this event represents a plausible risk of harm due to the AI system's use, qualifying it as an AI Hazard rather than an AI Incident. There is no indication that this is merely complementary information or unrelated news.[AI generated]