Spanish Regulator Warns of AI Investment Risks Without Human Oversight

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Spanish financial regulator CNMV found that large language models like ChatGPT, Gemini, DeepSeek, and Perplexity, when used for investment decisions without human supervision, frequently produce errors and hallucinations. These flaws could lead to significant financial losses, prompting calls for mandatory human oversight in AI-driven financial analysis.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (large language models) used autonomously for financial investment recommendations. The study identifies recurrent AI reasoning failures that could plausibly lead to financial harm (losses) for investors if used without human oversight. Since no actual harm is reported but the risk of harm is credible and significant, this qualifies as an AI Hazard rather than an AI Incident. The article focuses on potential risks and operational hazards inherent in autonomous AI use in investing, fitting the definition of an AI Hazard.[AI generated]
AI principles
AccountabilitySafety

Industries
Financial and insurance services

Affected stakeholders
ConsumersBusiness

Harm types
Economic/Property

Business function:
Accounting

AI system task:
Forecasting/prediction


Articles about this incident or hazard