Report Warns of Risks in Agentic AI Procurement Prioritizing Approval Over Capability

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A report by the Actuaries Institute warns that companies adopting agentic AI may prioritize tools that are easier to approve through cybersecurity and procurement processes over more capable alternatives, potentially leading to inadequate AI performance and increased business risks. The report urges stronger governance and monitoring to mitigate these hazards.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article focuses on potential risks and governance challenges related to the adoption of agentic AI systems, emphasizing plausible future harms if inadequate controls are applied. It does not report any actual harm or incident resulting from AI use, nor does it describe a specific event where AI caused injury, rights violations, or other harms. Therefore, it fits the definition of an AI Hazard, as it outlines circumstances where AI use could plausibly lead to harm, but no harm has yet occurred. It is not Complementary Information because it is not updating or responding to a past incident but rather providing a forward-looking risk assessment.[AI generated]
AI principles
AccountabilityRobustness & digital security

Industries
Business processes and support servicesDigital security

Affected stakeholders
Business

Harm types
Economic/Property

Business function:
Procurement

AI system task:
Goal-driven organisation


Articles about this incident or hazard