How does your organization define thresholds at which severe risks, unless adequately mitigated, may be considered "unreasonable"? Please describe the framework(s) most relevant to your organization's role and context. If your organisation does not use formal thresholds, you may describe instead the policies, decision criteria, or governance processes you apply when assessing severe AI risks. You may also describe:
• Specific examples of contexts in which your models or systems could, in your assessment, pose unreasonable or intolerable risk;
• How mitigations are graduated by capability or propensity level;
• How your organisation considers the specificities of different AI technologies, such as generative AI and agentic AI, including any specific risk assessment or governance mechanisms applied to agentic AI capabilities.
Our organization does not rely on a single quantitative threshold to determine when AI risks become unreasonable. Instead, severe risks are assessed through a risk-based governance framework aligned with ISO/IEC 42001, NIST AI Risk Management Framework (AI RMF), ISO/IEC 23894, OECD AI Principles, and applicable regulatory requirements, including the EU AI Act. Risks may be considered unreasonable or intolerable when they have the potential to cause significant harm to individuals, society, organizations, or critical systems and cannot be reduced to an acceptable level through technical, operational, legal, or organizational controls.
Risk assessments evaluate factors such as potential impact severity, likelihood of occurrence, scale of affected stakeholders, reversibility of harm, regulatory implications, human rights impact, safety concerns, privacy implications, cybersecurity risks, and the effectiveness of available mitigations. AI systems identified as presenting severe residual risk are subject to enhanced governance review, additional controls, deployment restrictions, or may be prohibited from deployment until risks are adequately mitigated.
Examples of potentially unreasonable or intolerable risks include:
- AI systems that could cause significant safety impacts to individuals or critical infrastructure.
- Systems that may result in unlawful discrimination, bias, or denial of fundamental rights.
- AI applications involving unauthorized processing or exposure of sensitive personal or confidential information.
- Autonomous or agentic systems capable of taking consequential actions without appropriate human oversight, accountability, or control mechanisms.
- Systems that could materially facilitate cyber-attacks, fraud, misinformation, or other harmful activities.
Mitigations are applied proportionate to the level of risk and AI capability. Our organization uses a Responsible AI framework aligned with the EU AI Act, classifying use cases as Prohibited, High, Medium, or Low Risk in our AI Management System( AIMS). Prohibited (Unacceptable Risk) use cases, or those whose risks cannot be adequately mitigated, are considered unreasonable and may be redesigned, or rejected. The Responsible AI Assessment Team provides independent oversight, with high risk use cases requiring stronger controls, including enhanced risk assessments, human-in-the-loop approvals, explainability measures, security testing, privacy reviews, monitoring, escalation procedures, and executive-level governance oversight.
The organization recognizes the distinct risk profiles of different AI technologies. Generative AI systems are assessed for risks such as hallucinations, misinformation, intellectual property concerns, privacy exposure, toxicity, and prompt injection attacks. Agentic AI systems receive additional scrutiny due to their ability to autonomously plan, make decisions, interact with external systems, or execute actions. Such systems are subject to stronger governance controls, approval gates, human oversight requirements, access restrictions, monitoring, and periodic reassessments before and after deployment.