Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Ethical Problem Solving



Ethical Problem Solving

The Ethical Problem Solving (EPS) framework is a comprehensive approach designed to bridge the gap between ethical principles and their practical implementation in artificial intelligence (AI) systems. EPS operates within an Ethics as a Service (EaaS) framework, focusing on human-centered evaluation and guidance.

EPS consists of two main stages: evaluation and recommendation, which are facilitated by various tools and methodologies. The evaluation stage begins with a pre-algorithmic impact assessment (pre-AIA), where the potential impact of an AI system is preemptively gauged. This initial assessment informs subsequent Algorithmic impact assessments (AIAs), covering data protection, privacy, antidiscrimination, and consumer rights. These AIAs utilize legally binding standards to evaluate AI systems' implications objectively.

Following the evaluation stage, EPS involves ethical framing, where human evaluators classify the system's impact based on ethical principles and levels of recommendation. This is followed by the recommendation stage, which utilizes the WHY-SHOULD-HOW methodology. In the WHY step, the relevancy of each ethical principle is explained, highlighting paradigmatic cases. The SHOULD component provides metric recommendations for each principle, while the HOW component offers practical tools and strategies for implementation.

Finally, the EPS framework provides various tools to assist in the ethical evaluation and implementation of AI systems. These tools include multiple surveys for AIAs and ethical troubleshooting to ensure a human-centric approach. Additionally, the framework offers normative guidance and practical tools tailored to each ethical principle, aiding developers in addressing potential ethical concerns.

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.