Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Responsible innovation toolkit: Judgement call



Responsible innovation toolkit: Judgement call

Judgment Call is an award-winning responsible innovation game and team-based activity that puts Microsoft's AI principles of fairness, privacy and security, reliability and safety, transparency, inclusion, and accountability into action. The game provides an easy-to-use method for cultivating stakeholder empathy through scenario-imagining.

Technology builders need practical methods to incorporate ethics in product development, by considering the values of diverse stakeholders and how technology may uphold or not uphold those values. The goal of the game is to imagine potential outcomes of a product or platform by gaining a better understanding of stakeholders, and what they need and expect.

The game helps people discuss challenging topics in a safe space within the context of gameplay, and gives technology creator a vocabulary to facilitate ethics discussions during product development. It gives managers and designers an interactive tool to lead ethical dialogue with their teams to incorporate ethical design in their products.

The game includes the following elements:

  • Identify the product: identifying the product of interest.
  • Defining roles: identifying stakeholders impacted by the technology and ethical principles linked to it.
  • Brainstorm and identify stakeholders: understand the direct and indirect impacts of the technology.
  • Scenarios: identifying scenarios and corresponding actions.

 

 

About the tool


Developing organisation(s):


Objective(s):


Country of origin:


Type of approach:





Geographical scope:


Tags:

  • ai ethics
  • social impact
  • robustness

Modify this tool

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.