Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Mozilla Open Source Audit Tooling (OAT) Project



Mozilla Open Source Audit Tooling (OAT) Project

Over the coming year, Mozilla is running the Open Source Audit Tooling (OAT) Initiative to identify the resources and tools needed to support algorithmic auditors, and to make thorough and consequential AI scrutiny the status quo.

Timeline

Phase 1 | Open Source Audit Tools Survey and Taxonomy

In this phase, we will articulate the need for algorithmic audit tools and gaps in audit tool development; map out the known design space for audit tool development in AI and other industries; develop a taxonomy of considerations; and map out categories of tools and the needed resources for development for these tools.

Phase 2 | Exploration of Interventions for Improved Audit Tool Development

In this phase, we will brainstorm potential interventions to address gaps in effective audit execution and tool development; assess the value of doing a public challenge to promote open-source development of algorithmic auditing tools and benchmarks; and map out opportunities for Mozilla to get involved in auditing space and operate a hub for open source audit tools and datasets.

Phase 3 | Implementation of Prioritized Intervention for Audit Tool Development

In this phase, we will plan and launch audit challenges and/or product development, invite participants to engage in an implemented solution; and launch workshop meetings with key audit tool development stakeholders.

About the tool


Developing organisation(s):


Tool type(s):



Impacted stakeholders:


Type of approach:






Stakeholder group:



Geographical scope:


Modify this tool

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.