Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Type

Clear all

Fairness

Clear all

Origin

Scope

SUBMIT A TOOL

If you have a tool that you think should be featured in the Catalogue of AI Tools & Metrics, we would love to hear from you!

SUBMIT
Approach Technical
Objective Fairness

TechnicalUploaded on May 23, 2023
This repository contains a sample implementation of Gradient Feature Auditing (GFA) meant to be generalizable to most datasets.

Objective(s)


TechnicalUploaded on Mar 27, 2023<1 day
A fully independent and impartial audit to ensure compliance with the bias audit requirements for New York City Local Law 144 and upcoming regulations.

TechnicalUploaded on Mar 27, 2023<1 day
A bespoke AI risk audit solution tailor-made to identify your enterprise project’s AI risks, comprising deep technical, quantitative analysis.

TechnicalUploaded on Feb 23, 2022

Open Sourced Bias Testing for Generalized Machine Learning Applications audit-AI is a Python library built on top of pandas and sklearn that implements fairness-aware machine learning algorithms. audit-AI was developed by the Data Science team at pymetrics

Objective(s)


TechnicalUploaded on Feb 23, 2022

Aequitas is an open source bias and fairness audit toolkit that is an intuitive and easy to use addition to the machine learning workflow, enabling users to seamlessly test models for several bias and fairness metrics in relation to multiple population sub-groups. Aequitas facilitates informed and equitable decisions around developing and deploying algorithmic decision making […]

Objective(s)


catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.