Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Type

Origin

Scope

SUBMIT A TOOL

If you have a tool that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!

Submit

TechnicalCanadaUploaded on Nov 6, 2026
FAIRLENS is a benchmark and evaluation framework for measuring fairness (across demographic attributes such as gender, race, and age) and response validity of vision-language models used in high-stake...

TechnicalSwitzerlandUploaded on Nov 5, 2026
EduFair-Bench is a benchmark for auditing the pedagogical fairness of LLM tutors. It tests whether tutoring quality changes with student demographics. Tutors guide a simulated student through maths, physics and chemistry problems. The student’s demographic profile varies across gender, immigration background, first language and socioeconomic status. An LLM judge validated against human annotators scores each turn on five teaching metrics. Paired statistical tests measure bias.

TechnicalUploaded on Nov 4, 2026
AI Bias Auditing Tool is a Python tool for detecting bias in tabular datasets. Users upload a CSV file and choose a sensitive attribute and an outcome column. The tool calculates approval rates for each group. It then measures the Demographic Parity Difference using Fairlearn. Results are shown as charts and a short bias audit report. The tool runs in Google Colab and is designed for beginners.

TechnicalUnited StatesUploaded on Oct 12, 2026
TrustLLM is a framework and open-source toolkit for evaluating the trustworthiness of large language models. It was presented at ICML 2024 by an international team led by researchers in the United States. It proposes principles for trustworthy models and a benchmark covering truthfulness, safety, fairness, robustness, privacy and machine ethics. The benchmark draws on more than 30 datasets. A public leaderboard ranks 16 leading models. The code is released under the MIT licence.

Objective(s)

Related lifecycle stage(s)

Operate & monitorVerify & validate

TechnicalIndiaUploaded on Oct 7, 2026
AiEnsured is a commercial testing platform for AI products, designed to support the deployment of responsible AI. It is developed in India. The platform brings together fairness and bias evaluation, explainability, adversarial robustness testing and privacy and GDPR compliance checks. It also generates test cases automatically, including rare and extreme inputs. Further features cover experiment management, model comparison and performance testing. After deployment, it monitors models for concept drift, which can reduce accuracy over time.

TechnicalUploaded on Nov 5, 2026
AgentFairBench is a multi-domain benchmark for measuring demographic disparity in the actions produced by LLM agents, rather than only the fairness of their written answers. It evaluates whether agent...

TechnicalUploaded on Sep 25, 2026
IndoBias is a benchmark for evaluating social bias in large language models in Indonesian and three local languages. It was developed by researchers at the Mohamed bin Zayed University of Artificial Intelligence and Universitas Indonesia. One track tests whether models prefer stereotypical sentences over neutral ones. A second track tests whether models describe local groups and institutions more positively or negatively. The results show strong stereotypical bias in current models, especially regarding ideology and religion in local languages.

TechnicalUploaded on Oct 2, 2026
F2Bench is a benchmark for evaluating fairness in large language models that also considers factual accuracy. It was developed by researchers at Inner Mongolia University and Xiamen University. The benchmark contains 2 568 test instances across ten demographic categories, including intersectional combinations. One task tests whether models accept biased conclusions after gradual stereotypical suggestions in a conversation. A second task tests whether models avoid stereotypes while still reflecting real statistics accurately. The code and dataset are publicly available.

Objective(s)

Related lifecycle stage(s)

Operate & monitorVerify & validate

TechnicalUnited StatesUploaded on Sep 26, 2026
M4 Bias Eval FairFace is a dataset for evaluating social bias in vision-language models. It was created by Hugging Face to assess its IDEFICS models. It contains around 11,000 face images labelled by perceived gender, ethnicity and age. For each image, two models wrote a résumé, a dating profile and a news article about an arrest. Comparing these texts across demographic groups reveals stereotypes the models have learned. The dataset is released under a CC BY 4.0 licence.

TechnicalKoreaUploaded on Sep 26, 2026
FLEX is a benchmark for testing whether large language models stay fair when prompts are designed to induce bias. It was developed by researchers at Korea University. The benchmark contains 3,145 multiple-choice questions from established fairness datasets, each combined with an adversarial prompt. These include assigning negative personas, forbidding refusals and introducing small text changes. Results show that models appearing fair on standard benchmarks can still be easily manipulated. The data and code are available for research purposes.

TechnicalUnited StatesUploaded on Sep 26, 2026
CEB (Compositional Evaluation Benchmark for Fairness) is a fairness evaluation benchmark containing about 11 000 samples spanning multiple bias types, social groups, and tasks. It enables consistent measurement of compositional fairness behavior to identify failures that occur when fairness conditions combine across groups and bias factors. It is used by developers and auditors to support the fairness and accountability objectives, and to assess robustness of fairness performance under varied evaluation settings.

TechnicalIndiaUploaded on Sep 26, 2026
ASR-FairBench is an online leaderboard that ranks speech recognition systems on both accuracy and fairness. It was developed by researchers at IIT Kharagpur. The leaderboard tests models on recordings from speakers of different ages, genders, ethnicities and backgrounds. It measures how error rates differ across these groups and combines this with overall accuracy into a single score. Models are rated from "severely biased" to "exemplarily fair". Users can submit their own models and receive a fairness audit within minutes.

TechnicalUploaded on Sep 26, 2026
Audit the Judge is an open-source tool for checking whether large language models used as judges evaluate answers reliably. It builds answer pairs where the correct verdict is known. These test whether the judge invents preferences between equal answers or favours answers shown first or written at greater length. Results are presented in a one-page report with statistical confidence intervals. The tool works with any major LLM judge. It is written in Python and released under the MIT licence.

TechnicalItalyUnited StatesUploaded on Sep 26, 2026
FairnessEval is an open-source framework for evaluating the fairness of machine learning models. It was developed by the University of Modena and Reggio Emilia with Microsoft. Users can load real or synthetic datasets and run fairness-aware models from toolkits such as Fairlearn and AIF360. The framework compares models on fairness, accuracy and training time, and presents the trade-offs in charts. It supports both selecting a suitable model and validating its performance under changing conditions.

TechnicalSwedenUploaded on Sep 27, 2026
FairX is an open-source toolkit for benchmarking machine learning models on fairness, data utility and explainability. It was developed by researchers at Linköping University. Users load tabular or image datasets and apply bias-mitigation methods before, during or after model training, including fair generative models that create synthetic data. FairX evaluates results using fairness, performance and synthetic data quality metrics. This lets users compare trade-offs between fairness and utility. It is written in Python and released under the MIT licence.

TechnicalUploaded on Sep 27, 2026
Fairmetrics is an open-source R package for evaluating the group fairness of machine learning models. It was developed by researchers at the University of Toronto. The package calculates a wide range of fairness metrics, such as statistical parity and equal opportunity. Unlike most fairness tools, it also provides confidence intervals for each metric. This shows whether differences between groups are statistically significant or due to random variation. It is available on CRAN under the MIT licence.

Related lifecycle stage(s)

Operate & monitorVerify & validate

TechnicalItalyUploaded on Sep 27, 2026
MANILA is a web-based, low-code application for benchmarking machine learning models and methods that reduce bias. It helps users find the combination that offers the best balance between fairness and performance. MANILA models a fairness benchmarking workflow as a set of options, such as datasets, models and metrics. Rules between these options guide users and prevent experiments that would fail. This makes fairness benchmarking accessible to users with little or no programming experience.

TechnicalUnited StatesUploaded on Sep 16, 2026
FLARE-AI is an open-source AI flaw and incident reporting platform that lets anyone document a flaw in any AI system and route a single, standardised report to multiple developers and coordinators at once. It enables any AI actor to document vulnerabilities, biases, or incidents and route a single, standardised (JSON-LD) report to multiple developers, coordinators, and registries in the ecosystem.

Related lifecycle stage(s)

Operate & monitorVerify & validate

TechnicalUploaded on Sep 14, 2026
Toolkit for evaluating fairness and bias in machine learning models using multiple subgroup fairness metrics (including parity and equalized-odds-style measures). It supports fairness auditing by quantifying disparities across demographic or other defined subgroups. Data scientists and developers can use it to verify and validate fairness properties and to guide improvements toward fairer model behavior.

Related lifecycle stage(s)

Operate & monitorVerify & validate

ProceduralUploaded on Sep 14, 2026
The AIM Framework (Awareness, Identification, Mitigation) presents a stepwise approach for the implementation of risk management strategies. The framework is intended for AI developers working in private, academic, or public sectors. It features a checklist with indicative scenarios for awareness-raising and training purposes.

Partnership on AI

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.