Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

RecourseBench



RecourseBench is an open, modular software framework for benchmarking algorithmic recourse methods that generate counterfactual explanations telling individuals what changes would be needed to reverse an unfavourable automated decision. Developed by researchers at the University of Waterloo, the framework decomposes the evaluation pipeline into five decoupled layers (Data, Processing, Model, Recourse Method, and Evaluation), allowing new datasets, models, and methods to be integrated without altering existing components. 

It features a four-tier reproducibility classification system that automatically tests whether each integrated method's implementation reproduces the results reported in its source publication, using a defined statistical tolerance and transparent per-method documentation of reproduction barriers (e.g. missing artifacts, undocumented hyperparameters). This turns reproducibility from an implicit assumption into a measurable, auditable property of the benchmark. 

Results are available through an interactive web interface that allows practitioners to configure comparisons by dataset, model architecture, method, and metric profile. It provides practical infrastructure for AI developers, auditors, and researchers seeking to select, evaluate, or govern recourse-generating systems. 

Auto-discovered on 2026-08-26 by OECD Catalogue Automation

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
Partnership on AI

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.