Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

PrivFair



PrivFair is a library for auditing the fairness of machine learning (ML) models while protecting the privacy of both the model and the data used in the audit. ML models used in healthcare, justice and finance have been found to discriminate based on sensitive attributes such as gender, race or disability. Checking a model for bias requires data about these sensitive characteristics, which is protected by anti-discrimination and data protection law. Existing fairness auditing libraries offer no way to protect the privacy of this audit data. PrivFair addresses this gap. It was published in February 2022.

PrivFair uses Secure Multiparty Computation (MPC), a cryptographic technique that lets several parties jointly compute a result without revealing their own inputs to each other. This supports a common real-world scenario: a company owns a proprietary AI model, and an external investigator, such as a regulator or researcher, holds sensitive data needed to audit it.

With PrivFair, the investigator does not have to disclose their data to anyone in unencrypted form. The company also does not have to reveal its model parameters to anyone in plain text. Both parties keep their information confidential, while the audit still produces a reliable assessment of the model's fairness. The authors demonstrate PrivFair for group fairness audits, which compare model outcomes across demographic groups, using both tabular data and image data.

Auto-discovered on 2026-02-11 by OECD Catalogue Automation

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
Partnership on AI

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.