Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Biaslyze - The NLP Bias Identification Toolkit



Biaslyze - The NLP Bias Identification Toolkit

Bias is often subtle and difficult to detect in NLP models, as the protected attributes are less obvious and can take many forms in language (e.g. proxies, double meanings, ambiguities etc.). Therefore, technical bias testing is a key step in avoiding algorithmically mediated discrimination. However, it is currently conducted too rarely due to the effort involved, missing resources or lack of awareness for the problem.

The biaslyze python toolbox supports developers in facilitating an ethically responsible development and deployment of the NLP components they work with. For developers, researchers and teams with limited resources, the toolbox provides a low-effort access to bias testing and mitigation for NLP use cases and helps to get started with the analysis of bias within NLP models and offers a concrete entry point for further impact assessments and mitigation measures.

About the tool




Impacted stakeholders:



Country of origin:



Type of approach:









Enforcement:



Geographical scope:


People involved:



Tags:

  • ai ethics
  • biases testing
  • large language model
  • nlp
  • trustworthy ai
  • text understanding
  • ai auditing
  • bias
  • natural language processing
  • accountability
  • ai oversight
  • explainability
  • ethical risk

Modify this tool

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.