Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

LangBiTe



LangBiTe

LangBiTe is a comprehensive testing platform designed to systematically assess the presence of bias within LLMs. LangBiTe empowers development teams to determine test scenarios adapted to their specific needs, and automates the generation and execution of test cases based on a set of ethical requirements specifically defined by the user. It includes a customizable template library with over 300 multi-language questions and hypothetical scenarios to prompt text-to-text LLMs. LangBiTe can be seamlessly incorporated into the development practice in order to ensure a system embedding LLM-based features does not inadvertently exhibit discriminatory behaviors contrary to regulations on AI and the interest of society.

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.