Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Type

Clear all

Digital Security

Origin

Scope

SUBMIT A TOOL

If you have a tool that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!

Submit
Objective Digital Security

TechnicalInternationalUploaded on Jun 3, 2026
The AI red team service exposes hidden safety and security threats across the entire lifecycle of artificial intelligence (AI) systems by applying an adversarial mindset to assess AI systems during design, development, deployment, and operations stages.

TechnicalUploaded on Jun 3, 2026
LLM Vulnerability Scanner and Guardrails provides comprehensive assessment of LLM vulnerabilities and automatic application of optimal defensive techniques to generative AI on LLMs.

Related lifecycle stage(s)

DeployVerify & validate

TechnicalUploaded on Jun 3, 2026
The Einstein Trust Layer is a secure AI architecture built into the Salesforce platform that provides guardrails to protect data privacy and security, improve the safety and accuracy of AI outputs, and enable Salesforce customers to use generative AI responsibly within Salesforce applications.

Related lifecycle stage(s)

Operate & monitorDeploy

EducationalUploaded on Jun 3, 2026
The OWASP Top 10 for Large Language Model (LLM) Applications is a written guidance document developed by the OWASP community to identify the most critical security risks affecting applications that use large language models.

Related lifecycle stage(s)

Operate & monitorPlan & design

TechnicalUploaded on Mar 20, 2026
garak is an open-source LLM vulnerability scanner developed by NVIDIA that probes large language models for security weaknesses including prompt injection, jailbreaks, hallucination, toxicity, data leakage, and misinformation.

TechnicalUploaded on Jan 19, 2026
ASQI Engineer is an open-source framework for testing and assuring AI systems. Built for scale and reliability, it uses containerised test packages, automated assessments, and repeatable workflows to make evaluation transparent and robust. With ASQI Engineer, organisations also run ASQIs that they have created themselves, giving teams full control and confidence in AI quality.

TechnicalUnited StatesUploaded on May 2, 2025
ATLAS (Adversarial Threat Landscape for Artificial-Intelligence Systems) is a globally accessible, living knowledge base of adversary tactics and techniques against Al-enabled systems based on real-world attack observations and realistic demonstrations from Al red teams and security groups.

TechnicalUnited StatesUploaded on May 19, 2025
HiddenLayer’s AISec Platform is a GenAI Protection Suite purpose-built to ensure the integrity of AI models throughout the MLOps pipeline. The platform provides detection and response for GenAI and traditional AI models to detect prompt injections, adversarial AI attacks, and digital supply chain vulnerabilities.

ProceduralUploaded on Jan 6, 2025
ISO/IEC 25023:2016 defines quality measures for quantitatively evaluating system and software product quality in terms of characteristics and subcharacteristics defined in ISO/IEC 25010 and is intended to be used together with ISO/IEC 25010.

TechnicalUnited KingdomUploaded on Dec 6, 2024
Continuous automated red teaming for AI, minimize security threats to AI models and applications.

TechnicalUploaded on Nov 5, 2024
garak, Generative AI Red-teaming & Assessment Kit, is an LLM vulnerability scanner. Garak checks if an LLM can be made to fail.

Related lifecycle stage(s)

Operate & monitorVerify & validate

TechnicalUnited StatesUploaded on Aug 2, 2024
AI Security Platform for GenAI and Conversational AI applications. Probe enables security officers and developers identify, mitigate, and monitor AI system security.

Related lifecycle stage(s)

Operate & monitorVerify & validate

ProceduralUploaded on Jul 1, 2024
This Recommendation specifies an architectural framework for network automation based on artificial intelligence (AI) for resource and fault management in future networks, including international mobile telecommunications-2020 (IMT-2020).

ProceduralUploaded on Jul 1, 2024
This Recommendation provides an architectural framework for machine learning (ML) models serving in future networks including IMT-2020, i.

ProceduralUploaded on Jul 2, 2024
This Recommendation provides system context, functional requirements and use cases for machine learning as a service (MLaaS).

ProceduralUploaded on Jul 2, 2024
PAS 11281 is the international standard on road vehicles that gives recommendations for managing security risks that might lead to a compromise of safety in a connected automotive ecosystem.

ProceduralUploaded on Jul 2, 2024
Methodology extending current experiences on the characteristics of 'adaptive networks' such as virtualization, self-organization, self-configuration, self-optimization, self-healing and self-learning offer huge advantages in future networks.

ProceduralUploaded on Jul 2, 2024
Effective data management and operation is extremely important. This work item is purposed to draft a GR of data operation requirements and mechanisms to better serve ENI system.

ProceduralUploaded on Jul 2, 2024
This Recommendation provides a framework for artificial intelligence (AI) enhanced telecom operation and management (AITOM).

ProceduralUploaded on Jul 2, 2024
This Recommendation specifies a functional framework for network service provisioning based on artificial intelligence (AI) in future networks, including international mobile telecommunication-2020 (IMT-2020).

Partnership on AI

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.