Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Accountability

Clear all

SUBMIT A METRIC USE CASE

If you have a metric use case that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!

SUBMIT
Objective Accountability

Recognition/object detectionUploaded on Apr 22, 2024
Today's deep learning methods focus on how to design the most appropriate objective functions so that the prediction results of the model can be closest to the ground truth. Meanwh...

Objective(s)


Event/anomaly detectionReasoning with knowledge structures/planningRecognition/object detectionUploaded on Apr 22, 2024
Table-based reasoning with large language models (LLMs) is a promising direction to tackle many table understanding tasks, such as table-based question answering and fact verificat...

Objective(s)


Recognition/object detectionUploaded on Apr 22, 2024
Image classifiers often rely on convolutional neural networks (CNN) for their tasks, which are inherently more heavyweight than multilayer perceptrons (MLPs), which can be problema...

Objective(s)


Reasoning with knowledge structures/planningRecognition/object detectionUploaded on Apr 22, 2024
Large language models (LLMs) have shown great potential in complex reasoning tasks, yet their performance is often hampered by the scarcity of high-quality and reasoning-focused tr...

Objective(s)


Recognition/object detectionUploaded on Apr 2, 2024
Image classifiers often rely on convolutional neural networks (CNN) for their tasks, which are inherently more heavyweight than multilayer perceptrons (MLPs), which can be problema...

Objective(s)


Recognition/object detectionUploaded on Apr 2, 2024
In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation re...

Objective(s)


Recognition/object detectionUploaded on Mar 15, 2024
In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation re...

Objective(s)


Event/anomaly detectionReasoning with knowledge structures/planningUploaded on Nov 1, 2023
Traffic event cognition and reasoning in videos is an important task that has a wide range of applications in intelligent transportation, assisted driving, and autonomous vehicles....

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
A key function of auditory cognition is the association of characteristic sounds with their corresponding semantics over time. Humans attempting to discriminate between fine-graine...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
Cervical cancer is one of the most deadly and common diseases among women worldwide. It is completely curable if diagnosed in an early stage, but the tedious and costly detection p...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
The discrepancy between the cost function used for training a speech enhancement model and human auditory perception usually makes the quality of enhanced speech unsatisfactory. Ob...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases. Overlooking thi...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
In this work, we propose a permutation invariant language model, SymphonyNet, as a solution for symbolic symphony music generation. We propose a novel Multi-track Multi-instrument ...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
Online social media is rife with offensive and hateful comments, prompting the need for their automatic detection given the sheer amount of posts created every second. Creating hig...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
In this paper, we introduce a framework ARBEx, a novel attentive feature extraction framework driven by Vision Transformer with reliability balancing to cope against poor class dis...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
Jointly processing information from multiple sensors is crucial to achieving accurate and robust perception for reliable autonomous driving systems. However, current 3D perception ...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
We present Video-LLaMA a multi-modal framework that empowers Large Language Models (LLMs) with the capability of understanding both visual and auditory content in the video. Video-...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
Biological systems perceive the world by simultaneously processing high-dimensional inputs from modalities as diverse as vision, audition, touch, proprioception, etc. The perceptio...

Objective(s)


Event/anomaly detectionRecognition/object detectionUploaded on Nov 1, 2023
The task of long-form question answering (LFQA) involves retrieving documents relevant to a given question and using them to generate a paragraph-length answer. While many models h...

Objective(s)


Recognition/object detectionUploaded on Nov 1, 2023
NeurST is an open-source toolkit for neural speech translation. The toolkit mainly focuses on end-to-end speech translation, which is easy to use, modify, and extend to advanced sp...

Objective(s)


catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.