These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
SUBMIT A METRIC USE CASE
If you have a metric use case that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!
SUBMITDDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations
Recognition/object detectionUploaded on Apr 22, 2024Today's deep learning methods focus on how to design the most appropriate
objective functions so that the prediction results of the model can be closest
to the ground truth. Meanwh...
Objective(s)
CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios
Event/anomaly detectionReasoning with knowledge structures/planningRecognition/object detectionUploaded on Apr 22, 2024Table-based reasoning with large language models (LLMs) is a promising
direction to tackle many table understanding tasks, such as table-based
question answering and fact verificat...
Objective(s)
A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classification
Recognition/object detectionUploaded on Apr 22, 2024Image classifiers often rely on convolutional neural networks (CNN) for their
tasks, which are inherently more heavyweight than multilayer perceptrons
(MLPs), which can be problema...
Objective(s)
A Bag of Tricks for Few-Shot Class-Incremental Learning
Reasoning with knowledge structures/planningRecognition/object detectionUploaded on Apr 22, 2024Large language models (LLMs) have shown great potential in complex reasoning
tasks, yet their performance is often hampered by the scarcity of high-quality
and reasoning-focused tr...
Objective(s)
Loss-aware Curriculum Learning for Heterogeneous Graph Neural Networks
Recognition/object detectionUploaded on Apr 2, 2024Image classifiers often rely on convolutional neural networks (CNN) for their
tasks, which are inherently more heavyweight than multilayer perceptrons
(MLPs), which can be problema...
Objective(s)
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
Recognition/object detectionUploaded on Apr 2, 2024In this paper, we revisit techniques for uncertainty estimation within deep
neural networks and consolidate a suite of techniques to enhance their
reliability. Our investigation re...
Objective(s)
ReViT: Enhancing Vision Transformers with Attention Residual Connections for Visual Recognition
Recognition/object detectionUploaded on Mar 15, 2024In this paper, we revisit techniques for uncertainty estimation within deep
neural networks and consolidate a suite of techniques to enhance their
reliability. Our investigation re...
Objective(s)
WaferSegClassNet -- A Light-weight Network for Classification and Segmentation of Semiconductor Wafer Defects
Event/anomaly detectionReasoning with knowledge structures/planningUploaded on Nov 1, 2023Traffic event cognition and reasoning in videos is an important task that has
a wide range of applications in intelligent transportation, assisted driving,
and autonomous vehicles....
Objective(s)
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
Recognition/object detectionUploaded on Nov 1, 2023A key function of auditory cognition is the association of characteristic
sounds with their corresponding semantics over time. Humans attempting to
discriminate between fine-graine...
Objective(s)
Unmasking Anomalies in Road-Scene Segmentation
Recognition/object detectionUploaded on Nov 1, 2023Cervical cancer is one of the most deadly and common diseases among women
worldwide. It is completely curable if diagnosed in an early stage, but the
tedious and costly detection p...
Objective(s)
UniFormer: Unifying Convolution and Self-attention for Visual Recognition
Recognition/object detectionUploaded on Nov 1, 2023The discrepancy between the cost function used for training a speech
enhancement model and human auditory perception usually makes the quality of
enhanced speech unsatisfactory. Ob...
Objective(s)
The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Tasks
Recognition/object detectionUploaded on Nov 1, 2023In LiDAR-based 3D object detection for autonomous driving, the ratio of the
object size to input scene size is significantly smaller compared to 2D
detection cases. Overlooking thi...
Objective(s)
Stay on topic with Classifier-Free Guidance
Recognition/object detectionUploaded on Nov 1, 2023In this work, we propose a permutation invariant language model, SymphonyNet,
as a solution for symbolic symphony music generation. We propose a novel
Multi-track Multi-instrument ...
Objective(s)
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting
Recognition/object detectionUploaded on Nov 1, 2023Online social media is rife with offensive and hateful comments, prompting
the need for their automatic detection given the sheer amount of posts created
every second. Creating hig...
Objective(s)
Sample Selection with Uncertainty of Losses for Learning with Noisy Labels
Recognition/object detectionUploaded on Nov 1, 2023In this paper, we introduce a framework ARBEx, a novel attentive feature
extraction framework driven by Vision Transformer with reliability balancing to
cope against poor class dis...
Objective(s)
SSR: An Efficient and Robust Framework for Learning with Unknown Label Noise
Recognition/object detectionUploaded on Nov 1, 2023Jointly processing information from multiple sensors is crucial to achieving
accurate and robust perception for reliable autonomous driving systems.
However, current 3D perception ...
Objective(s)
RefineCap: Concept-Aware Refinement for Image Captioning
Recognition/object detectionUploaded on Nov 1, 2023We present Video-LLaMA a multi-modal framework that empowers Large Language
Models (LLMs) with the capability of understanding both visual and auditory
content in the video. Video-...
Objective(s)
Penalizing the Hard Example But Not Too Much: A Strong Baseline for Fine-Grained Visual Classification
Recognition/object detectionUploaded on Nov 1, 2023Biological systems perceive the world by simultaneously processing
high-dimensional inputs from modalities as diverse as vision, audition, touch,
proprioception, etc. The perceptio...
Objective(s)
Patch-Mix Transformer for Unsupervised Domain Adaptation: A Game Perspective
Event/anomaly detectionRecognition/object detectionUploaded on Nov 1, 2023The task of long-form question answering (LFQA) involves retrieving documents
relevant to a given question and using them to generate a paragraph-length
answer. While many models h...
Objective(s)
NeurST: Neural Speech Translation Toolkit
Recognition/object detectionUploaded on Nov 1, 2023NeurST is an open-source toolkit for neural speech translation. The toolkit
mainly focuses on end-to-end speech translation, which is easy to use, modify,
and extend to advanced sp...
Objective(s)