These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
SUBMIT A METRIC USE CASE
If you have a metric use case that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!
SUBMITProprioception Is All You Need: Terrain Classification for Boreal Forests
Recognition/object detectionUploaded on Apr 22, 2024In Multiple Object Tracking (MOT), tracking-by-detection methods have stood
the test for a long time, which split the process into two parts according to
the definition: object det...
Objective(s)
ProMISe: Promptable Medical Image Segmentation using SAM
Recognition/object detectionUploaded on Apr 22, 2024This paper introduces fourteen novel datasets for the evaluation of Large
Language Models' safety in the context of enterprise tasks. A method was
devised to evaluate a model's saf...
Objective(s)
HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images
Recognition/object detectionUploaded on Apr 22, 2024Multimodal Large Language Models (MLLMs) have experienced significant
advancements recently. Nevertheless, challenges persist in the accurate
recognition and comprehension of intri...
Objective(s)
Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Recognition/object detectionUploaded on Apr 22, 2024Vision Transformer (ViT) self-attention mechanism is characterized by feature
collapse in deeper layers, resulting in the vanishing of low-level visual
features. However, such feat...
Objective(s)
DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations
Recognition/object detectionUploaded on Apr 22, 2024Today's deep learning methods focus on how to design the most appropriate
objective functions so that the prediction results of the model can be closest
to the ground truth. Meanwh...
Objective(s)
CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios
Event/anomaly detectionReasoning with knowledge structures/planningRecognition/object detectionUploaded on Apr 22, 2024Table-based reasoning with large language models (LLMs) is a promising
direction to tackle many table understanding tasks, such as table-based
question answering and fact verificat...
Objective(s)
Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations
Recognition/object detectionUploaded on Apr 22, 2024The task of stock earnings forecasting has received considerable attention
due to the demand investors in real-world scenarios. However, compared with
financial institutions, it is...
Objective(s)
Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention
Recognition/object detectionUploaded on Apr 2, 2024We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed
for real-world vision and language understanding applications. Our approach is
structured around three ke...
Objective(s)
Multiple Object Tracking as ID Prediction
Recognition/object detectionUploaded on Apr 2, 2024Earth observation (EO) applications involving complex and heterogeneous data
sources are commonly approached with machine learning models. However, there is
a common assumption tha...
Objective(s)
Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning
Recognition/object detectionUploaded on Apr 2, 2024With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for
medical image segmentation (MIS) has become popular. However, due to the large
size of the SAM model and ...
Objective(s)
Explore Human Parsing Modality for Action Recognition
Recognition/object detectionUploaded on Apr 2, 2024Vision Transformer (ViT) self-attention mechanism is characterized by feature
collapse in deeper layers, resulting in the vanishing of low-level visual
features. However, such feat...
Objective(s)
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
Recognition/object detectionUploaded on Apr 2, 2024In this paper, we revisit techniques for uncertainty estimation within deep
neural networks and consolidate a suite of techniques to enhance their
reliability. Our investigation re...
Objective(s)
CoDA: Instructive Chain-of-Domain Adaptation with Severity-Aware Visual Prompt Tuning
Recognition/object detectionUploaded on Apr 2, 2024In Multiple Object Tracking (MOT), tracking-by-detection methods have stood
the test for a long time, which split the process into two parts according to
the definition: object det...
Objective(s)
Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving
Recognition/object detectionUploaded on Apr 2, 2024Multimodal Large Language Models (MLLMs) have experienced significant
advancements recently. Nevertheless, challenges persist in the accurate
recognition and comprehension of intri...
Objective(s)
ReViT: Enhancing Vision Transformers with Attention Residual Connections for Visual Recognition
Recognition/object detectionUploaded on Mar 15, 2024In this paper, we revisit techniques for uncertainty estimation within deep
neural networks and consolidate a suite of techniques to enhance their
reliability. Our investigation re...
Objective(s)
MambaTab: A Simple Yet Effective Approach for Handling Tabular Data
Recognition/object detectionUploaded on Mar 15, 2024Multimodal Large Language Models (MLLMs) have experienced significant
advancements recently. Nevertheless, challenges persist in the accurate
recognition and comprehension of intri...
Objective(s)
HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields
Recognition/object detectionUploaded on Mar 15, 2024With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for
medical image segmentation (MIS) has become popular. However, due to the large
size of the SAM model and ...
Objective(s)
Graph Transformers without Positional Encodings
Recognition/object detectionUploaded on Mar 15, 2024Vision Transformer (ViT) self-attention mechanism is characterized by feature
collapse in deeper layers, resulting in the vanishing of low-level visual
features. However, such feat...
Objective(s)
EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning
Recognition/object detectionUploaded on Mar 15, 2024The task of stock earnings forecasting has received considerable attention
due to the demand investors in real-world scenarios. However, compared with
financial institutions, it is...
Objective(s)
Context-Guided Spatio-Temporal Video Grounding
Recognition/object detectionUploaded on Mar 15, 2024We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed
for real-world vision and language understanding applications. Our approach is
structured around three ke...
Objective(s)
