These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Accuracy is the proportion of correct predictions among the total number of cases processed. It can be computed with:
Accuracy = (TP + TN) / (TP + TN + FP + FN) , where:
TP: True positive
TN: True negative
FP: False positive
FN: False negative
Related use cases :
Evaluating Model Robustness and Stability to Dataset Shift
Uploaded on Oct 21, 2022As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robus...
Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift
Uploaded on Oct 21, 2022We might hope that when faced with unexpected inputs, well-designed software systems would fire off warnings. Machine learning (ML) systems, however, which depend strongly on p...
Explaining the Predictions of Any Classifier
Uploaded on Oct 21, 2022Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, wh...
Empirical Risk Minimization under Fairness Constraints
Uploaded on Oct 21, 2022We address the problem of algorithmic fairness: ensuring that sensitive variables do not unfairly influence the outcome of a classifier. We present an approach based on empiric...
Fairness Constraints: A Flexible Approach for Fair Classification
Uploaded on Oct 21, 2022Algorithmic decision making is employed in an increasing number of real-world applicationstions to aid human decision making. While it has shown considerable promise in terms o...
Data preprocessing techniques for classification without discrimination
Uploaded on Oct 21, 2022Recently, the following Discrimination-Aware Classification Problem was introduced: Suppose we are given training data that exhibit unlawful discrimination; e.g., towa...
DetectA: abrupt concept drift detection in non-stationary environments
Uploaded on Oct 21, 2022Almost all drift detection mechanisms designed for classification problems work reactively: after receiving the complete data set (input patterns and class labels) they apply a...
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Uploaded on Oct 21, 2022Machine-learning (ML) algorithms are increasingly utilized in privacy-sensitive applications such as predicting lifestyle choices, making medical diagnoses, and facial recognit...
The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
Uploaded on Oct 21, 2022This paper describes a testing methodology for quantitatively assessing the risk that rare or unique training-data sequences are unintentionally memorized by generative sequenc...
Privacy-preserving Neural Representations of Text
Uploaded on Oct 21, 2022This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type ...
Information Maximization Clustering via Multi-View Self-Labelling
Uploaded on Mar 27, 2023AE-Net:Adjoint Enhancement Network for Efficient Action Recognition in Video Understanding
Uploaded on Nov 1, 2023AKHCRNet: Bengali Handwritten Character Recognition Using Deep Learning
Uploaded on Nov 1, 2023AZTR: Aerial Video Action Recognition with Auto Zoom and Temporal Reasoning
Uploaded on Nov 1, 2023AsymmNet: Towards ultralight convolution neural networks using asymmetrical bottlenecks
Uploaded on Nov 1, 2023Beyond First Impressions: Integrating Joint Multi-modal Cues for Comprehensive 3D Representation
Uploaded on Nov 1, 2023Boosting Contrastive Self-Supervised Learning with False Negative Cancellation
Uploaded on Nov 1, 2023Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
Uploaded on Nov 1, 2023Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation
Uploaded on Nov 1, 2023DADA: Differentiable Automatic Data Augmentation
Uploaded on Nov 1, 2023DeBERTa: Decoding-enhanced BERT with Disentangled Attention
Uploaded on Nov 1, 2023DeepViT: Towards Deeper Vision Transformer
Uploaded on Nov 1, 2023DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion
Uploaded on Nov 1, 2023EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search
Uploaded on Nov 1, 2023ESResNet: Environmental Sound Classification Based on Visual Domain Models
Uploaded on Nov 1, 2023EVA: Exploring the Limits of Masked Visual Representation Learning at Scale
Uploaded on Nov 1, 2023ElasticFace: Elastic Margin Loss for Deep Face Recognition
Uploaded on Nov 1, 2023End-to-End Audio Strikes Back: Boosting Augmentations Towards An Efficient Audio Classification Network
Uploaded on Nov 1, 2023Enhancing Intra-class Information Extraction for Heterophilous Graphs: One Neural Architecture Search Approach
Uploaded on Nov 1, 2023Enhancing Prototypical Few-Shot Learning by Leveraging the Local-Level Strategy
Uploaded on Nov 1, 2023Exphormer: Sparse Transformers for Graphs
Uploaded on Nov 1, 2023Exploring Localization for Self-supervised Fine-grained Contrastive Learning
Uploaded on Nov 1, 2023Few-Shot Image Classification via Contrastive Self-Supervised Learning
Uploaded on Nov 1, 2023Free Lunch for Domain Adversarial Training: Environment Label Smoothing
Uploaded on Nov 1, 2023From Generalized zero-shot learning to long-tail with class descriptors
Uploaded on Nov 1, 2023Generative Data Augmentation for Commonsense Reasoning
Uploaded on Nov 1, 2023Graph Neural Networks with Learnable and Optimal Polynomial Bases
Uploaded on Nov 1, 2023Graph-Based High-Order Relation Discovery for Fine-Grained Recognition
Uploaded on Nov 1, 2023HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection
Uploaded on Nov 1, 2023Hierarchical Action Classification with Network Pruning
Uploaded on Nov 1, 2023Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognition
Uploaded on Nov 1, 2023Improving ProtoNet for Few-Shot Video Object Recognition: Winner of ORBIT Challenge 2022
Uploaded on Nov 1, 2023Improving out-of-distribution generalization via multi-task self-supervised pretraining
Uploaded on Nov 1, 2023Information Maximization Clustering via Multi-View Self-Labelling
Uploaded on Nov 1, 2023Instance Credibility Inference for Few-Shot Learning
Uploaded on Nov 1, 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
Uploaded on Nov 1, 2023InternVideo: General Video Foundation Models via Generative and Discriminative Learning
Uploaded on Nov 1, 2023Investigation of deep learning models on identification of minimum signal length for precise classification of conveyor rubber belt loads
Uploaded on Nov 1, 2023Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition
Uploaded on Nov 1, 2023Learning Efficient, Explainable and Discriminative Representations for Pulmonary Nodules Classification
Uploaded on Nov 1, 2023Learning Representation for Clustering via Prototype Scattering and Positive Sampling
Uploaded on Nov 1, 2023Liquid Structural State-Space Models
Uploaded on Nov 1, 2023MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation
Uploaded on Nov 1, 2023MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers
Uploaded on Nov 1, 2023Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networks
Uploaded on Nov 1, 2023Meta Dropout: Learning to Perturb Latent Features for Generalization
Uploaded on Nov 1, 2023Meta-Learning with a Geometry-Adaptive Preconditioner
Uploaded on Nov 1, 2023Milking CowMask for Semi-Supervised Image Classification
Uploaded on Nov 1, 2023MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Uploaded on Nov 1, 2023Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets
Uploaded on Nov 1, 2023Multi-Label Compound Expression Recognition: C-EXPR Database & Network
Uploaded on Nov 1, 2023Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognition
Uploaded on Nov 1, 2023Multiscale Vision Transformers
Uploaded on Nov 1, 2023New Benchmarks for Learning on Non-Homophilous Graphs
Uploaded on Nov 1, 2023NoiseRank: Unsupervised Label Noise Reduction with Dependence Models
Uploaded on Nov 1, 2023OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning
Uploaded on Nov 1, 2023On Evolving Attention Towards Domain Adaptation
Uploaded on Nov 1, 2023Online Graph Dictionary Learning
Uploaded on Nov 1, 2023Optimal Representations for Covariate Shift
Uploaded on Nov 1, 2023PaLI-3 Vision Language Models: Smaller, Faster, Stronger
Uploaded on Nov 1, 2023Patch-Mix Transformer for Unsupervised Domain Adaptation: A Game Perspective
Uploaded on Nov 1, 2023Pattern Attention Transformer with Doughnut Kernel
Uploaded on Nov 1, 2023Penalizing the Hard Example But Not Too Much: A Strong Baseline for Fine-Grained Visual Classification
Uploaded on Nov 1, 2023Point Cloud Classification Using Content-based Transformer via Clustering in Feature Space
Uploaded on Nov 1, 2023PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling
Uploaded on Nov 1, 2023Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
Uploaded on Nov 1, 2023Pyramid Adversarial Training Improves ViT Performance
Uploaded on Nov 1, 2023RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL
Uploaded on Nov 1, 2023Random Dilated Shapelet Transform: A New Approach for Time Series Shapelets
Uploaded on Nov 1, 2023ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning
Uploaded on Nov 1, 2023ResNet strikes back: An improved training procedure in timm
Uploaded on Nov 1, 2023Rethinking Domain Generalization Baselines
Uploaded on Nov 1, 2023SNoRe: Scalable Unsupervised Learning of Symbolic Node Representations
Uploaded on Nov 1, 2023SP-ViT: Learning 2D Spatial Priors for Vision Transformers
Uploaded on Nov 1, 2023SSR: An Efficient and Robust Framework for Learning with Unknown Label Noise
Uploaded on Nov 1, 2023Sample Selection with Uncertainty of Losses for Learning with Noisy Labels
Uploaded on Nov 1, 2023Selecting Relevant Features from a Multi-domain Representation for Few-shot Classification
Uploaded on Nov 1, 2023Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style
Uploaded on Nov 1, 2023Self-attention Dual Embedding for Graphs with Heterophily
Uploaded on Nov 1, 2023Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting
Uploaded on Nov 1, 2023Semi-Supervised Recognition under a Noisy and Fine-grained Dataset
Uploaded on Nov 1, 2023Sequence Alignment Ensemble with a Single Neural Network for Sequence Labeling
Uploaded on Nov 1, 2023Shape-Biased Domain Generalization via Shock Graph Embeddings
Uploaded on Nov 1, 2023Slow-Fast Auditory Streams For Audio Recognition
Uploaded on Nov 1, 2023Space-time Mixing Attention for Video Transformer
Uploaded on Nov 1, 2023Stay on topic with Classifier-Free Guidance
Uploaded on Nov 1, 2023Supervised Domain Adaptation: A Graph Embedding Perspective and a Rectified Experimental Protocol
Uploaded on Nov 1, 2023TAPAS: Weakly Supervised Table Parsing via Pre-training
Uploaded on Nov 1, 2023TAPEX: Table Pre-training via Learning a Neural SQL Executor
Uploaded on Nov 1, 2023The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Tasks
Uploaded on Nov 1, 2023Transfer learning based few-shot classification using optimal transport mapping from preprocessed latent space of backbone neural network
Uploaded on Nov 1, 2023UPANets: Learning from the Universal Pixel Attention Networks
Uploaded on Nov 1, 2023UniFormer: Unifying Convolution and Self-attention for Visual Recognition
Uploaded on Nov 1, 2023Unsupervised Embedding Adaptation via Early-Stage Feature Reconstruction for Few-Shot Classification
Uploaded on Nov 1, 2023Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps
Uploaded on Nov 1, 2023ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
Uploaded on Nov 1, 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking
Uploaded on Nov 1, 2023WaferSegClassNet -- A Light-weight Network for Classification and Segmentation of Semiconductor Wafer Defects
Uploaded on Nov 1, 2023mT5: A massively multilingual pre-trained text-to-text transformer
Uploaded on Nov 1, 2023Graph Transformers without Positional Encodings
Uploaded on Mar 15, 2024ReViT: Enhancing Vision Transformers with Attention Residual Connections for Visual Recognition
Uploaded on Mar 15, 2024Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving
Uploaded on Apr 2, 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
Uploaded on Apr 2, 2024Explore Human Parsing Modality for Action Recognition
Uploaded on Apr 2, 2024Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning
Uploaded on Apr 2, 2024Loss-aware Curriculum Learning for Heterogeneous Graph Neural Networks
Uploaded on Apr 2, 2024MIM-Refiner: A Contrastive Learning Boost from Intermediate Pre-Trained Representations
Uploaded on Apr 2, 2024Multiple Object Tracking as ID Prediction
Uploaded on Apr 2, 2024PaddingFlow: Improving Normalizing Flows with Padding-Dimensional Noise
Uploaded on Apr 2, 2024The VampPrior Mixture Model
Uploaded on Apr 2, 2024You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement
Uploaded on Apr 2, 2024Human-Computer Trust Scale (HCTS)
Uploaded on Apr 10, 2024The Human-Computer Trust scale (HCTS) is a simple, nine-item attitude Likert scale that gives a global view of subjective assessments of trust in technology.
The HCTS resu...
A Bag of Tricks for Few-Shot Class-Incremental Learning
Uploaded on Apr 22, 2024A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classification
Uploaded on Apr 22, 2024CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios
Uploaded on Apr 22, 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on Apr 22, 2024Efficient Image Super-Resolution via Symmetric Visual Attention Network
Uploaded on Apr 22, 2024HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images
Uploaded on Apr 22, 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining
Uploaded on Apr 22, 2024ProMISe: Promptable Medical Image Segmentation using SAM
Uploaded on Apr 22, 2024Proprioception Is All You Need: Terrain Classification for Boreal Forests
Uploaded on Apr 22, 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
Uploaded on Apr 22, 2024Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network
Uploaded on Apr 22, 2024A Bag of Tricks for Few-Shot Class-Incremental Learning
Uploaded on May 21, 2024A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classification
Uploaded on May 21, 2024CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios
Uploaded on May 21, 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on May 21, 2024Efficient Image Super-Resolution via Symmetric Visual Attention Network
Uploaded on May 21, 2024HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images
Uploaded on May 21, 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining
Uploaded on May 21, 2024ProMISe: Promptable Medical Image Segmentation using SAM
Uploaded on May 21, 2024Proprioception Is All You Need: Terrain Classification for Boreal Forests
Uploaded on May 21, 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
Uploaded on May 21, 2024Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network
Uploaded on May 21, 2024A Bag of Tricks for Few-Shot Class-Incremental Learning
Uploaded on Jun 5, 2024A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classification
Uploaded on Jun 5, 2024CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios
Uploaded on Jun 5, 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on Jun 5, 2024Efficient Image Super-Resolution via Symmetric Visual Attention Network
Uploaded on Jun 5, 2024HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images
Uploaded on Jun 5, 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining
Uploaded on Jun 5, 2024ProMISe: Promptable Medical Image Segmentation using SAM
Uploaded on Jun 5, 2024Proprioception Is All You Need: Terrain Classification for Boreal Forests
Uploaded on Jun 5, 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
Uploaded on Jun 5, 2024Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network
Uploaded on Jun 5, 2024About the metric
You can click on the links to see the associated metrics
Objective(s):
Target sector(s):
Lifecycle stage(s):
Target users: