These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Exact Match
A given predicted string’s exact match score is 1 if it is the exact same as its reference string, and is 0 otherwise.
- Example 1: The exact match score of prediction “Happy Birthday!” is 0, given its reference is “Happy New Year!”.
- Example 2: The exact match score of prediction “The Colour of Magic (1983)” is 1, given its reference is also “The Colour of Magic (1983)”.
The exact match score of a set of predictions is the sum of all of the individual exact match scores in the set, divided by the total number of predictions in the set.
- Example: The exact match score of the set {Example 1, Example 2} (above) is 0.5.
Related use cases :
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction
Uploaded on Nov 1, 2023This paper introduces a new concept called "transferable visual words"
(TransVW), aiming to achieve annotation efficiency for deep learning in medical
image analysis. Medical imagi...
Learning Algebraic Recombination for Compositional Generalization
Uploaded on Nov 1, 2023Vision-language modeling has enabled open-vocabulary tasks where predictions
can be queried using any text prompt in a zero-shot manner. Existing
open-vocabulary tasks focus on obj...
About the metric
You can click on the links to see the associated metrics
Objective(s):
Purpose(s):
Target sector(s):
Lifecycle stage(s):
Target users:
