These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
This paper proposes a new bias evaluation metric – Gender-based Illicit Proximity Estimate (GIPE), which measures the extent of undue proximity in word vectors resulting from the presence of gender-based predilections. Experiments based on a suite of evaluation metrics show that RAN-Debias significantly outperforms the state-of-the-art in reducing proximity bias (GIPE) by at least 42.02%. It also reduces direct bias, adding minimal semantic disturbance, and achieves the best performance in a downstream application task (coreference resolution).
Related use cases :
Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on Apr 22, 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on May 21, 2024Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Uploaded on Jun 5, 2024About the metric
You can click on the links to see the associated metrics
Objective(s):
Purpose(s):
Target sector(s):
Lifecycle stage(s):
Target users:
Risk management stage(s):