These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Type
Origin
Scope
SUBMIT A TOOL
If you have a tool that you think should be featured in the Catalogue of Tools & Metrics for Trustworthy AI, we would love to hear from you!
SubmitResponsible innovation toolkit: Judgement call
EducationalUnited StatesUploaded on Sep 9, 2024Judgment Call is an award-winning responsible innovation game and team-based activity that puts Microsoft's AI principles of fairness, privacy and security, reliability and safety, transparency, inclusion, and accountability into action. The game provides an easy-to-use method for cultivating stakeholder empathy through scenario-imagining.
Objective(s)
Dioptra
TechnicalUnited StatesUploaded on Sep 9, 2024Dioptra is an open source software test platform for assessing the trustworthy characteristics of artificial intelligence (AI). It helps developers on determining which types of attacks may impact negatively their model's performance.
Objective(s)
Control Audits AI Governance, Risk & Assurance Platform
ProceduralNew ZealandUploaded on Jul 11, 2024<1 dayAn Artificial Intelligence Governance Risk and Assurance Platform for implementation guidance and assurance
Objective(s)
DVMS NIST Cybersecurity Framework Overlay System
EducationalUploaded on Jul 11, 2024<1 weekThe Digital Value Management Overlay System (DVMS) provides organizations of any size, scale, or complexity an affordable way to mitigate cybersecurity risk to assure digital business performance, resilience & trust
Objective(s)
Enzai EU AI Act Compliance Framework
TechnicalProceduralUnited KingdomUnited StatesUploaded on Jul 11, 2024Enzai’s EU AI Act Compliance Framework makes achieving compliance with the world’s first comprehensive AI governance legislation as easy as possible. The framework breaks hundreds of pages of regulations down into easy-to-follow steps allowing teams to enable organisations to seamlessly and confidently assess the compliance of their AI Systems with the Act and complete the requisite conformity assessments.
Objective(s)
LangBiTe
TechnicalProceduralSpainUploaded on May 21, 2024LangBiTe is a framework for testing biases in large language models. It includes a library of prompts to test sexism / misogyny, racism, xenophobia, ageism, political bias, lgtbiq+phobia and religious discrimination. Any contributor may add new ethical concerns to assess.
Objective(s)
Careful AI: PRIDAR Assurance Framework
ProceduralUploaded on May 27, 2024PRIDAR (Prioritization, Research, Innovation, Development, Analysis, and Review) A Risk Management Framework
Objective(s)
Unsupervised bias detection tool
TechnicalNetherlandsUploaded on Nov 29, 2023This bias detection tool identifies potentially unfairly treated groups of similar users by a binary algorithmic classifier. The tool identifies clusters of users that face a higher misclassification rate compared to the rest of the data set. Clustering is an unsupervised ML method, so no data is needed is required on protected attributes of users. The metric by which bias is defined can be manually chosen in advance: False Negative Rate (FNR), False Positive Rate (FPR), or Accuracy (Acc).
Objective(s)
Related lifecycle stage(s)
Verify & validateProject GuardRail
TechnicalProceduralUnited StatesUploaded on Nov 29, 2023AI/ML applications have unique security threats. Project GuardRail is a set of security and privacy requirements that AI/ML applications should meet during their design phase that serve as guardrails against these threats. These requirements help scope the threats such applications must be protected against.
Objective(s)
AI TIPS
ProceduralUnited StatesUploaded on Nov 29, 2023The AI Trust Integrity Pillars Sustainability (TIPS) Framework is a holistic conceptual model to build trust in AI DNA, at the foundation.
Objective(s)
Saidot
TechnicalEducationalProceduralCanadaFinlandSlovak RepublicSwedenUploaded on Nov 13, 2023Use Saidot to empower AI teams to do high-quality AI governance efficiently and with quality
Objective(s)
Automated Decision-Making Systems in the Public Sector – An Impact Assessment Tool for Public Authorities
EducationalProceduralGermanySwitzerlandUploaded on Oct 31, 2023How can we ensure a trustworthy use of automated decision-making systems (ADMS) in the public administration? AlgorithmWatch has developed a concrete and practicable impact assessment tool for ADMS in the public sector. This publication provides a framework ready to be implemented for the evaluation of specific ADMS by public authorities at different levels.
Objective(s)
Understanding AI at Work Toolkit
EducationalUnited KingdomUploaded on Oct 6, 2023A toolkit for employers and workers seeking to understand the challenges and opportunities of using algorithmic systems that make or inform decisions about workers.
Objective(s)
AI Guardian
TechnicalProceduralUnited StatesUploaded on Oct 3, 2023Comprehensive AI governance and compliance platform focused on empowering organizations with the risk management capabilities they need to adopt AI swiftly and responsibly.
Objective(s)
Trustworthy and Ethical Assurance Platform
ProceduralUnited KingdomUploaded on Sep 11, 2023>1 yearThe Trustworthy and Ethical Assurance platform is an open-source tool and framework to support the process of developing and communicating trustworthy and ethical assurance cases for data-driven technologies.
Objective(s)
ETUI AI boardgame
EducationalUploaded on Aug 14, 2023>1 yearThe ETUI AI game is designed to break down complex scientific and technical concepts, enhance critical thinking towards AI systems, develop strategic intelligence, and strengthen negotiation skills. It can be played by multiple stakeholders, each taking on different roles, fostering diverse perspectives. Through hands-on practice, players and learners engage in solving real-world challenges related to the world of work
Objective(s)
Data Carbon Scorecard
TechnicalEducationalProceduralUploaded on Jul 4, 2023<1 hourThe Data Carbon Scorecard provides a rapid assessment of the environmental impact of your proposed data project enabling you to quickly gauge the CO2 implications of your data project and determine the ‘best’ course of action for the environment. Through answering just 9 questions, the scorecard provides you with a traffic light display of data CO2 hotspots and an overall Data CO2 Score for the whole project within minutes. The scorecard can be used by any individual, team, or organization.
Objective(s)
Orthrus
ProceduralNetherlandsUnited KingdomUploaded on Jun 20, 2023>1 yearA software-based EU AI Act compliance solution for your clients and AI value chain actors
Objective(s)
Related lifecycle stage(s)
Verify & validateAival Analysis Lab
TechnicalProceduralUnited KingdomUploaded on Jun 16, 2023Aival provide independent quality assurance systems to evaluate and monitor AI in healthcare
Objective(s)
City of Boston Interim Guidelines for Using Generative AI
ProceduralUnited StatesUploaded on Jun 12, 2023These guidelines serve as an interim resource for employees of the City of Boston.
Objective(s)
Partnership on AI
