Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

OverviewToolsMetricsAbout the catalogue
Contribute to the catalogue
Contribute to the catalogue
Show toolsShow use cases

Type

Origin

Scope

SUBMIT A TOOL

If you have a tool that you think should be featured in the Catalogue of AI Tools & Metrics, we would love to hear from you!

SUBMIT

ValidMind

TechnicalUnited StatesUploaded on Apr 18, 2024
An end-to-end model risk management platform that automates model documentation and dramatically simplifies AI model validation.

Objective(s)

PerformancePrivacy & data governanceTransparency & explainability

Related lifecycle stage(s)

Verify & validateBuild & interpret modelCollect & process data

Map Lead Scraper

TechnicalUploaded on Apr 18, 2024
Tool to scrape local business data from Google Maps

Objective(s)

Accountability

The Citrusx Platform

TechnicalProceduralIsraelUploaded on Apr 11, 2024
Citrusx offers a multifaceted solution to connect all stakeholders in the company through an SDK, user-friendly UI, and automated reporting system.

Objective(s)

FairnessRobustness & digital securityTransparency & explainability

Related lifecycle stage(s)

Operate & monitorVerify & validateCollect & process data

tflearn

TechnicalUploaded on Apr 2, 2024
Deep learning library featuring a higher-level API for TensorFlow.

Objective(s)

FairnessReskill or upskillRobustness & digital security

Related lifecycle stage(s)

Plan & design

dlib

TechnicalUnited StatesUploaded on Apr 2, 2024
A toolkit for making real world machine learning and data analysis applications in C++

Objective(s)

FairnessPrivacy & data governanceReskill or upskillRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Related lifecycle stage(s)

Plan & design

docker-stacks

TechnicalUnited KingdomUploaded on Apr 2, 2024
Ready-to-run Docker images containing Jupyter applications

Objective(s)

FairnessPrivacy & data governanceReskill or upskillRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Related lifecycle stage(s)

Plan & design

finrl

TechnicalUnited StatesUploaded on Apr 2, 2024
FinRL: Financial Reinforcement Learning.

Objective(s)

FairnessPrivacy & data governanceReskill or upskillRobustness & digital securityTransparency & explainability

Related lifecycle stage(s)

Build & interpret modelPlan & design

openface

TechnicalUnited KingdomUploaded on Apr 2, 2024
OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.

Objective(s)

Privacy & data governanceRobustness & digital security

Related lifecycle stage(s)

Operate & monitorDeployVerify & validateBuild & interpret modelCollect & process dataPlan & design

labelme

TechnicalJapanUploaded on Apr 2, 2024
Image Polygonal Annotation with Python (polygon, rectangle, circle, line, point and image-level flag annotation).

Objective(s)

FairnessPrivacy & data governance

Related lifecycle stage(s)

Plan & design

onnxruntime

TechnicalUnited StatesUploaded on Apr 2, 2024
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Objective(s)

Privacy & data governanceRobustness & digital security

Related lifecycle stage(s)

Build & interpret model

gpt4all

TechnicalUnited StatesUploaded on Apr 2, 2024
Open-source large language models that run locally on your CPU and nearly any GPU.

Objective(s)

Respect of human rightsRobustness & digital security

Related lifecycle stage(s)

Plan & design

nni

TechnicalUnited StatesUploaded on Apr 2, 2024
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Objective(s)

FairnessPrivacy & data governanceReskill or upskillRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Related lifecycle stage(s)

Plan & design

openbbterminal

TechnicalUploaded on Apr 2, 2024
Investment Research for Everyone, Everywhere.

Objective(s)

FairnessPrivacy & data governanceRespect of human rights

Related lifecycle stage(s)

Build & interpret modelPlan & design

pytorch3d

TechnicalUnited StatesUploaded on Apr 2, 2024
PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

Objective(s)

FairnessPrivacy & data governanceRespect of human rightsRobustness & digital security

Related lifecycle stage(s)

Operate & monitorDeployVerify & validateBuild & interpret modelCollect & process dataPlan & design

cookiecutter-data-science

TechnicalUploaded on Apr 2, 2024
A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

Objective(s)

FairnessPrivacy & data governanceReskill or upskillRespect of human rightsRobustness & digital securitySafetyTransparency & explainability

Related lifecycle stage(s)

Operate & monitorDeployVerify & validateBuild & interpret modelCollect & process dataPlan & design

jupyterhub

TechnicalUnited StatesUploaded on Apr 2, 2024
Multi-user server for Jupyter notebooks

Objective(s)

Robustness & digital security

Related lifecycle stage(s)

Plan & design
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.