These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Type
Origin
SUBMIT A TOOL
If you have a tool that you think should be featured in the Catalogue of AI Tools & Metrics, we would love to hear from you!
SUBMITPyRIT
TechnicalUnited StatesUploaded on Nov 8, 2024The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.
Objective(s)
garak
TechnicalUploaded on Nov 5, 2024garak, Generative AI Red-teaming & Assessment Kit, is an LLM vulnerability scanner. Garak checks if an LLM can be made to fail.
Objective(s)
BELLS - Benchmarks for the Evaluation of LLM Safeguards
TechnicalFranceUploaded on Aug 2, 2024Evaluate input-output safeguards for LLM systems such as jailbreak and hallucination detectors, to understand how good they are and on which type of inputs they fail.
Objective(s)
Privacy Tools
TechnicalBrazilUploaded on Jun 26, 2024Privacy compliance platform, based on AI/Blockchain, which helps global companies to keep compliant with the data protection requirements.
Objective(s)
Related lifecycle stage(s)
Deploywhisper-jax
TechnicalUnited KingdomUploaded on Apr 22, 2024JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
Objective(s)
vit-explain
TechnicalIsraelUploaded on Apr 22, 2024Explainability for Vision Transformers
Objective(s)
Related lifecycle stage(s)
Verify & validateBuild & interpret modelCollect & process dataPlan & designvespa
TechnicalUploaded on Apr 22, 2024The open big data serving engine. https://vespa.ai
Objective(s)
traingenerator
TechnicalGermanyUploaded on Apr 2, 2024🧙 A web app to generate template code for machine learning
Objective(s)
torch-cam
TechnicalFranceUploaded on Apr 2, 2024Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM)
Objective(s)
tf-explain
TechnicalFranceUploaded on Apr 2, 2024Interpretability Methods for tf.keras models with Tensorflow 2.x
Objective(s)
trojai
TechnicalUploaded on Apr 29, 2024A repository to quickly generate synthetic data and associated trojaned deep learning models
Objective(s)
Related lifecycle stage(s)
Build & interpret modelsteal-ml
TechnicalUploaded on Apr 2, 2024Model extraction attacks on Machine-Learning-as-a-Service platforms.
Objective(s)
Related lifecycle stage(s)
Operate & monitorDeployVerify & validateBuild & interpret modelCollect & process dataPlan & designspeech-transformer
TechnicalChinaUploaded on Apr 2, 2024A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Objective(s)
shapley
TechnicalUnited KingdomUploaded on Apr 2, 2024The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).
Objective(s)
Related lifecycle stage(s)
Build & interpret modelseq2seq-signal-prediction
TechnicalCanadaUploaded on Apr 2, 2024Signal forecasting with a Sequence-to-Sequence (seq2seq) Recurrent Neural Network (RNN) model in TensorFlow - Guillaume Chevalier
Objective(s)
Related lifecycle stage(s)
Build & interpret modelLiving guidelines on the responsible use of Generative AI in research
ProceduralUploaded on Mar 26, 2024These guidelines focus on one particular area of AI used in the research process, namely generative Artificial Intelligence. There is an important step to prevent misuse and ensure that generative AI plays a positive role in improving research practices.
Objective(s)
Generative AI Framework for HMG (HTML)
ProceduralUnited KingdomUploaded on Jan 24, 2024Ten core principles for generative AI use in government and public sector organisations.
Objective(s)
Related lifecycle stage(s)
Plan & designProposed Model Governance Framework for Generative AI
ProceduralSingaporeUploaded on Jan 24, 2024This Model AI Governance Framework for Generative AI therefore seeks to set forth a systematic and balanced approach to address generative AI concerns while continuing to facilitate innovation.
Objective(s)
scikit-learn-videos
TechnicalUnited StatesUploaded on Dec 15, 2023Jupyter notebooks from the scikit-learn video series
Objective(s)
Related lifecycle stage(s)
Collect & process dataText classification Keras
TechnicalChinaUploaded on Dec 15, 2023Text classification models implemented in Keras, including: FastText, TextCNN, TextRNN, TextBiRNN, TextAttBiRNN, HAN, RCNN, RCNNVariant, etc.
Objective(s)
Related lifecycle stage(s)
Build & interpret model