Inner Warden is an open-source security agent for Linux and macOS servers. It detects attacks such as brute-force attempts and privilege escalation, and alerts operators in real time. It can use AI models to recommend responses, but AI remains advisory unless operators allow automatic action. Inner Warden can also monitor autonomous AI agents and block risky commands. All actions are reversible and recorded in an audit trail. It runs locally and is released under the MIT licence.

M4 Bias Eval FairFace is a dataset for evaluating social bias in vision-language models. It was created by Hugging Face to assess its IDEFICS models. It contains around 11,000 face images labelled by perceived gender, ethnicity and age. For each image, two models wrote a résumé, a dating profile and a news article about an arrest. Comparing these texts across demographic groups reveals stereotypes the models have learned. The dataset is released under a CC BY 4.0 licence.

Gate AI: LLM Security Benchmark Evaluation Methodology and Results is a technical report on evaluating detectors of prompt injection and jailbreak attacks. It was published by Constellation Network. The method tests a detector across 16 public benchmarks with more than 12 000 samples. It uses a single detection threshold for all benchmarks and prevents near-duplicate prompts from inflating results. Competing detectors are compared at the same false-alarm rate. The report applies the method to Gate AI, Constellation Network's commercial security gateway.

FairnessEval is an open-source framework for evaluating the fairness of machine learning models. It was developed by the University of Modena and Reggio Emilia with Microsoft. Users can load real or synthetic datasets and run fairness-aware models from toolkits such as Fairlearn and AIF360. The framework compares models on fairness, accuracy and training time, and presents the trade-offs in charts. It supports both selecting a suitable model and validating its performance under changing conditions.

FairX is an open-source toolkit for benchmarking machine learning models on fairness, data utility and explainability. It was developed by researchers at Linköping University. Users load tabular or image datasets and apply bias-mitigation methods before, during or after model training, including fair generative models that create synthetic data. FairX evaluates results using fairness, performance and synthetic data quality metrics. This lets users compare trade-offs between fairness and utility. It is written in Python and released under the MIT licence.

Fairmetrics is an open-source R package for evaluating the group fairness of machine learning models. It was developed by researchers at the University of Toronto. The package calculates a wide range of fairness metrics, such as statistical parity and equal opportunity. Unlike most fairness tools, it also provides confidence intervals for each metric. This shows whether differences between groups are statistically significant or due to random variation. It is available on CRAN under the MIT licence.

Meilynx is a software tool for governing large language models (LLMs) and AI agents used in regulated sectors such as financial services, insurance, healthcare, and human resources. It runs as a proxy between applications and model providers, where it redacts sensitive data, restricts model use, and controls agents' tool calls. Each decision is recorded in a tamper-evident audit log that can be mapped to frameworks such as the EU AI Act. The tool provides evidence for controls but does not certify compliance.

AI Facts is a free, open-source Decision Terrain tool with an independently developed checklist mapped to NIST AI RMF 1.0. It is not affiliated with, sponsored by, or endorsed by NIST. Teams document self-reported safeguards, evidence notes, gaps, owners, and next actions, then export assessment reports and AI Facts labels. This public-alpha tool does not verify evidence or establish certification, compliance, or safety.

The Model Card Builder is a free, browser based tool by HCXAIResearch for documenting AI systems that an organisation deploys but did not develop. Users complete eight sections covering provider documentation, intended use, stated capabilities and limitations, and their own oversight, safeguards and monitoring. Provider claims are kept separate from the organisation's own information. Cards can be tagged against the NIST AI Risk Management Framework and EU AI Act risk classes, previewed live, and exported as HTML, Markdown or PDF.

Toolkit for evaluating fairness and bias in machine learning models using multiple subgroup fairness metrics (including parity and equalized-odds-style measures). It supports fairness auditing by quantifying disparities across demographic or other defined subgroups. Data scientists and developers can use it to verify and validate fairness properties and to guide improvements toward fairer model behavior.

The REFRAIME Legal Toolkit provides legal practitioners, public authorities, and civil society organisations with a structured resource for identifying and addressing the impact of AI systems on fundamental rights under the EU Charter. Developed by a consortium including the Center for the Study of Democracy, the European Center for Not-for-Profit Law, and the University of Malta, and co-funded by the European Union, the toolkit combines knowledge articles, sixteen real-world case studies grounded in actual case law (including ACLU v. Clearview AI, SCHUFA before the CJEU, and the Dutch Childcare Benefits case), an interactive glossary, a curated directory of EU, Council of Europe, UN, and OECD instruments, and a 43-point checklist for monitoring compliance with Fundamental Rights Impact Assessment obligations under Article 27 of the EU AI Act.

The AIM Framework (Awareness, Identification, Mitigation) presents a stepwise approach for the implementation of risk management strategies. The framework is intended for AI developers working in private, academic, or public sectors. It features a checklist with indicative scenarios for awareness-raising and training purposes.

ModelBench is a benchmarking tool for running safety-focused evaluations on AI models and producing detailed reports on performance against the benchmark suite. It is intended for developers and researchers who need to verify and compare safety/robustness behavior before deployment and during ongoing evaluation. The outputs support auditing and model validation for safety-related trustworthiness objectives.

Legalithm is a free, open-source developer toolkit that brings EU AI Act compliance directly into the software development workflow. It classifies an AI system's risk tier under Regulation (EU) 2024/1689 and generates a dated, auditable compliance record. It also supports Article 50(2) transparency duties by watermarking AI-generated content (via C2PA credentials and pixel watermarking) and verifying such marks. A GitHub Action integration fails continuous integration builds when the compliance record drifts from the codebase or from regulatory deadlines, helping engineering teams catch compliance gaps early.

TrustyAI Explainability Toolkit is a software toolkit for generating, transforming, and managing explanations of AI model behavior. It helps practitioners produce explanation artifacts that support the trustworthiness objectives of explainability and transparency, enabling users to inspect and communicate how model outputs are derived.

Human Approval Gate is a free, platform-neutral educational kit that helps leaders, educators, operators, and small teams define what a qualified person must check before AI-assisted work can affect a real decision or action. It includes a practical guide, printable worksheet, facilitator notes, and ten synthetic test cases. Its CLEAR test holds the consequence, names the reviewer and evidence, preserves accept, revise, reject, and escalate outcomes, and records the decision and recovery path.

An open specification and command line interface (CLI) toolkit for cryptographically pre-registering machine learning evaluation criteria, including the metric, threshold, dataset, and seed, before a model is run. By committing these criteria in advance, the tool makes any post hoc changes to success thresholds detectable rather than silent, supporting greater integrity and accountability in reported ML evaluation claims.

An open-source AI governance toolkit that turns responsible-AI principles into runnable release workflows for generative and agentic systems. It connects risk scoping, evaluation, red teaming, human review, and evidence-backed release decisions, and maps evaluation and red-team evidence to the NIST AI RMF, the EU AI Act, and the MIT AI Risk Repository, giving teams an audit trail for every model and agent release.

ALIA is Spain’s public and open AI infrastructure for Spanish and co-official languages. This ensures digital sovereignty and provides language models and related resources that public administrations, researchers and companies can use to build trustworthy AI services. It was created to expand the availability of transparent AI in Spain’s languages and to improve public services, research and innovation.

Open-source governance evidence workflow for machine-learning-based small-business credit underwriting. It provides schemas, templates, synthetic fixtures, public-data run kits, validation scripts, monitoring reports, adverse-action reason QA checks, model-change review, issue registers, and reviewer-ready evidence packs for model-risk, transparency, and accountable oversight review.