These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Human-AI Interaction Layer Reviewer
Human-AI Interaction Layer Reviewer is an open-source audit tool (distributed as an MCP server) that evaluates the human-AI interaction layer of an AI system rather than the underlying model itself. It assesses how a system communicates with and is perceived by its users, screening for risks such as over trust, automation bias, and mistimed alerts or corrections.
The tool produces evidence-based results drawn from system documentation, user experience reports, and system profiles rather than technical specifications alone. These findings are then cross-walked to regulatory and risk management frameworks, specifically the EU AI Act and the NIST AI Risk Management Framework, turning interaction-design observations into artifacts usable for compliance and audit purposes. Specifically, it supports local execution using open models (via Ollama), making it suitable for privacy-sensitive audits, and integrates with Inspect AI to support standardized, reproducible evaluation reporting.
About the tool
You can click on the links to see the associated tools
Developing organisation(s):
Tool type(s):
Objective(s):
Impacted stakeholders:
Purpose(s):
Target sector(s):
Country/Territory of origin:
Lifecycle stage(s):
Type of approach:
Maturity:
Usage rights:
License:
Target groups:
Target users:
Stakeholder group:
Validity:
Enforcement:
Benefits:
Geographical scope:
People involved:
Required skills:
Technology platforms:
Tags:
- human-in-the-loop ai governance
- human-in-the-loop
- llm-as-judge
- hax-18
- human oversight
- human-ai interaction
Use Cases
Would you like to submit a use case for this tool?
If you have used this tool, we would love to know more about your experience.
Add use case
Partnership on AI
