Catalogue of Tools & Metrics for Trustworthy AI

These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.

Aival Analysis Lab



Aival Analysis Lab

Independent Quality Assurance for AI in healthcare. The Aival Analysis Lab is a suite of software solutions to streamline and standardise AI assessment. The software allows clinical users to independently and rigorously analyse an AI system, giving them the confidence they need to know that it will work at their local site and for their patients, before procurement and through use.

 

Evaluate and Compare 

Clinicians and decision makers can evaluate and compare different AI products quickly, and choose the ones which offer greatest clinical benefit. The anaylsis creates reports on performance, fairness, robustness and explainability of the query product and highlights any inequities between population subgroups. Different AI products for the same application can be compared along the same baseline.

 

Monitor

Once an AI product is in use, Aival allows a hospital to audit and monitor the AI product to ensure performance and fairness is maintained over time. Safety alerts can be set to be warned for any potential drift in the AI results.

 

Curate

The software allows hospitals to collect and ground-truth data for evaluation from the local site, with user account management to control permissions.

About the tool


Developing organisation(s):




Impacted stakeholders:



Target sector(s):


Country of origin:



Type of approach:


Usage rights:


License:



Target users:


Stakeholder group:





Geographical scope:


People involved:


Required skills:


Technology platforms:


Tags:

  • fairness
  • performance
  • auditing
  • healthcare
  • validation

Modify this tool

Use Cases

There is no use cases for this tool yet.

Would you like to submit a use case for this tool?

If you have used this tool, we would love to know more about your experience.

Add use case
catalogue Logos

Disclaimer: The tools and metrics featured herein are solely those of the originating authors and are not vetted or endorsed by the OECD or its member countries. The Organisation cannot be held responsible for possible issues resulting from the posting of links to third parties' tools and metrics on this catalogue. More on the methodology can be found at https://oecd.ai/catalogue/faq.