These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
Type
Origin
Scope
SUBMIT A TOOL
If you have a tool that you think should be featured in the Catalogue of AI Tools & Metrics, we would love to hear from you!
SUBMITSAIF CHECK
ProceduralSaudi ArabiaUploaded on Mar 26, 2024LLM Survey for responsible and transparent and safe AI covering international compliance regulations and data/ model evaluations
Objective(s)
Towards Measuring and Mitigating the Environmental Impacts of Large Language Models
ProceduralUploaded on Nov 14, 2023Advice for government, regulators and developers on how to minimize environmental impacts across the full life cycle of large language models.
Objective(s)
Related lifecycle stage(s)
Operate & monitorVoluntary Code of Conduct on the Responsible Development and Management of Advanced Generative AI Systems
ProceduralCanadaUploaded on Nov 14, 2023In undertaking this voluntary commitment, developers and managers of advanced generative systems commit to working to achieve outcomes related to the OECD AI principles.
Objective(s)
Related lifecycle stage(s)
Operate & monitorDeployVerify & validateCollect & process dataPlan & designNIST Trustworthy & Responsible Artificial Intelligence Resource Center (AIRC)
ProceduralUploaded on Oct 26, 2023The AIRC supports all AI actors in the development and deployment of trustworthy and responsible AI technologies. AIRC supports and operationalizes the NIST AI Risk Management Framework (AI RMF 1.0) and accompanying Playbook and will grow with enhancements to enable an interactive, role-based experience providing access to a wide-range of relevant AI resources.
Objective(s)
Artificial Intelligence Risk Management Framework (AI RMF 1.0)
ProceduralUploaded on Oct 26, 2023The goal of the AI RMF is to offer a resource to the organizations designing, developing, deploying, or using AI systems to help manage the many risks of AI and promote trustworthy and responsible development and use of AI systems.
Objective(s)
Fairly AI: FAIRLY End-to-End AI Governance Platform
Uploaded on Sep 14, 2023<1 dayFAIRLY provides an AI governance platform focussed on accelerating the broad use of fair and responsible AI by helping organisations bring safer AI models to market.
Objective(s)
Trustworthy and Ethical Assurance Platform
ProceduralUnited KingdomUploaded on Sep 11, 2023>1 yearThe Trustworthy and Ethical Assurance platform is an open-source tool and framework to support the process of developing and communicating trustworthy and ethical assurance cases for data-driven technologies.
Objective(s)
CESIUM
United KingdomUploaded on Sep 11, 2023Using the latest advances in ethical artificial intelligence, CESIUM supports risk-assessment for safeguarding the most vulnerable children in society.
Objective(s)
Data Carbon Scorecard
TechnicalEducationalProceduralUploaded on Jul 4, 2023The Data Carbon Scorecard provides a rapid assessment of the environmental impact of your proposed data project enabling you to quickly gauge the CO2 implications of your data project and determine the ‘best’ course of action for the environment. Through answering just 9 questions, the scorecard provides you with a traffic light display of data CO2 hotspots and an overall Data CO2 Score for the whole project within minutes. The scorecard can be used by any individual, team, or organization.
Objective(s)
Guide to the Generative AI Revolution
ProceduralUnited StatesUploaded on Jun 12, 2023Generative AI presents unprecedented opportunities. But it also forces CEOs to grapple with towering unknowns, and to do so in a space that may feel unfamiliar or uncomfortable. Crafting an effective strategic approach to generative AI can help distinguish the signal from the noise. Leaders who are prepared to reimagine their business models—identifying the right opportunities, organizing their workforce and operating models to support generative AI innovation, and ensuring that experimentation doesn’t come at the expense of security and ethics—can create long-term competitive advantage.
Objective(s)
5 Guidelines for Responsible Development in Generative AI
ProceduralUnited StatesUploaded on Jun 12, 2023Salesforce is embedding ethical guardrails and guidance across their products to help customers innovate responsibly — and catch potential problems before they happen. Given the tremendous opportunities and challenges emerging in this space, they are building on their Trusted AI Principles with a new set of guidelines focused on the responsible development and implementation of generative AI.
Objective(s)
Experiment Impact Tracker
TechnicalUploaded on May 23, 2023The experiment-impact-tracker is meant to be a simple drop-in method to track energy usage, carbon emissions, and compute utilization of your system.
Objective(s)
Carbon Emissions and Large Neural Network Training
TechnicalUploaded on May 23, 2023Carbon estimation of LLMs.
Objective(s)
Data Carbon Ladder
TechnicalEducationalProceduralUnited KingdomUploaded on May 11, 2023To accelerate the journey to net zero, our team has designed the first publicly available tool to be used on new data projects to assess and measure the data CO2 footprint along the dataflow, called the “Data Carbon Ladder”. Using this tool, organizations can reduce their data CO2 footprint by ensuring optimal dataset(s) selection, frequency of updates, storage location, and analytics for the project to not only succeed but to do so in the most environmentally friendly way.
Objective(s)
CivicLytics (civic big data analytics)
TechnicalEducationalUploaded on Apr 12, 2023An AI tool that allows you to understand complex civic issues by listening to the perceptions and concerns of millions of citizens in Latin America and the Caribbean in real time.
Objective(s)
GRACE
TechnicalProceduralUploaded on Mar 30, 2023<1 dayGRACE is an AI governance platform that offers a central registry for all AI models, tools, and workflows for risk mitigation, compliance, and collaboration across AI teams and projects. It provides real-time compliance, transparency, and trust while promoting AI innovation. The platform works across all major cloud vendors and offers out-of-the-box frameworks for complying with EU AI Act, AI standards, data regulations, and AI frameworks.
Objective(s)
Related lifecycle stage(s)
Operate & monitorDeployVerify & validateBuild & interpret modelCollect & process dataPlan & designHAiPECR
TechnicalEducationalProceduralUploaded on Apr 4, 2023<1 dayThe Human-Ai Paradigm for Ethics, Conduct and Risk (HAiPECR)
Objective(s)
Related lifecycle stage(s)
Verify & validateFramework for meaningful engagement of external stakeholders in AI development
ProceduralUploaded on Mar 23, 2023Framework for meaningful engagement of external stakeholders has been developed in the context of AI impact assessments. The Framework articulates minimum criteria for engagement and uses these as a baseline for involving companies, public entities as well as multilateral bodies during AI design and development. It also includes practical tools, steps and phases building on existing work on human rights due diligence.
Objective(s)
Related lifecycle stage(s)
Operate & monitorDeployBuild & interpret modelCollect & process dataPlan & designBig Data Analytics and Artificial Intelligence for Impact - Free Training Course
EducationalInternationalUploaded on Mar 20, 2023Climate change, infectious diseases, disasters, air pollution, migration and poverty are among the most critical challenges the world faces today. This four-week, online course looks at the role mobile technology, advanced analytics and artificial intelligence can play in drastically improving the effectiveness and efficiency of planning and responses to these challenges.
Objective(s)