Initiative overview
The Digital Marketplace Panel 2 (DMP2) supports Australian Government procurement of digital and ICT services. Evaluating supplier submissions for DMP2 involves reviewing large volumes of structured and unstructured information against defined criteria, which can be time consuming and resource intensive.
The DTA is using an AI enabled tool to support evaluators by providing a check of an assessment as an AI check tool. The capability is used strictly as decision support and does not make automated recommendations or determinations.
The objectives are to improve evaluation efficiency, promote greater consistency across assessment teams, and enable evaluators to focus more time on professional judgement, risk assessment and value for money considerations.
Results, outcomes and impacts:
The initiative is focused on testing feasibility and usability rather than delivering measurable efficiency gains. Initial observations suggest AI support may assist evaluators to navigate large and complex submissions and identify areas requiring closer review.
Challenges and lessons learned:
Key challenges include managing information security and privacy, avoiding overreliance on AI outputs, and ensuring alignment with procurement and probity requirements. These risks are mitigated by limiting AI use to decision support, requiring human validation of all outputs, and maintaining clear audit trails. A key lesson is that strong governance, clear guidance for evaluators, and careful prompt design and testing are essential. Success depends on transparency, human oversight, and clear communication that AI does not replace professional judgement.
