Please describe any measures used to ensure data quality and fairness across the data collection and curation stage (e.g., dataset audits, filtering training data to remove harmful content or personal information, fine-tuning on curated data, use of moderation tools, assessment of limitations to model generalisability).
Our organization does not develop or train foundation AI models.
We use third-party AI models and apply governance controls to the data, knowledge sources, testing datasets, and evaluation processes used in our AI solutions.
Before use, datasets and knowledge sources undergo review for quality, relevance, accuracy, completeness, and compliance with applicable privacy requirements.
Personal information is removed or anonymized where required. Data used for testing and evaluation is curated and approved before use.
The organization uses a combination of internal datasets and publicly available reference datasets where appropriate. In the clinical research and clinical trial domain, publicly available scientific, regulatory, and industry-standard data sources can be used to support data quality assessment, benchmark development, and evaluation activities.
Domain experts review datasets and evaluation results to verify accuracy, consistency, and suitability for the intended use case.
Data can be labelled manually by subject matter experts or through controlled data-processing pipelines. The organization performs quality checks to verify the correctness of labels and metadata.
The organization uses Microsoft evaluation capabilities in Azure AI services and Copilot Studio to assess output quality, grounding, hallucination rates, safety, fairness, reliability, and performance. Test datasets are used to evaluate system behavior under representative use conditions.
The organization reviews known limitations of datasets, evaluation datasets, and knowledge sources. Risk assessments consider data coverage, potential bias, domain limitations, and the ability of evaluation results to generalize to real-world use cases.
If testing identifies quality, fairness, safety, privacy, or performance concerns, the organization implements corrective actions before deployment. These actions can include dataset updates, additional review by subject matter experts, changes to prompts or guardrails, additional testing, or restrictions on system use.
The organization maintains monitoring and periodic review activities to verify that data quality, system performance, and risk controls remain effective throughout the operational life of the AI system.