Please provide any further comments and implementation documentation.
Q7 practices by lifecycle stage.
Plan and design: agree the use, the data scope and the role of people with the customer; design so that people make important final decisions; use deterministic rules where a rule can decide, with the model choosing among fixed options where possible
Collect and process data: limit the fields sent to a model; remove or mask personal data that is not needed; keep confidential data out of source repositories; check for secrets before code is committed (in place in the Representative Member's development environment and being extended to all staff)
Build, integrate and interpret model: use third-party foundation models under terms or settings where inputs are not used for training; keep code and prompts under version control
Verify and validate: measure each processing stage; test with paraphrased questions; prompt-injection test cases on some projects; review by a person
Deploy: use criteria agreed with the customer; separate staging from production; release in stages where possible
Operate and monitor: keep measuring accuracy after release and investigate drops; cloud audit logs and security monitoring on projects we run
Notes on the selections above.
Q9A: we do not train foundation models.
Q10: Controls for organizational customers: the scope of data sent to a model is agreed for each project.
Q10: Privacy-Enhancing Technologies: masking, k-anonymization and synthetic test data on some projects.
Q11A: Incident response, disaster recovery or business continuity plans: incident response in place; business continuity plan in preparation.
Q11B: MFA and role-based access controls: see Q11E.
Q11B: Security testing focused on AI-specific risks: on some projects.
Q13: Post-deployment monitoring: for systems we operate.
Q13: Monitoring and emergency controls specific to agentic AI systems: agents can be interrupted and their access revoked.
Q14: We use AI agents for software development and back-office work, and we build retrieval and answering systems with agent-like steps for customers.
Q14A: Constraints on the agent's action space: tool-use permissions, separate accounts, scope limits.
Q14A: Human oversight or interruptibility mechanisms: outbound messages to customers and authorities, payments and signatures need a person's approval, except routine actions the Representative Member has approved in advance.
Q14A: Logging of agent actions: including a log of actions completed automatically.