Please provide any further comments and implementation documentation.
Question 12 — vulnerability management
OpenAI receives vulnerability reports through its security and safety bounty programs and provides an encrypted channel for reporting security incidents. Its disclosure policy also describes coordination for vulnerabilities found in third-party software and its role as a CVE Numbering Authority.
For covered frontier systems, security assessments include red teaming, penetration testing and vulnerability scanning.
Question 13 — post-deployment practices
OpenAI disallows the use of our models and tools for certain activities and content, as outlined in our terms and usage policies. These policies are designed to prohibit the use of our models and tools in ways that cause individual or societal harm. We periodically update these policies in response to new risks and new information on how our models are being used. Access to and use of our models are also subject to OpenAI’s Terms of Use and our Business Terms. We employ a combination of guardrails, tools, policies, and processes to detect and enforce against abuse of our models. In addition to usage policies, we employ automated systems (for example, our Moderation API) and AI-powered tools to detect and prevent harmful content, human reviewers and expert investigators to conduct detailed investigations of model behavior and platform abuse, and external input to help our teams iterate on and regularly improve our moderation, detection, disruption, and enforcement capabilities. We publish information related to our post-deployment monitoring, mitigation and enforcement activities.
We build robust monitoring systems to detect potential model misalignment. We view model alignment as the primary lever to prevent potential misaligned behavior from our models. However, monitoring provides broad visibility into frontier model behavior, illuminating opportunities to further improve alignment and safety. This serves as an additional layer of protection against misaligned behavior that is detected.
Addressing vulnerabilities, incidents, emerging risks and misuse often requires participation from a number of teams across the company, including where applicable, teams responsible for research; safety and alignment; product; user or customer relationships and support; intelligence, investigations and teams supporting scaled detection and enforcement; security; policy teams; global affairs; legal and privacy; and communications.
Post-deployment, we rely on monitoring, user feedback, periodic security evaluations, and incident reporting to track risk emergence over time. Material findings can be fed back into model update cycles, safety classifiers, or policy adjustments.
Questions 14 and 14A — agentic systems and controls
Yes. Some of our products can perform supported tasks using tools and a cloud browser, including reading websites and completing multi-step workflows. It pauses when it needs user input, sign-in, or confirmation. Cloud browser documentation.
We design controls to help users remain in charge of an agent’s work. In our agentic products, users can manage website permissions, review consequential actions, and take over the cloud browser. OpenAI tests for prompt injection, phishing, and unintended actions, among other things.
We also train and test the agent to resist prompt injection: attempts to make it follow malicious instructions hidden in material it encounters, such as a webpage. Monitoring helps us detect and respond to these attacks. Secure browser takeover allows users to enter credentials without exposing those inputs to the model. Together, these measures address risks that arise when an agent uses outside information or works through services where the user is signed in.
Additionally, we train the model to be aligned with human intentions, and monitor for misalignment issues. This monitoring helps us detect and respond to issues as they arise in internal and external deployment, allowing us to iterate on further safeguard and evaluation development.