Exposed AI Deepfake Database Raises Human Rights Concerns

The event describes an AI system (an AI 'nudify' app) generating explicit deepfake images, including non-consensual use of real individuals' faces and celebrities portrayed as children. The exposure of this database constitutes a direct violation of privacy and ethical norms, which falls under violations of human rights and breaches of applicable laws protecting personal rights. The AI system's use has directly led to realized harm, qualifying this as an AI Incident rather than a hazard or complementary information. The harm is clear and ongoing, involving serious privacy and legal concerns.

The event involves an AI system (GenNomis) that generates explicit images, including illegal child sexual abuse material and non-consensual deepfake pornography, which are serious violations of law and human rights. The AI system's outputs were stored in an unsecured cloud bucket, exposing tens of thousands of such images publicly. This exposure and the generation of illegal content directly cause harm to individuals depicted and society at large. The article documents realized harm, not just potential harm, and the AI system's role is pivotal in creating and exposing this content. Hence, it meets the criteria for an AI Incident.

The event describes a breach of an AI system's database containing AI-generated explicit images, including non-consensual deepfakes of minors and celebrities, which is a clear violation of privacy and ethical norms, constituting harm to individuals and communities. The AI system's use (image generation and face swapping) directly led to the creation and exposure of harmful content. The breach and exposure of this data caused realized harm, not just potential harm. Hence, it meets the criteria for an AI Incident due to violations of rights and harm to communities.

The event explicitly involves AI systems used to generate harmful and illegal content, including AI-generated CSAM and nonconsensual sexual images. The exposure of this data and the existence of such content directly harm individuals' rights and well-being, fulfilling the criteria for an AI Incident. The AI system's use in generating and distributing this content is central to the harm described, and the incident involves realized harm, not just potential harm.

The event describes a data breach of an AI system's database containing AI-generated explicit and non-consensual deepfake images, including of minors and celebrities, which directly causes harm through privacy violations, potential extortion, and reputational damage. The AI system's development and use (face-swapping and AI-generated explicit content) are central to the harm. The exposure of this sensitive data without protection and the presence of illegal content constitute a clear violation of rights and ethical norms. The incident has already occurred and caused harm, meeting the criteria for an AI Incident rather than a hazard or complementary information.