AI Face-Swapping App Avatarify Removed Amid Privacy and Rights Violations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The AI face-swapping app Avatarify, which went viral in China with over 29 billion video views, was removed from the Chinese App Store after concerns about privacy breaches, copyright infringement, and potential misuse for bypassing facial recognition. The app's popularity led to actual privacy and rights violations, prompting regulatory action.[AI generated]

Why's our monitor labelling this an incident or hazard?

The app uses AI to manipulate photos into animated videos, which directly involves an AI system. The widespread use and monetization of these AI-generated videos have led to privacy concerns and copyright infringement, constituting violations of rights and legal obligations. These harms have materialized, as evidenced by the app's removal from the market. Therefore, this qualifies as an AI Incident due to realized harm linked to the AI system's use.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsAccountability

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsEconomic/Property

AI system task:
Recognition/object detectionContent generation


Articles about this incident or hazard