YouTube introduces new AI feature to boost child safety and restrict adult content
2025-09-25
India TV News
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
YouTube has expanded its AI-driven age estimation tool, which analyzes user behavior to determine age and restricts accounts it deems under 18. Many adult users have been wrongly flagged as minors, resulting in loss of access and forced submission of sensitive ID documents, raising privacy and rights concerns.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved in the use phase, making decisions that affect user account settings and content accessibility. The misclassification of adult users as minors causes a form of harm related to user rights and potentially privacy, as users must upload sensitive documents for verification. This constitutes a violation of user rights and privacy, which falls under harm category (c) (violations of human rights or breach of obligations under applicable law). Since the harm is realized (users are affected and must take action), this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]