AI-Powered Monitoring in Iranian Messaging App 'Bale' Sparks Privacy Violation Outcry

The messaging app uses a monitoring system that enables employees to access and read users' private messages, which constitutes a violation of users' privacy rights. This involves an AI system or algorithmic monitoring tool that processes user communications. The direct access to private data by employees through this system leads to a breach of fundamental rights related to privacy and data protection, fulfilling the criteria for an AI Incident under violations of human rights or breach of obligations intended to protect fundamental rights.

An AI system is involved as the messaging platform uses automated algorithms to analyze message content for moderation purposes. The event involves the use of this AI system in monitoring user communications, which has directly led to concerns and allegations of privacy violations, a breach of users' rights. Although the company claims private messages are not accessed, the fact that employees can view monitored content and that this has caused public outcry about privacy constitutes a violation or at least a significant harm to user privacy rights. Therefore, this qualifies as an AI Incident due to the realized harm related to privacy and rights violations stemming from the AI system's use and its operational practices.

An AI system is explicitly involved in the use of text mining to detect harmful content, which is a form of AI use. However, the event does not report any actual harm caused by the AI system or its malfunction. Instead, it describes the AI system's role in content moderation and user privacy protection, which is a governance and operational detail. There is no indication of realized harm or plausible future harm from the AI system's use. Therefore, this event is best classified as Complementary Information, as it provides context on AI use and privacy safeguards without reporting an AI Incident or Hazard.

The event explicitly involves the use of AI algorithms for automated analysis of user messages in public channels and large groups, confirming the presence of an AI system. The use of this AI system directly leads to a violation of user privacy rights, a breach of obligations intended to protect fundamental rights. The platform's recent policy updates expanding AI monitoring without clear user notification or consent further exacerbate the harm. Since the AI system's use has directly led to realized harm (privacy violations and potential legal breaches), this qualifies as an AI Incident rather than a hazard or complementary information.

The messaging app uses automated algorithms to analyze user messages, which qualifies as an AI system involvement. The monitoring and access to private user communications without explicit consent constitutes a violation of privacy rights, a breach of fundamental rights protected by law. Since the harm (privacy violation) is occurring due to the use of AI-based monitoring, this event qualifies as an AI Incident.

The article mentions the use of AI-based text mining tools to identify fraudulent and inappropriate content in public channels and groups. However, it clarifies that private user data is not accessible to operators, and no privacy breach occurred. Since the AI system's use is described as functioning properly without causing harm, and the event is about verifying and confirming the absence of harm, this constitutes Complementary Information rather than an Incident or Hazard.

The event involves an AI system used for monitoring user messages within the messaging app. The confirmed access by employees to private user chats constitutes a violation of privacy rights, which falls under violations of human rights and legal protections. Since the AI system's use has directly led to harm in terms of privacy breaches and potential misuse of personal data, this qualifies as an AI Incident.