AI Error Causes Itch.io Domain Takedown

The incident stems from the use/misuse of an AI system (BrandShield) whose false positive takedown request caused real harm (site downtime and lost revenue). This meets the definition of an AI Incident: an AI system’s malfunction directly led to harm.

BrandShield’s AI-powered anti-phishing software produced a bogus phishing report (a false positive or hallucination), which the registrar’s automated process then used to disable Itch.io’s domain without human review. The AI system’s erroneous output directly disrupted the site’s operation, constituting a realized harm.

An AI system (the “AI-powered” brand protection software) malfunctioned by wrongly reporting a legitimate page as phishing. That automated misclassification directly led to the domain being disabled and the marketplace going offline for hours, disrupting Itch.io’s operations and creator income. This is a realized harm caused by the AI system’s malfunction, so it is classified as an AI Incident.

An AI system (BrandShield’s automated brand protection software) malfunctioned by generating a bogus phishing report, which directly led to the wrongful disabling of Itch.io’s domain. The disruption of the service qualifies as harm caused by an AI system’s erroneous output.

BrandShield is an AI-powered brand protection tool that erroneously filed a phishing report, leading the registrar to disable Itch.io’s domain and take the site offline. This malfunction of the AI system directly caused service disruption to Itch.io, constituting an AI Incident.

Funko’s AI system directly misidentified Itch.io as a phishing site, triggering a false report that disabled the domain and disrupted the site’s operation. The AI malfunction led to tangible harm (downtime, lost revenue), fitting the definition of an AI Incident.

BrandShield is explicitly described as an AI-powered system. Its use directly caused tangible disruption of itch.io’s operations—users and developers lost access to their projects and assignments. This qualifies as an AI Incident because the AI system’s outputs led to real harm (service outage and economic/operational damage).

The incident involves a deployed AI system that malfunctioned by generating a false phishing report, which directly led to the disruption of a live service and harm to users and developers who rely on the platform. This meets the criteria for an AI Incident, as the AI’s erroneous output caused real, material harm.

An AI system (Brand Shield) was involved in generating a false phishing report that caused a temporary disruption of a website's availability. However, there is no indication of injury, rights violations, or other harms resulting from this event. The incident was resolved without reported damage or ongoing issues. Therefore, this does not meet the threshold for an AI Incident or AI Hazard. It is best classified as Complementary Information because it provides context on AI system involvement in a disruption and the company's stance on AI usage, but no direct or plausible harm occurred.

BrandShield is described as an 'AI Powered' brand protection software that automatically flagged a fanmade page as fraudulent, leading to the domain registrar disabling Itch.io's domain. This automated AI system's false positive caused a significant disruption to the platform's operation, preventing indie developers from selling their products for several hours. The harm is indirect but clear: economic harm to developers and disruption of the platform's operation. Therefore, this qualifies as an AI Incident due to the AI system's malfunction directly leading to harm.

The AI system (BrandShield) was used in its intended function (brand protection) but malfunctioned by falsely flagging legitimate content, which led to the registrar's automated system disabling the domain without human intervention. This caused a significant disruption to the platform's operation and harmed users dependent on the site. The harm is indirect but clearly linked to the AI system's malfunction and its automated enforcement. Therefore, this qualifies as an AI Incident due to realized harm caused by the AI system's malfunction and its consequences.

The event involves an AI system (Brand Shield) whose automated report led to the disabling of a domain, causing disruption to the management and operation of a critical online platform (Itch.io). This disruption constitutes harm to the operation of critical infrastructure (the platform's online presence). Therefore, this qualifies as an AI Incident due to the AI system's use indirectly leading to operational harm.

An AI system (Brand Shield) was used for automated phishing detection and mistakenly flagged Itch.io, triggering automated domain disablement by the registrar. This caused a direct service disruption, making the platform inaccessible and impacting users. The harm is a direct consequence of the AI system's malfunction (false positive) and its automated use without sufficient human oversight. Therefore, this qualifies as an AI Incident because the AI system's malfunction directly led to harm (service disruption and user impact).

An AI system’s malfunction (BrandShield’s bogus phishing report) directly led to operational disruption and business harm for Itch.io. The involvement of an AI system in causing realized harm classifies this as an AI Incident.