AI Chatbot 'Meiyu Auntie' Upgraded to Combat Image-Based Scams and Misinformation

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Gogolook's AI chatbot 'Meiyu Auntie,' in collaboration with the Institute for Information Industry, launched new features to detect misinformation in images and assess cryptocurrency wallet risks. The system uses AI to identify scams and false information, helping prevent harm from fraud and misinformation on messaging platforms.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system "美玉姨" is explicitly mentioned as using AI technology to detect fraudulent messages and assess risks, which directly helps prevent harm to individuals by reducing scams and misinformation. Since the AI system's use is directly linked to preventing harm to people (fraud victims), this qualifies as an AI Incident under the definition of harm to persons or communities caused by AI system use. The article reports the system's deployment and active use, indicating realized harm prevention rather than just potential risk, so it is not merely complementary information or a hazard.[AI generated]
AI principles
Privacy & data governanceTransparency & explainabilityRobustness & digital securityFairnessAccountabilityRespect of human rightsSafetyDemocracy & human autonomy

Industries
Digital securityMedia, social platforms, and marketingFinancial and insurance services

Harm types
Economic/PropertyReputationalPsychologicalHuman or fundamental rightsPublic interest

Severity
AI incident

Business function:
Citizen/customer serviceMonitoring and quality controlICT management and information security

AI system task:
Recognition/object detectionEvent/anomaly detectionForecasting/predictionInteraction support/chatbots


Articles about this incident or hazard

Thumbnail Image

資策會助攻 「美玉姨」防詐升級、長輩圖假訊息掰掰 - 自由財經

2022-12-20
自由時報電子報
Why's our monitor labelling this an incident or hazard?
The AI system "美玉姨" is explicitly mentioned as using AI technology to detect fraudulent messages and assess risks, which directly helps prevent harm to individuals by reducing scams and misinformation. Since the AI system's use is directly linked to preventing harm to people (fraud victims), this qualifies as an AI Incident under the definition of harm to persons or communities caused by AI system use. The article reports the system's deployment and active use, indicating realized harm prevention rather than just potential risk, so it is not merely complementary information or a hazard.
Thumbnail Image

資策會聯手美玉姨 不實長輩圖訊息OUT - 熱門新訊 - 自由電子報

2022-12-19
自由時報
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (the "美玉姨" chatbot with AI-based image rumor detection) to address misinformation and scams. However, there is no indication that the AI system has caused any harm or malfunctioned. Instead, it is used proactively to prevent harm by identifying and blocking false information. Therefore, this is not an AI Incident or AI Hazard but rather Complementary Information about societal and technical responses to AI for misinformation control.
Thumbnail Image

查核不實圖資再進化 資策會聯手美玉姨提升AI查核科技 | 產業熱點 | 產業 | 經濟日報

2022-12-20
Udnemoney聯合理財網
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system developed and deployed to detect and mitigate misinformation and scams, which are forms of harm to communities and individuals. The AI system's use directly addresses the harm by identifying and blocking false information, thus preventing potential harm. Since the AI system is actively used to counter misinformation and scams, which are realized harms, this qualifies as an AI Incident. The article does not describe a potential future risk but an ongoing harm mitigation through AI use.
Thumbnail Image

美玉姨防詐騙升級 長輩圖謠言與虛擬錢包地址騙不了人 | 產業熱點 | 產業 | 經濟日報

2022-12-20
Udnemoney聯合理財網
Why's our monitor labelling this an incident or hazard?
The AI system '美玉姨' is explicitly mentioned and described as using AI technology to analyze images and blockchain data to detect scams and misinformation. Its use directly prevents harm to individuals by blocking fraudulent messages and warning about risky virtual wallet addresses, which are forms of financial and informational harm. Since the AI system's use is actively preventing realized harm from scams and misinformation, this qualifies as an AI Incident under the definition of harm to persons and communities caused by AI system use.
Thumbnail Image

LINE美玉姨變更強!新增「圖片謠言辨識」 7功能一次看 | 科技電玩 | 生活 | NOWnews今日新聞

2022-12-20
NOWnews 今日新聞
Why's our monitor labelling this an incident or hazard?
The AI system "美玉姨" is explicitly mentioned as using AI technology to identify and verify suspicious messages and images, which directly helps prevent harm to users from scams and misinformation. The system's use is aimed at reducing realized harm (fraud, misinformation) in communication platforms. Therefore, this event involves the use of an AI system that has directly led to harm prevention, which qualifies as an AI Incident because the AI system's role is pivotal in addressing and mitigating harms related to misinformation and scams.
Thumbnail Image

訊息查證機器人美玉姨升級 揪出長輩圖詐騙 | 科技 | 中央社 CNA

2022-12-20
Central News Agency
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (the fact-checking chatbot '美玉姨') that is actively used to identify and prevent misinformation and fraud. However, the article does not report any incident of harm caused by the AI system itself, nor does it describe any plausible future harm stemming from the AI system's development or use. Instead, it reports on the AI system's new functionalities aimed at reducing harm. Therefore, this is complementary information about AI developments and responses to AI-related challenges, not an AI Incident or AI Hazard.
Thumbnail Image

美玉姨擴大防詐範圍 圖片謠言與虛擬錢包地址也難不倒 | 科技 | 三立新聞網 SETN.COM

2022-12-20
三立新聞
Why's our monitor labelling this an incident or hazard?
The AI system "Meiyu Auntie" is explicitly mentioned as using AI technologies such as multimodal message comparison and AI blockchain transaction monitoring to detect suspicious images and risky cryptocurrency wallet addresses. The system's use is aimed at preventing scams and misinformation, which are forms of harm to communities and individuals' property (financial assets). However, the article does not report any actual harm occurring due to the AI system's malfunction or misuse; rather, it focuses on the AI system's deployment to reduce harm. Therefore, this event does not describe an AI Incident or AI Hazard but rather a societal and technical response to AI-related risks, enhancing understanding and prevention. This fits the definition of Complementary Information.