Zomato bans AI-generated food images after customer complaints

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Zomato CEO Deepinder Goyal announced the removal of all AI-generated dish images from the platform following numerous customer complaints that these misleading visuals breached trust, triggered refunds, and led to lower restaurant ratings. He urged restaurant partners to stop using AI for menu photos to ensure authenticity.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems to generate food images that mislead customers, causing harm in the form of breach of trust and financial consequences (refunds). This harm is directly linked to the AI-generated content used on the platform. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to consumers and businesses through misleading representations and associated negative outcomes.[AI generated]
AI principles
AccountabilityTransparency & explainabilityRobustness & digital security

Industries
Food and beveragesConsumer services

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyReputational

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard

Thumbnail Image

Zomato bans use of AI-generated food images - ET CIO

2024-08-19
ETCIO.com
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate food images that mislead customers, causing harm in the form of breach of trust and financial consequences (refunds). This harm is directly linked to the AI-generated content used on the platform. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm to consumers and businesses through misleading representations and associated negative outcomes.
Thumbnail Image

Will remove AI-generated food images: Zomato CEO after complaints - ET CISO

2024-08-19
ETCISO.in
Why's our monitor labelling this an incident or hazard?
An AI system (PicNic AI) was used to generate food images, which directly led to harm in the form of misleading customers, breach of trust, and financial consequences (refunds). This constitutes harm to consumers and potentially to businesses relying on accurate representation, fitting the definition of an AI Incident due to realized harm caused by AI-generated misleading content. The CEO's response to remove such images confirms the harm has occurred and is being addressed.
Thumbnail Image

"Leads To Breach Of Trust": Zomato To Remove AI-Generated Food Images

2024-08-18
NDTV
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (PicNic AI) to generate food images. The AI-generated images misled customers, causing harm in the form of breach of trust, increased refunds, and lower customer ratings, which are harms to consumers and businesses. This fits the definition of an AI Incident because the AI system's use directly led to harm (a breach of trust and financial harm). The company's response to remove such images is a mitigation measure but does not change the classification of the original harm caused.
Thumbnail Image

Mint Primer | No way to tell a fake: AI images face reality check

2024-08-22
mint
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI-generated images causing misleading impressions to customers, leading to complaints, refunds, and lower ratings, which are harms to consumers and communities. The AI system's use directly caused these harms. The event is not merely a potential risk but a realized harm, as evidenced by customer complaints and Zomato's policy change. Hence, it meets the criteria for an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Zomato's Deepinder Goyal promises to remove AI-Generated food image from menus, says 'leads to breach of trust...' | Mint

2024-08-18
mint
Why's our monitor labelling this an incident or hazard?
The AI system is used to generate food images that are misleading customers, causing harm in the form of breach of trust, complaints, refunds, and lower ratings. This fits the definition of an AI Incident because the AI system's use has indirectly led to harm to communities (customers) and a violation of trust. The company's response to remove such images and discourage their use further confirms the recognition of harm. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

'Customers Say...': Why Is Zomato Removing AI-Generated Food Images?

2024-08-18
TimesNow
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate food images, but the primary focus is on the company's policy to remove such images to prevent misleading representations. There is no indication of harm caused by the AI-generated images, nor a plausible future harm described. The event is about a governance or policy response to AI use, enhancing understanding of AI's impact on the platform's ecosystem.
Thumbnail Image

Zomato Bans AI-Generated Food Images After Spike In Customer Complaints

2024-08-18
Jagran English
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate images of food dishes, which has directly led to harm in the form of misleading customers, breaching trust, and causing financial and reputational harm to both customers and the company. This fits the definition of an AI Incident because the AI system's use has directly led to harm to customers (harm to communities and consumer trust) and economic harm (refunds, complaints). The company's response to remove AI-generated images is a mitigation measure but does not negate the fact that harm has occurred.
Thumbnail Image

Zomato won't show you AI-made food photos anymore, here's why

2024-08-20
The Financial Express
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate food images, which were then used on the platform. The AI-generated images caused indirect harm by misleading users, resulting in trust issues, refund claims, and lower ratings, which are harms to consumers and the community. The company's response to remove such images and ban their use in marketing confirms the recognition of harm caused. Therefore, this qualifies as an AI Incident due to realized harm linked to AI system use.
Thumbnail Image

Zomato to remove AI-generated food images after customer backlash

2024-08-19
India TV News
Why's our monitor labelling this an incident or hazard?
The AI system (PicNic AI) was used to generate food images that misled customers, resulting in harm to customer trust and business reputation, which fits the definition of an AI Incident due to indirect harm to people and businesses. The harm is realized, not just potential, as evidenced by refund requests and lower ratings. Therefore, this event qualifies as an AI Incident.
Thumbnail Image

Zomato bans AI-generated food images in menus after surge in complaints from customers

2024-08-18
OpIndia
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI-generated images (an AI system) in restaurant menus, which has led to customer complaints about misleading representations. This has caused indirect harm to customers in terms of trust breaches, complaints, refunds, and lower ratings, which can be considered harm to communities or consumers. Since the harm has occurred and is linked to the AI system's use, this qualifies as an AI Incident. The company's response to remove such images is a mitigation measure but does not change the classification of the event as an incident.
Thumbnail Image

Zomato Bans AI-Generated Food Images to Maintain Customer Trust

2024-08-18
Analytics India Magazine
Why's our monitor labelling this an incident or hazard?
The event describes how AI-generated images have directly led to customer dissatisfaction and business harm (refunds, lower ratings), which are harms to customers and businesses. The AI system's use in generating misleading or inauthentic food images is the cause of these harms. The company's response to ban and remove such images confirms the recognition of harm. Hence, this is an AI Incident as the AI system's use has directly caused harm.
Thumbnail Image

Zomato Can Learn Generative AI From Swiggy

2024-08-21
Analytics India Magazine
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems used for generating and enhancing food images and for consumer interaction. It raises concerns about the potential for AI-generated images to mislead consumers and promote unhealthy eating habits, which could be considered harm to communities or health if realized. However, these harms are presented as potential risks rather than actualized incidents. The companies' responses, such as Zomato's ban on AI-generated menu images and Swiggy's hybrid approach, indicate efforts to prevent harm. Since no direct or indirect harm has occurred yet, but plausible future harm is credible, this qualifies as an AI Hazard rather than an AI Incident or Complementary Information.
Thumbnail Image

Keeping It Real: Zomato Bans AI-Generated Food Images After Surge In Complaints From Customers

2024-08-19
Free Press Journal
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI-generated images, which are misleading customers and causing harm in the form of breach of trust and financial losses (complaints and refunds). However, the company is responding by banning such images and removing them, indicating the harm is recognized and being addressed. The AI system's use led to indirect harm to customers and the business's reputation. This constitutes an AI Incident because the AI-generated content directly led to harm (misleading customers and financial consequences).
Thumbnail Image

Zomato Cracks Down on AI-Generated Menu Images Amid Customer Complaints | Business

2024-08-18
Devdiscourse
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate menu images, which has indirectly led to harm in the form of misleading customers, breach of trust, and increased complaints. This constitutes harm to consumers and communities through misinformation and deception. Since the harm has already occurred and the company is responding to it, this qualifies as an AI Incident. The AI system's use in generating misleading images directly contributed to the harm experienced by customers and the platform's reputation.
Thumbnail Image

Business News | Zomato Bans AI-generated Food Images After Surge in Complaints from Customers | LatestLY

2024-08-18
LatestLY
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate food images, which are then used in restaurant menus. Customers complained that these AI-generated images were misleading, leading to harm in the form of breach of trust, increased complaints, refunds, and lower ratings. This constitutes harm to consumers and businesses, fitting the definition of an AI Incident where the AI system's use indirectly led to harm. The company's response to remove such images is a mitigation measure but does not change the classification of the event as an AI Incident.
Thumbnail Image

Zomato bans AI-generated food images after surge in complaints from customers

2024-08-18
Asian News International (ANI)
Why's our monitor labelling this an incident or hazard?
The event explicitly involves the use of AI systems to generate food images that mislead customers, causing harm in the form of breach of trust and financial consequences (complaints and refunds). This harm is directly linked to the AI-generated images used in menus. The company's active removal of such images and discouragement of their use confirms the recognition of harm caused by the AI system's outputs. Hence, this qualifies as an AI Incident due to the realized harm to consumers and the company's response to mitigate it.
Thumbnail Image

Zomato Urges Its Restaurants To STOP Using AI Images Of Food, Calls It Breach Of Trust

2024-08-18
NewsX
Why's our monitor labelling this an incident or hazard?
AI-generated images are explicitly mentioned as the source of misleading content causing customer dissatisfaction and financial harm. The harm is indirect, stemming from the use of AI-generated images that misrepresent food, leading to breach of trust and economic consequences. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to harm to customers and businesses.
Thumbnail Image

Will remove AI-generated food images: Zomato CEO after complaints

2024-08-18
Weekly Voice
Why's our monitor labelling this an incident or hazard?
An AI system (PicNic AI) was used to generate food images, which directly led to harm in the form of misleading customers, breach of trust, and financial consequences (refunds) for restaurants and the platform. This constitutes harm to consumers and businesses, fitting the definition of an AI Incident due to the realized harm caused by the AI-generated content. The company's response to remove such images is a mitigation measure but does not change the fact that harm occurred.
Thumbnail Image

Zomato bans AI-generated food images after surge in complaints from customers

2024-08-18
Cambodian Times
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated images (an AI system generating content) used in restaurant menus. The use of these AI-generated images has directly led to customer complaints about misleading representations, breaches of trust, and financial consequences (refunds), which constitute harm to consumers and communities. The company is responding by banning such images and removing them, indicating the harm is materialized. Hence, this is an AI Incident due to realized harm caused by the AI system's outputs.
Thumbnail Image

Great News For Food Lovers! Zomato CEO Deepinder Goyal Bans THIS on His Platform, Urges Restaurant Owners to Follow

2024-08-18
DNP INDIA
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI-generated images, which are considered misleading and have caused customer complaints and harm to businesses. However, the article describes a policy decision and enforcement plan to prevent such harm rather than an incident where harm has already occurred due to AI misuse or malfunction. Therefore, this is a governance and response measure to an existing issue, enhancing understanding and management of AI-related risks, fitting the definition of Complementary Information rather than an AI Incident or Hazard.
Thumbnail Image

Zomato to ditch AI-generated food images after customer complaints | Business Upturn

2024-08-20
Business Upturn
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems to generate food images that misled customers, resulting in harm to consumer trust and financial consequences for restaurants and the platform. This constitutes harm to communities (customers) and a breach of trust, which aligns with violations of rights and clearly articulated harms caused by AI use. Therefore, this qualifies as an AI Incident due to the realized harm from AI-generated misleading content.
Thumbnail Image

Zomato announces removal of AI-generated food images from platform following customer complaints

2024-08-21
News9live
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate food images that misled customers about the actual appearance of dishes, leading to customer complaints, trust breaches, refunds, and lower ratings. This harm is directly linked to the AI-generated content's misleading nature. The event involves the use of AI and the resulting realized harm to consumers, fitting the definition of an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Zomato Bans AI-Generated Food Images After Rise In Complaints, Refunds

2024-08-18
NDTV Profit
Why's our monitor labelling this an incident or hazard?
The event explicitly involves AI-generated images being used in restaurant menus, which misled customers and caused harm in the form of complaints and refunds. This meets the criteria for an AI Incident because the AI system's use has directly or indirectly led to harm to people (financial and consumer harm). The company's response to ban such images is a mitigation measure but does not change the classification of the event as an AI Incident.