Why news publishers are struggling to fend off AI bots scraping online content
2024-07-02
The Indian Express
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Perplexity AI, a startup using AI to generate search responses, is accused of copyright infringement and unethical web scraping by repurposing content from Forbes and other publishers without permission. The controversy highlights the challenges of AI systems navigating copyright laws and respecting web standards like robots.txt.[AI generated]
Why's our monitor labelling this an incident or hazard?
The article describes AI systems in active use—specifically web‐crawling AI bots—that have directly led to unauthorized copying and summarization of paywalled news articles and artwork, infringing on publishers’ intellectual property rights. This constitutes a realized harm (violation of IP rights) caused by the development and use of these AI systems.[AI generated]