'Catastrophic, invisible': Supreme Court flags use of AI in legal process as 'misconduct'
2026-07-02
Hindustan Times
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
The Supreme Court of India set aside tribunal rulings after discovering they relied on fake, AI-generated legal precedents. The Court warned of catastrophic risks to judicial integrity from unregulated AI use, directed the Bar Council to establish guidelines, and declared zero tolerance for citing unverifiable AI-generated material in legal proceedings.[AI generated]
Why's our monitor labelling this an incident or hazard?
An AI system was used to generate fake legal precedents that were relied upon in a judicial decision, leading to a miscarriage of justice and violation of legal rights. This constitutes harm under the framework as a violation of human rights and breach of legal obligations. The AI's role in generating hallucinated material directly contributed to the harm. Therefore, this qualifies as an AI Incident. The court's response and call for disciplinary action are complementary information but do not change the classification of the event described.[AI generated]