NEW DELHI: In the first case of its kind, Supreme Court on Thursday quashed orders passed by NCLT and NCLAT on the ground that they decided a case on the basis of AI-generated non-existent case laws and verdicts, cautioning that unchecked use of AI could distort the justice delivery system.A bench of Justices P S Narasimha and Alok Aradhe cautioned both the Bar and the Bench on the use of AI, saying the human element should remain in the driving seat and have “absolute and total control over the application and usage of AI”.”For us… the production of fake, non-existent, and hallucinated material and its utilisation as precedents in law, is like the release of methyl isocyanate in the province of law and justice: invisible, insidious, and catastrophic by the time anyone notices,” Justice Narasimha said.The bench said AI was not just an aid but “an alternative to our own thinking, reasoning and even decision making”, making regulation essential. In the insolvency case, NCLT relied on AI-generated material and cited six non-existent SC judgments. The fake judgments also escaped scrutiny by NCLAT. Lawyers told the apex court they had not supplied the fake judgments and that the tribunal had obtained the material through its own research.”It is necessary for courts to adopt a zero-tolerance mode for producing, citing or using AI-generated precedents without verification,” the bench said, adding that any decision relying even partly on fake or hallucinated AI material “is no decision in the eyes of the law” and must be set aside.The court directed the Bar Council of India to constitute a committee to deliberate on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents. It warned that delegating thinking to AI could have serious consequences for the human capacity to distinguish truth from falsehood and justice from injustice.Get the latest India news and live updates. Download the TOI App.End of ArticleFollow Us On Social MediaVideosUnesco Warns Pakistan Over ‘Reconstructions’ At Taxila, Threatens Danger ListNHAI Under Fire As Delhi-Dehradun Expressway Develops Major Potholes 3 Months After Inauguration’Insult To Shivaji, Bhagat Singh’: CJP Founder Dipke Demands ACP’s Suspension Over Library RowMission Aagaman Explained: How Vikram-1 Could Make Indian Space History60-Year-Old Mumbai Man Dies After Falling Into Open Manhole, 4 BMC Officials SuspendedIndian Navy’s INS Trikand Thwarts Piracy Attempt On India-Bound Vessel In Gulf Of AdenWest Bengal Passes Tough Public Order Laws: What The Recovery And Preventive Detention Bills MeanJapan PM Takaichi In India: Top 10 Items On The Agenda As She Meets PM Modi54 Years of the Shimla Agreement: Why India Says Pakistan Violated the Spirit of the PactChina’s Proposed Bangladesh Corridor Could Open A New Strategic Route Into The Indian Ocean123PhotostoriesShoaib Ibrahim’s father gets discharged from hospital after 37 days; Dipika Kakar gets emotional before second infusion5 most effective ways to make money through social media in 20265 fascinating animals that glow in the darkThere are only 3 American states that start with the letter ‘C’; here’s why every traveller on a U.S trip should visit themWhat are chemical-free cosmetics? 5 things no clean cosmetic brand should have that every woman should know about5 superfoods that reduce seasonal hair fall naturally5 reasons devotees cry for Krishna during moments of deep devotionAlia Bhatt redefines airport glam with heritage Gucci tote and classic Frankie Shop layering7 viral techniques people are using to keep mice away without poisonJuly gardening guide: 7 flowers, fruits, and vegetables to plant in the UK123Hot PicksTrump tariffsNHL TradeEPF Scheme 2026NFL TradeIncome Tax Return FilingMumbai rainNovak DjokovicMicrosoft layoffsIndia Japal TradeTop TrendingCapgemini Bengaluru DaycareDelhi Hit and RunBengaluru Triple MurderFIFA World Cup 2026EPF Scheme 2026US Iran warBy-election datesConnor McDavidManish TewariLando Norris
NEW DELHI: In the first case of its kind, Supreme Court on Thursday quashed orders passed by NCLT and NCLAT on the ground that they decided a case on the basis of AI-generated non-existent case laws and verdicts, cautioning that unchecked use of AI could distort the justice delivery system.A bench of Justices P S Narasimha and Alok Aradhe cautioned both the Bar and the Bench on the use of AI, saying the human element should remain in the driving seat and have “absolute and total control over the application and usage of AI”.“For us… the production of fake, non-existent, and hallucinated material and its utilisation as precedents in law, is like the release of methyl isocyanate in the province of law and justice: invisible, insidious, and catastrophic by the time anyone notices,” Justice Narasimha said.The bench said AI was not just an aid but “an alternative to our own thinking, reasoning and even decision making”, making regulation essential. In the insolvency case, NCLT relied on AI-generated material and cited six non-existent SC judgments. The fake judgments also escaped scrutiny by NCLAT. Lawyers told the apex court they had not supplied the fake judgments and that the tribunal had obtained the material through its own research.“It is necessary for courts to adopt a zero-tolerance mode for producing, citing or using AI-generated precedents without verification,” the bench said, adding that any decision relying even partly on fake or hallucinated AI material “is no decision in the eyes of the law” and must be set aside.The court directed the Bar Council of India to constitute a committee to deliberate on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents. It warned that delegating thinking to AI could have serious consequences for the human capacity to distinguish truth from falsehood and justice from injustice.
