Supreme Court's Stance on AI-Generated Precedents
The Supreme Court of India has emphasized the necessity for a zero-tolerance approach towards the use of AI-generated precedents without verification, citing the detrimental effects on the judicial process.
Key Observations
- The Court set aside a National Company Law Tribunal (NCLT) order that relied on fictitious AI-generated precedents.
- Justices P.S. Narasimha and Alok Aradhe highlighted the importance of independent verification to maintain the integrity of judicial decisions.
- They warned against AI “hallucinations” that could subvert the rule of law and equated its impact to a catastrophic event.
Judicial and Legal Community Collaboration
- The court underscored the need for collaboration between the Bar and the Bench to ensure AI is used cautiously and responsibly.
- The Supreme Court has initiated a public consultation on draft regulations for the use of AI in courts.
- AI systems are permitted only to assist and not replace judges, with prohibitions on AI in decision-making, sentencing, and bail matters.
Implications for Legal Practice
- The Bar Council of India was directed to form a committee to address the issue of AI-generated precedents, emphasizing the importance of human oversight.
- The court cautioned against over-reliance on AI, stressing the importance of human reasoning and disciplined mental training.
Case Context
- This ruling arose from an appeal by Pooja Ramesh Singh regarding insolvency proceedings linked to a ₹200-crore credit facility by Jammu and Kashmir Bank.
- The NCLT, supported by the National Company Law Appellate Tribunal (NCLAT) initially, relied on non-existent precedents, prompting the Supreme Court to set aside their orders.
- Jammu and Kashmir Bank stated that the fictitious precedents were not cited by its counsel but sourced by the NCLT independently. Regardless, the Supreme Court stressed the criticality of maintaining judicial integrity.
