AI Hallucination Cases Tracker: AI and non-AI fabricated/false citations (Suspected or Confirmed)

AI Hallucination Cases Tracker

AI hallucination cases can, and do, reach real courtrooms and have real consequences. However, there is some dispute about the correct phrasing of this phenomenon:

“…Although the termed used in relation to erroneously generated references by Al is "hallucinations", this is a term which seeks to legitimise the use of Al. More properly, such erroneously generated references are simply fabricated, fictional, false, fake and as such could be misleading...”
JML Rose Pty Ltd v Jorgensen (No 3) [2025] FCA 976 (Federal Court of Australia, 19 August 2025)

Read MoreAI Hallucination Cases Tracker: AI and non-AI fabricated/false citations (Suspected or Confirmed)

Think Before You Accuse: Lessons on Alleging AI Misuse from Vanguard Construction v 400 Times Square

AI Misuse

“We have considered the parties' remaining contentions and find them unavailing, including respondents' counsel's unfounded insinuation that appellant's counsel "used ChatGPT to write [his] brief" without verifying the accuracy of cited case authorities. The court reminds respondents' counsel that, as an officer of the court, such representations must be substantiated, and without evidence, these insinuations can undermine trust and damage one's reputation (see Rules of Prof Conduct [22 NYCRR 1200.00] rule 3.3[a][1]). Counsel's response at oral argument when questioned about his claim was dismissive and his attempt to defend and modulate his accusatory contention was disingenuous.
Upon review of the cases relied upon by appellant, we find no support for respondents' counsel's position.”
Vanguard v 400 Times Sq

Read MoreThink Before You Accuse: Lessons on Alleging AI Misuse from Vanguard Construction v 400 Times Square

AI Can Provide ‘Reasonably Accurate’ Legal Advice, Dedicated tools in Employment and Property Law, Says Master of the Rolls—But Is That Enough to Replace Lawyers?”

“...AI is already capable of providing reasonably accurate legal advice. Many of you will have tried some of the dedicated programmes offering advice on employment, property and other issues. They may be scary for lawyers, but they will not actually replace them, in my view at least, since many of the issues that arise concern the explanations that need to accompany legal advice. Persuading people to accept legal advice is a peculiarly human activity.”

Sir Geoffrey Vos, Master of the Rolls

Read MoreAI Can Provide ‘Reasonably Accurate’ Legal Advice, Dedicated tools in Employment and Property Law, Says Master of the Rolls—But Is That Enough to Replace Lawyers?”