Category Uncategorized

3 AI legal cases and lessons for us all: when expert evidence hallucinates, AI evaluates employee skills and must lawyers check their opponent’s work?

AI legal cases

"The Court also finds troubling [Lawyer's] failure to identify or bring the non-existent case citations to the Court's attention before the hearing on the motion to compel arbitration. The Court should not be left as the last line of defense against citations to fictional cases in briefs filed with the court. While [Lawyer] did not create or rely on the fake citations, he also did not detect them. Instead, he admitted he did not review the cases cited by his opponent...."

Thirty one UK Cases of Hallucinated Citations, AI and Otherwise: “It is not ‘co-operating with the Tribunal’ to neither confirm nor deny the use of AI”

AI hallucination cases - UK31

"93. In further submissions, the Representative said 'The suggestion that citing a published authority amounts to providing false material is misconceived. A court decision is a matter of public record. Whether a case applies is a matter of legal argument and opinion, not misrepresentation. It is entirely proper for parties to put forward different interpretations for the Tribunal to consider. To characterise this as "false material" is both unfounded and inappropriate.' It is not clear who the representative is quoting as saying false material was used. The wording used by HMRC was 'inaccurate use of AI/inaccurate authorities'.

Lessons from Australia and the United States: Self-representation, Anonymous Second Opinions, AI and Unregulated Legal Services

AI in the courts and anonymous second opinions

As I was catching up on recent international decisions in the developing field of AI and the law, I found myself drawn to two in particular, one from the United States and one from Australia. I initially considered writing about each decision separately. In the end, I felt that reading them together offered a more helpful way of exploring three issues that I have been reflecting on for some time and which I hope will also be of practical interest to readers navigating similar questions.

Is AI Law Now a Practice Area? If Not, Should It Be?

AI law

"I have come to think of AI law as two related, but not necessarily overlapping, things... These are distinct forms of legal work and there is no reason to assume that those practising in one will necessarily practise in the other, but each increasingly calls for lawyers who develop focused expertise rather than treating AI as a peripheral concern."

Thirty UK Cases of Hallucinated Citations, AI and Otherwise: A First Appearance in the Court of Appeal from A Family Case?

hallucinated citations

"...I return to the issue raised by the father’s representatives about the mother’s erroneous citation of authority (see in particular paragraph 54 above). I absolve the mother of any intention to mislead the court. Litigants in person are in a difficult position putting forward legal arguments. It is entirely understandable that they should resort to artificial intelligence for help. Used properly and responsibly, artificial intelligence can be of assistance to litigants and lawyers when preparing cases. But it is not an authoritative or infallible body of legal knowledge. There are a growing number of reports of “hallucinations” infecting legal arguments through the citation of cases for propositions for which they are not authority and, in some instances, the citation of cases that do not exist at all...."

Artificial Intelligence in Housing/Property Proceedings and Beyond: Why the Master of the Rolls’ AI Speech Matters for All Practitioners.

Master of the Rolls AI speech

"AI offers opportunities to resolve complex rent and disrepair disputes far more quickly and economically than was possible in past times. We should embrace those opportunities and available new technologies in order to provide the access to justice that so many tenants and occupiers have long sought and have long found to have eluded them.”

ChatGPT as Evidence in the Family Court: Do the prompts reveal an attempt to fabricate allegations, or the searches of a victim trying to learn how to report abuse?

ChatGPT evidence in family law.

“It would then appear that on 18/5/25, on father’s case …, or perhaps even earlier in 2025 …, he formed the view that the mother was having an affair. He had access to her ChatGPT account, which I confess was new to me. This was explained to me as effectively analogous to one person having remote access to another person’s internet search history…”

Another Four UK AI Hallucination cases (AI and non‑AI fabricated/false citations) (24 in total): November Shows How Quickly the Problem Is Escalating Internationally

Four UK AI Hallucination cases

“In considering the Respondent’s grounds of appeal, the tribunal noted that the Respondent relied on a number of cases. However, on close scrutiny, the tribunal was unable to find some of the cases that were referenced. Further the tribunal found that in a number of the cases quoted, incorrect references were used and in many of the cases the tribunal did not recognise the case summary provided...The tribunal is aware of the growing use of artificial intelligence and it would appear that an AI tool was used to prepare the Respondent’s grounds of appeal. This has resulted in the tribunal’s resources being disproportionately engaged in order to consider the cases relied on by the Respondent.”