Category Uncategorized

First Solicitors Disciplinary Tribunal Case Involving AI Hallucinations: Registered Foreign Lawyer Struck Off as the Tracker Reaches 76 UK Cases of AI Hallucinated/False Citations (Confirmed or Suspected)

76 UK Cases of AI Hallucinated/False Citations

"I have not set out the names of the cases which appear to me to be likely to be hallucinations because this decision will be published online on the Tribunals Decisions website. The inclusion of cases which are, or may be, fake may perpetuate the loop of such cases being cited by AI if this decision is scraped by a Large Language Model."

R v FGD: 10 Lessons from the Court of Appeal on AI Witness Coaching in Criminal Proceedings and Beyond.

R v FGD

“We began this judgment by indicating that it raised issues about the use of AI. More and more people are using AI for all manner of things: to answer everyday questions, to apply for jobs or prepare for interviews, to do research in many areas, including the law. The coaching of witnesses in their evidence, by any means, is not permitted. All witnesses, whether for the prosecution or defence, should be firmly discouraged from resorting to the use of AI to prepare for giving evidence. Doing so could run the risk of unfairness up to the point, in an extreme case, where the court may have to consider excluding evidence..."

67 UK Cases of AI Hallucinated/False Citations (Confirmed or Suspected): An important case involving the CPS

Tobosaru v Court of Law Craiolva, Romania

"...I have accepted the apology given on behalf of the Crown Prosecution Service and the assurance that there was no attempt to mislead. I have noted the steps taken to ensure that there is no repetition but considered that it was necessary to set out what had taken place in this judgment given the serious consequences that an error of this nature might have had in other circumstances. It would be naive to assume that there will not be an increasing use of artificial intelligence in legal work in future; indeed, that may be both necessary and beneficial. The episode highlights the risks of its use without appropriate oversight particularly for legal research."

The Dangers of Using AI to Assist with Witness Statements: Lessons from Godwin v Godwin

AI-assisted witness statements

"There was no good reason for either the Defendant or [redacted] to use ChatGPT in this case. Both struck me as sophisticated people... Both the Defendant and [redacted] are sufficiently technically adept to have used ChatGPT. They must have been able to use the spelling and grammar checking facility in Word (which the Defendant used to prepare his first draft) and in whatever word processing programme [redacted] used to prepare her first draft."

Live Facial Recognition, AI Bias and the Equality Questions in R (Thompson and Carlo) v Commissioner of Police of the Metropolis

live facial recognition

"207. The Commission emphasises that the world has seen the rapid development of artificial intelligence very recently with risks that, unless constrained by domestic and international law, States may use digital technologies to suppress dissent. In the domestic context, the uses to which LFR may be put, and the technology which supports it, will doubtless evolve but this claim is concerned with the terms of the Policy under challenge and (as we have said) its lawfulness now. We see no reason to take a different approach to Bridges."