Tech

‘Colossal failure’: CPS prosecutor cites prospective high court case after AI search | AI (artificial intelligence)

The acting chief prosecutor in a high court case has outlined a controversial legal precedent that has raised new concerns about AI innovation infecting the justice system.

Ravinder Dhillon, representing the Crown Prosecution Service (CPS), spoke about the completely fabricated case during a dispute over whether the child should be prosecuted for raping his younger sister, court documents revealed.

His explanation of how the non-existent case relied on it has been called “unconvincing” by two of the court’s top judges and a “gross failure” by AI and legal experts. The Guardian understands that the reference comes from an AI response generated during an internet search.

This case adds to many others where AI-related errors have plagued litigation this year, particularly in cases involving legally ineligible individuals, and often in employment tribunal cases.

It is only the second known case involving the CPS – the main public agency that carries out criminal prosecutions in England and Wales – which admitted in February that one of its lawyers handling the extradition case involving two Romanians convicted of minor crimes had cited missing law enforcement authorities, possibly created by AI. Those designated cases are only seen when opposition lawyers have no trace of them and the CPS concluded that the “risk of recidivism is low”.

In the latest case, lawyers for the boy, who was 11 when his seven-year-old sister was accused, contested the CPS’s decision to prosecute him. They suspect that prosecutors failed to consider the representations of social workers, youth workers and psychologists. Dhillon, a senior prosecutor in the CPS’s rape and serious sexual offences, opposed the prosecution of the child and submitted a detailed reference in a case he called CPS – R v J. [2024] EWCA Crim 3529. Turns out there wasn’t.

The decision to proceed was taken by Dhillon in April and confirmed by the chief crown prosecutor. Then in October, Dhillon admitted that the missing quote had been made in error. He said he was talking about a completely different decision – this time a real one – made 15 years earlier.

“This was used as a legal source to oppose the prosecution of a child and that legal source does not exist: that is a huge failure,” said Brian Flanagan, a law professor at Maynooth University in Ireland who investigates the use of AI by judges. “It calls into question the norms of trust in the law when we treat the authorities as valuable things. You can’t do it; it’s out of bounds. AI increases the risks that will happen because of the time you can’t save. It’s not good for any professional to do this, but if the professional works for the country it takes a different dimension, because the power of the state is great.”

The high court has said the CPS’ claim of a false charge does not affect the outcome of a boy who challenged a decision to continue his prosecution which is scheduled for a youth court hearing later this week.

In June 2025, the Supreme Court responded to AI falsehoods in cases involving housing and banking, by asking the Bar Council and the Law Society to consider measures to curb the problem as an “urgent matter”. Dame Victoria Sharp, who was president of the King’s bench at the time, warned of “serious implications for the administration of justice and public confidence in the justice system if artificial intelligence is used recklessly” and said lawyers who misuse AI could face sanctions, from public counseling to contempt of court proceedings and referral to the police.

Asked for comment, the CPS said it has a strict AI policy that “restricts its use so that it cannot be used to make legal decisions and there should be human checks to make sure”.

A spokesman said the CPS “discovered that an error had occurred while conducting legal research using the internet”.

“Once this error was identified, it was corrected and an internal review was conducted to find out how this happened and to see if there were any other cases that were affected,” they said. “After a quick review we share what we have learned, including that case law must be cited from reliable legal sources.”

It is understood that an internet search has brought up an AI abstract containing details of a fictitious case.

The latest incident brought to 101 the number of entries in the UK tracker maintained by Doughty Street Chambers lawyer Matthew Lee which includes confirmed, suspected and disputed AI-related errors, and related false quotes. He said the identified cases could be the “tip of the iceberg”, as many lower court decisions have never been published.

He also added that there are privacy and security risks associated with CPS using AI, given the highly sensitive data it handles, and warned that AI creates more work for rowers, who need to spend time checking the authenticity of law enforcement authorities from documents where AI may be used in preparation.

Source link

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button