1. News
  2. AI models & agents
  3. UK · Government AI
UK · Government AI3 min read

UK watchdog may probe government use of ChatGPT tech in asylum cases

A UK watchdog may investigate the Home Office's use of ChatGPT-based tools in asylum cases, over doubts about accuracy and a lack of openness.

By the Dashline deskSource: Wired
UK watchdog may probe government use of ChatGPT tech in asylum cases
Photo: Wired

A UK government watchdog is considering an investigation into how the Home Office uses ChatGPT technology to help process asylum claims. The Independent Chief Inspector of Borders and Immigration has asked the digital rights group Open Rights Group for more information as it plans next year's inspections. The watchdog says it cannot confirm its topics until it publishes its priorities.

What the tools do

The Home Office uses two tools. One summarizes transcripts of interviews with asylum applicants. The other works as a search assistant for information about an applicant's home country. Both are built on OpenAI's 2023 GPT-4 model and Microsoft Foundry. Piloting began in late 2024, as the government tried to clear a backlog of around 100,000 cases. Together, the tools could save about an hour per case, according to government estimates.

The accuracy concern

The Home Office's own pilot put the error rate for the interview summaries at 9 percent. Open Rights Group says the share of summaries judged not fit for use is significantly higher, often because of factual errors or misrepresentations. It also found no quality control for the country search tool.

In July, a UK judge accused the Home Office of citing an "AI hallucinated" document when refusing a Moroccan woman and her child asylum. Researchers also worry that known cultural bias in GPT models could strip nuance from summaries and lead to unfair decisions.

The secrecy concern

UK government guidance says departments must be open about algorithmic tools used in decisions, including by listing them in a public repository. These two tools are not on that list. Asylum seekers are not told when AI is used in their case.

  • Open Rights Group's six-month probe used 11 parliamentary questions, two ministerial letters and 10 records requests.
  • Lawyers at Cloisters wrote that being unable to contest an incorrect AI summary may breach UK data rights laws.
  • The Public Law Project has found 11 high-risk government AI systems missing from the public list, including these two.

What the Home Office says

A spokesperson says trained caseworkers make asylum decisions. The AI tools only help them navigate interview records and policy information, and they cannot be used alone or decide claims. The department says it monitors the tools and has committed to publishing updated evaluations. Its privacy notice says parts of the process may involve automation.

What happens next

The watchdog has not said whether it will investigate. Open Rights Group and the Public Law Project have sent their findings to the UK data regulator, the Information Commission. It is already investigating the Home Office's refusal to say how staff use and were trained on the tools. OpenAI says it will retire GPT-4 in January.

The takeaway

When AI summaries feed into decisions about people, those affected should be told, and the error rates should be public and checked.

More articles

You should really read these.

Next step

Let’s talk