Questions
Which AI Has the Lowest Hallucination Rate for Legal Work?
The lowest hallucination rate AI for legal work as of September 2026: GPT-5.5 at 3% on HAQQ, Claude Opus 4.8 best overall, and why no model reaches the zero courts demand.
On this page
On the largest legal-specific test published in 2026, GPT-5.5 had the lowest citation hallucination rate at 3%, but it was also the slowest and most expensive model, and Claude Opus 4.8 scored highest overall. No model reached zero: 24% of all 3,000 answers cited or misapplied law. As of September 2026, the model you choose matters less than whether you open every source it cites.
The numbers from the one benchmark built for lawyers
HAQQ's benchmark, published on 5 June 2026, graded 3,000 answers to 300 tasks across 51 practice areas and more than 20 jurisdictions. It is vendor-run (HAQQ sells a legal AI product), so treat it as evidence rather than proof, but nothing independent of comparable size exists as of September 2026.
| Model | Citation hallucination rate | Overall score (of 35) | Speed and cost per task |
|---|---|---|---|
| GPT-5.5 | 3% | Not the leader | 134 s; $0.082 (slowest and dearest) |
| Claude Opus 4.8 | ~12% | 30.02, first; won 130 of 300 tasks | Mid-range |
| Grok 4.3 | ~14% | 28.98, second | $0.003 |
| o3 | 32% | Lower | Mid-range |
| Mistral Large | 64% citation errors | Lowest tier | Mid-range |
Source: HAQQ, best AI for legal work benchmark, 5 June 2026. The cost spread across models was 90x.
Two things stand out. The model with the fewest fabricated citations was not the model that gave the best legal answers, and HAQQ's own summary is that every model, including the leaders, fabricated or misapplied a citation somewhere.
Why the lowest rate and the best model are different questions
A hallucination rate measures one failure mode: citing authority that does not exist or does not say what the model claims. Legal quality also depends on issue-spotting, jurisdiction and whether the model applies the law it found. Opus 4.8 won 130 of 300 HAQQ tasks while fabricating roughly four times as often as GPT-5.5; GPT-5.5 cited cleanly and took over two minutes to do it.
The general leaderboards show the same task dependence. On the Vals Index of 15 September 2026 (58 models), Claude Fable 5.1 leads, followed by Claude Opus 5 and GPT-6 Astra. On Vals' Legal Research Bench the same day, Meta's Muse Spark 1.3 Max is first, Opus 5 second and Fable 5.1 third. On Vectara's summarisation-only hallucination leaderboard (11 May 2026) the best rates are 1.8–3.3%, and the winners are small models nobody would use for legal analysis. OpenAI reports Astra for Law at 54% on the Vals Legal Research Bench against 38.7% for GPT-6 with plain web search; it launched on 17 September 2026 and no independent evaluation exists yet. The benchmarks guide explains how to read each of these.
A litigator using Claude Fable described the practical problem in August 2026:
"it's right about the stuff that was never going to be in dispute anyways. The stuff it is wrong about is the meat of the case." — r/biglaw, 9 August 2026
Legal-grade research tools are not hallucination-free either
The last independent test of the legal research platforms is old. Stanford RegLab's Hallucination-Free? study (tools tested May 2024; peer-reviewed 2025) found Lexis+ AI hallucinating 17% of the time and Westlaw AI-Assisted Research 33%, against 43% for GPT-4. Thomson Reuters, LexisNexis and vLex declined to take part in Vals' October 2025 legal research study, and neither has since submitted to a comparable public test. Both platforms have been rebuilt since (Lexis+ with Protégé; CoCounsel Legal on the Claude Agent SDK), so the 2024 figures are a record of how bad it was, not a measure of today.
The sanctions record shows professional tools in the case law too. Lacey v. State Farm (C.D. Cal., 6 May 2025) cost K&L Gates and Ellis George $31,100 for nine bad citations out of 27, produced with CoCounsel, Westlaw Precision and Gemini. Fletcher v. Experian (5th Cir. 2026) involved vLex and CoCounsel output; the court said the problem "shows no sign of abating". In Cork v Smith [2026] EWHC 1199 (Ch) the AI had flagged its own answer as possibly inaccurate; the Pinsent Masons associate filed anyway and the firm was referred to the SRA. The sanctions tracker has the full list.
Why every published rate flatters the model
Three things make benchmark rates optimistic for real practice.
- Rates are task-specific. Summarisation is the easy case. Multi-jurisdiction research is the hard one: every system in Vals' October 2025 study lost 11–14 points on multi-jurisdiction questions.
- Users push models into error. Stanford HAI's 2026 AI Index reports hallucination rates from 22% to 94% across 26 models on a factuality benchmark, and a collapse when a false premise is framed as the user's own belief (GPT-4o fell from 98.2% to 64.4%). A lawyer who asks a model to confirm that a case held something is running that experiment on a live matter.
- Web search does not cure citations. A University of Pennsylvania study (3 April 2026) found search-augmented models and deep-research agents fabricating 3–13% of URLs, with agents hallucinating more because they cite more.
Add the score-keeping problem. Harvey's BigLaw Bench gives GPT-5.6 Sol 92.7%; Harvey's stricter all-criteria-pass LAB metric gives the same model 2.5%. Same model, same vendor, a 90-point gap set by the grading rule.
Workflow beats model: the rule that survives every benchmark
The 2,041 decisions in Damien Charlotin's AI Hallucination Cases database (14 September 2026), 811 of them involving lawyers, were not caused by picking the wrong model. They were caused by not opening the source. Raja Rajan (Cherry Hill, NJ) was sanctioned a second time in April 2026 for using AI to verify AI; Charlotin's tracker names self-validation as a decisive aggravator.
A protocol that works whichever model you use:
| Step | What you do | Why |
|---|---|---|
| 1 | Ask for citations with pinpoint paragraphs and a one-line quotation | Fabrications rarely survive a pinpoint request; misgrounded citations do |
| 2 | Open every cited authority in Westlaw, Lexis, BAILII, RIS or the court's own site | The only step courts accept; California's 2026 guidance says no filing should contain citations the responsible attorney has not personally read |
| 3 | Check the proposition, not just the existence | 854 of Charlotin's entries are real authorities misrepresented, the category hardest to spot by eye |
| 4 | Re-run the question in a second model with no access to the first answer | Cheap disagreement detection; not a substitute for step 2 |
| 5 | Record what was checked and by whom | Candour mitigates and evasiveness aggravates in every 2026 sanctions decision |
The verification playbook expands each step, and Module 2 of the AI Lab for Lawyers course runs the loop live on real research questions. One caution for prompts written in 2025: Anthropic's documentation says Claude Opus 5 "verifies its own work without being told to", so a standing instruction to add a final verification step now causes over-verification rather than better checking.
What to do this week
- Pick the model by task. For clean citations under time pressure, a GPT-5.5-class model (GPT-5.5 itself retires from ChatGPT on 14 October 2026) or its successor; for issue-spotting, Opus 5 or Fable 5.1; for summarising a bundle, almost anything current, verified by sampling. The Claude vs ChatGPT comparison has a task table.
- Treat any deep research output as a lead list with a 3–13% fake-URL rate, and any answer to the question of whether AI can research without hallucinating as "not yet".
- Write the five-step protocol into the firm's AI policy. The hallucination guide covers the mechanism; the glossary entry has the short definition for clients.
Frequently asked questions
Which AI model hallucinates the least on legal questions?
On the largest legal-specific benchmark published in 2026, HAQQ's 3,000-answer test of June 2026, GPT-5.5 had the lowest citation hallucination rate at 3%, followed by Claude Opus 4.8 at roughly 12% and Grok 4.3 at about 14%. GPT-5.5 was also the slowest model at 134 seconds a task and the most expensive at $0.082. Opus 4.8 won the most tasks overall. The benchmark is vendor-run, so treat it as evidence rather than proof.
Are Lexis and Westlaw AI research tools hallucination-free?
No. Stanford RegLab's study of tools as they stood in May 2024 found Lexis+ AI hallucinating 17% of the time and Westlaw AI-Assisted Research 33%. Both platforms have since been rebuilt, but neither Thomson Reuters nor LexisNexis has submitted to a comparable public test, and sanctions cases such as Lacey v. State Farm and Fletcher v. Experian involved CoCounsel, Westlaw Precision and vLex outputs, not only consumer chatbots.
Does web search or deep research stop AI from inventing citations?
It reduces but does not remove the problem. A University of Pennsylvania study published in April 2026 found search-augmented models and deep-research agents fabricating 3–13% of the URLs they cited, with agents hallucinating more because they cite more. A cited link is a lead to check, not a verified authority, and courts treat it that way.
What hallucination rate is acceptable for a court filing?
Zero. Courts in the US, UK, Germany and Austria have sanctioned lawyers for single fabricated citations, and California's 2026 guidance states that no paper filed in court should contain citations the responsible attorney has not personally read and verified. A model with a 3% rate still produces one bad citation in roughly every 33, so every citation in a filing must be opened and read regardless of which model produced it.
Put this into practice
AI Lab for Lawyers: a live, hands-on course for practising lawyers
4 live sessions (8 hours), recordings included, taught by Dr. Niklas Schmidt of Wolf Theiss. Rated 4.7/5 from 381 ratings; alumni from Norton Rose Fulbright, Paul Hastings, Pillsbury and Taylor Wessing.
Related reading
Guides
Legal AI Benchmarks Explained: Vals, BigLaw Bench, LAB, HAQQ and LegalBench
Legal AI benchmarks explained: what Vals, BigLaw Bench, Harvey LAB, HAQQ and LegalBench measure, the September 2026 leaders, and how to run your own evaluation.
10 min read
Playbooks
How to Verify AI Legal Research: A Citation-Checking Protocol
Verify AI legal research with a five-check protocol: open every authority, match the quote, confirm holding and status, log it. Template, time budgets, tools.
11 min read
Guides
AI Hallucinations in Legal Practice: Why They Happen and How to Catch Them
AI hallucinations in legal practice: why models invent cases, what 2,041 court decisions and the HAQQ benchmark show, and a verification routine that holds.
9 min read
Questions
Can AI Do Legal Research Without Hallucinating? The Honest Answer
No AI legal research tool is hallucination-free as of September 2026. Measured rates, why grounding does not cure misreading, and the checks that protect you.
6 min read
Regulation & Ethics
AI Hallucination Sanctions: The Cases Every Lawyer Should Know (2023–2026)
AI hallucination cases reached 2,041 in Charlotin's database by September 2026, 811 involving lawyers. Every sanction from Mata to Couvrette's $110,204, with lessons.
12 min read
Glossary
Hallucination (AI) — Definition for Lawyers
An AI hallucination is fluent, confident, false output: an invented case, a misread holding or a fake quote. 2,041 court decisions now involve one. What to know.
5 min read