AI Hallucination Rates & Benchmarks in 2026
The complete AI hallucination data references. Raw numbers from Vectara, AA-Omniscience, FACTS, OpenAI system cards, and 50+ sources. Updated monthly.
Last updated: March 2026
Every major AI model hallucinates. The question is how often, on what tasks, and whether you can catch it before it costs you money.
This page tracks hallucination rates across six benchmarks, covers every frontier model from GPT-5 to Claude 4.6 to Gemini 3.1 to Grok 4.1, and presents the data without spin. The numbers don't agree with each other — and we explain why that matters more than any single leaderboard ranking.
Universal Cross-Benchmark Hallucination Reference (March 2026)
How to Read This Table
Every number below comes from a different benchmark measuring a different aspect of hallucination. Low Vectara + high AA-Omniscience hallucination means the model is good at summarization but bad at admitting ignorance. High FACTS + low AA-Omniscience accuracy means the model is accurate with tools but attempts too many questions. No single column tells the full story. Cross-reference at least two.
Column guide:
- Vectara (Old): Summarization faithfulness on short documents. Lower = better.
- Vectara (New): Summarization faithfulness on enterprise-length documents. Lower = better.
- AA-Omni Acc: Accuracy on hard knowledge questions across 42 topics. Higher = better.
- AA-Omni Hall: How often the model gives wrong answers instead of refusing. Lower = better.
- AA-Omni Index: Combined knowledge reliability score (-100 to +100). Higher = better.
- FACTS: Multi-dimensional factuality across grounding, multimodal, parametric, and search. Higher = better.
- HalluHard: Hallucination rate in realistic conversations. Lower = better.
- CJR Citation: Citation hallucination rate (news sources). Lower = better.
Frontier AI Models Hallucination Comparison
| Model | Provider | Vectara (Old) | Vectara (New) | AA-Omni Acc | AA-Omni Hall | AA-Omni Index | FACTS | HalluHard | CJR Citation |
|---|---|---|---|---|---|---|---|---|---|
| GPT-5.3 Codex | OpenAI | – | – | 51.8% | – | – | – | – | – |
| GPT-5.2 (xhigh) | OpenAI | – | 10.8% | 43.8% | ~78% | – | 61.8 | 38.2% | – |
| GPT-5 | OpenAI | 1.4% | >10% | 40.7% | – | – | 61.8 | – | – |
| GPT-5.1 | OpenAI | – | – | 37.6% | 81% | Positive | 49.4 | – | – |
| GPT-4.1 | OpenAI | 2.0% | 5.6% | – | – | – | 50.5 | – | – |
| o3-mini-high | OpenAI | 0.8% | 4.8% | – | – | – | 52.0 | – | – |
| Claude 4.1 Opus | Anthropic | – | – | – | 0% | – | 46.5 | – | – |
| Claude Opus 4.6 | Anthropic | – | 12.2% | 46.4% | – | 14 | – | – | – |
| Claude Opus 4.5 | Anthropic | – | – | 45.7% | 58% | Negative | 51.3 | 30% | – |
| Claude Sonnet 4.6 | Anthropic | – | 10.6% | 40.0% | ~38% | – | – | – | – |
| Claude Sonnet 4.5 | Anthropic | – | >10% | – | 48% | – | 49.1 | – | – |
| Claude 3.7 Sonnet | Anthropic | 4.4% | – | – | – | – | – | – | – |
| Claude 4.5 Haiku | Anthropic | – | – | – | 25% | – | – | – | – |
| Gemini 3.1 Pro | – | 10.4% | 55.3% | 50% | 33 | – | – | – | |
| Gemini 3 Pro | – | 13.6% | 55.9% | 88% | 16 | 68.8 | – | – | |
| Gemini 3 Flash | – | – | 54.0% | 91% | – | – | – | – | |
| Gemini 2.5 Pro | – | 7.0% | – | – | – | 62.1 | – | – | |
| Gemini 2.0 Flash | 0.7% | 3.3% | – | – | – | – | – | – | |
| Grok 4 | xAI | 4.8% | >10% | 41.4% | 64% | Positive | 53.6 | – | – |
| Grok 4.1 Fast | xAI | – | 20.2% | – | 72% | – | 36.0 | – | – |
| Grok-3 | xAI | 2.1% | 5.8% | – | – | – | – | – | 94% |
| Perplexity Sonar Pro | Perplexity | – | – | – | – | – | – | – | 37% |
| DeepSeek-V3 | DeepSeek | 3.9% | 6.1% | – | – | – | – | – | – |
| DeepSeek-R1 | DeepSeek | 14.3% | 11.3% | – | 83% | – | – | – | – |
| Llama 4 Maverick | Meta | 4.6% | – | – | 87.6% | – | – | – | – |
Sources: Vectara HHEM Leaderboard (April 2025 + Feb 2026 snapshots) [1], Artificial Analysis AA-Omniscience (Nov 2025 - Feb 2026) [2], Google DeepMind FACTS Benchmark (Dec 2025) [3], HalluHard Benchmark (2025) [5], Columbia Journalism Review (March 2025) [6]. Dashes indicate no published data on that benchmark for that model.
Quick-Reference Findings
Lowest hallucination rate (knowledge tasks): Claude 4.1 Opus — 0% on AA-Omniscience (refuses rather than guesses)
Lowest hallucination rate (summarization): Gemini-2.0-Flash — 0.7% on Vectara original dataset
Highest factuality score (multi-dimensional): Gemini 3 Pro — 68.8 on FACTS
Best knowledge reliability index: Gemini 3.1 Pro — index 33 on AA-Omniscience
Best in realistic conversations: Claude Opus 4.5 — 30% on HalluHard (with web search)
Best citation accuracy: Perplexity Sonar Pro — 37% hallucination on CJR (lowest, but still high)
Biggest single improvement: Gemini 3.1 Pro — hallucination dropped 38 percentage points (88% to 50%) with 1% accuracy loss
Biggest variable across all models: Web search access — reduces hallucination 73-86% when enabled
Table of Contents
What Is an AI Hallucination?
In Plain English
An AI hallucination is when an AI model makes something up and presents it as fact. It doesn't flag uncertainty. It doesn't say "I'm guessing." It delivers fabricated statistics, invented legal cases, or nonexistent research papers with the same confidence it uses for basic arithmetic. The output reads perfectly. That's what makes it dangerous.
The Technical Definition
Hallucination refers to generated output not grounded in the provided input or factual reality. Two types:
Intrinsic hallucination (faithfulness failure): The model contradicts information it was explicitly given. Hand it a contract and ask for a summary — it adds clauses that don't exist in the original document.
Extrinsic hallucination (factuality failure): The model generates information that can't be verified against any known source. It invents facts, statistics, citations, or events from scratch. No source material was contradicted because no source material was consulted.
The Confidence Paradox
MIT researchers found something disturbing in January 2025: AI models use more confident language when hallucinating than when stating facts. Models were 34% more likely to use phrases like "definitely," "certainly," and "without a doubt" when generating incorrect information.
The wronger the AI, the more certain it sounds.
Why It Happens
Large language models are prediction engines, not knowledge bases. They generate text by predicting the most statistically likely next token based on patterns in training data. They don't understand truth. They predict plausibility.
When the model hits a gap in its training data or faces an ambiguous query, it fills the gap with something plausible rather than admitting it doesn't know. The architecture has no mechanism for "I'm not sure" — it just picks the next most probable word.
And this isn't a bug that will be fixed in the next update. Two independent mathematical proofs have now demonstrated that hallucination is a fundamental, provable limitation of the architecture. Not an engineering shortcoming. A mathematical certainty. (More on this in the Mathematical Impossibility section below.) [20][21]
The Benchmark Problem — Why the Numbers Contradict Each Other
Before looking at any hallucination data, you need to understand why different benchmarks give wildly different scores for the same model.
Grok-3 scores 2.1% on the Vectara summarization benchmark. Excellent. That same model scores 94% on the Columbia Journalism Review citation accuracy test. Catastrophic. Same model, same time period, opposite conclusions.
This isn't an error. It's measuring different things. And treating any single benchmark as "the hallucination rate" will mislead you.
Here's what each benchmark actually tests:
Vectara HHEM — "Can it stick to what's written?"
Vectara's Hughes Hallucination Evaluation Model gives a model a document and asks it to summarize using only the facts in that document. Then it checks whether the summary added anything that wasn't there. This is a summarization faithfulness test — a direct proxy for how AI behaves in RAG (Retrieval Augmented Generation) systems, enterprise search tools, and document analysis pipelines. [1]
Two versions exist. The original dataset uses ~1,000 documents. The refreshed version (November 2025) uses 7,700 longer articles across law, medicine, finance, technology, and education. Scores on the new dataset run dramatically higher because the task is harder and more representative of real enterprise workloads.
Good for: Evaluating AI for document summarization, knowledge base Q&A, and anything where the model has source material to work from.
Not good for: Measuring what happens when the model must rely on its own knowledge without source documents.
AA-Omniscience — "Does it know what it doesn't know?"
Artificial Analysis released this benchmark in November 2025. It covers 6,000 questions across 42 topics in six domains: Business, Humanities, Health, Law, Software Engineering, and Science/Math. [2]
The critical difference: the Omniscience Index penalizes wrong answers and does not penalize refusal. A model that says "I don't know" scores better than one that guesses wrong. The scale runs from -100 to +100.
This inverts the incentive structure of most benchmarks. Instead of rewarding models for attempting every question, AA-Omniscience asks: when you don't know, do you admit it?
For most models, the answer is no. Only 4 out of 40 tested models achieved a positive index score.
Good for: Evaluating whether a model is safe for high-stakes advisory work — legal, medical, financial — where a wrong answer is worse than no answer.
Not good for: Measuring summarization accuracy or grounded task performance.
FACTS — "How accurate across four dimensions?"
Google DeepMind's FACTS benchmark separates factuality into four slices: Grounding (can it faithfully use provided sources), Multimodal (visual + text accuracy), Parametric (knowledge stored in weights), and Search (accuracy when using web tools). Each slice gets its own score. [3]
This multi-dimensional approach reveals that models have dramatically different strengths depending on the task type. Grok 4 scores 75.3 on Search but just 25.7 on Multimodal — a 50-point gap within the same model.
Good for: Understanding where specific models are strong and weak across task types.
Not good for: Producing a single "hallucination rate" number. That's the point — there isn't one.
SimpleQA and PersonQA — "Can it answer short factual questions?"
OpenAI's SimpleQA tests fact-seeking queries with brief answers. PersonQA specifically tests accuracy about real people. These benchmarks revealed a troubling pattern: newer reasoning models sometimes perform worse than their predecessors. The o3 model hallucinates 33% on PersonQA versus o1's 16%. The o4-mini hits 48%. [4]
Good for: Quick factuality testing on straightforward questions.
Not good for: Measuring performance on complex, multi-step, or domain-specific queries.
HalluHard — "How does it handle realistic conversations?"
A newer benchmark from researchers in Switzerland and Germany that tests models in realistic conversational settings rather than clean benchmark conditions. Even the best models hallucinate 30-60% in these scenarios. Claude Opus 4.5 with web search achieved the lowest score at 30% — still wrong nearly a third of the time. [5]
Good for: Predicting real-world hallucination rates in production chat applications.
Not good for: Controlled, reproducible model comparisons (too variable).
CJR Citation Study — "Does it cite sources accurately?"
The Columbia Journalism Review tested whether AI models correctly attribute information to cited sources. Perplexity scored best at 37% hallucination. Grok-3 scored worst at 94%. This benchmark targets a specific and dangerous failure mode: presenting real-looking URLs with fabricated claims attached to them. [6]
Good for: Evaluating AI for research, journalism, and any task requiring source attribution.
Not good for: General knowledge or summarization evaluation.
Two Benchmarks to Ignore
TruthfulQA was once the gold standard. It's now partially saturated — models have been trained on its questions. Worse, researchers showed a simple decision tree can score 79.6% on TruthfulQA multiple choice without even seeing the question being asked, just by exploiting structural patterns in answer formatting. Citing TruthfulQA scores for 2025-2026 models is unreliable. [29]
HaluEval has a similar problem. A length-based classifier achieves 93.3% accuracy on HaluEval QA simply by flagging answers longer than 27 characters as hallucinated. The benchmark measures answer length more than it measures truthfulness. [30]
The Practical Takeaway
No single benchmark gives you "the hallucination rate" of any model. If someone quotes one number, they're either simplifying for convenience or cherry-picking for marketing.
The responsible approach: cross-reference at least two benchmarks that measure different things (one grounded task like Vectara, one open-ended knowledge task like AA-Omniscience), specify the exact model version and calling conditions, and note whether tool access was enabled. The sections that follow do exactly that.
Vectara AI Hallucination Leaderboard (HHEM)
Vectara's leaderboard is the most cited hallucination benchmark in the industry. It exists in two versions, and the gap between them tells an important story. [1]
Original Dataset — ~1,000 Documents (April 2025)
This is the dataset most articles reference when they quote hallucination rates. The documents are relatively short and the summarization tasks are straightforward.
| Model | Provider | Hallucination Rate | Factual Consistency |
|---|---|---|---|
| Gemini-2.0-Flash-001 | 0.7% | 99.3% | |
| Gemini-2.0-Pro-Exp | 0.8% | 99.2% | |
| o3-mini-high | OpenAI | 0.8% | 99.2% |
| Gemini-2.5-Pro-Exp | 1.1% | 98.9% | |
| GPT-4.5-Preview | OpenAI | 1.2% | 98.8% |
| Gemini-2.5-Flash-Preview | 1.3% | 98.7% | |
| o1-mini | OpenAI | 1.4% | 98.6% |
| GPT-5 / ChatGPT-5 | OpenAI | 1.4% | 98.6% |
| GPT-4o | OpenAI | 1.5% | 98.5% |
| GPT-4o-mini | OpenAI | 1.7% | 98.3% |
| GPT-4-Turbo | OpenAI | 1.7% | 98.3% |
| GPT-4 | OpenAI | 1.8% | 98.2% |
| Grok-2 | xAI | 1.9% | 98.1% |
| GPT-4.1 | OpenAI | 2.0% | 98.0% |
| Grok-3-Beta | xAI | 2.1% | 97.8% |
| Claude-3.7-Sonnet | Anthropic | 4.4% | 95.6% |
| Claude-3.5-Sonnet | Anthropic | 4.6% | 95.4% |
| Llama-4-Maverick | Meta | 4.6% | 95.4% |
| Grok-4 | xAI | 4.8% | ~95.2% |
| Claude-3.5-Haiku | Anthropic | 4.9% | 95.1% |
| Claude-3-Opus | Anthropic | 10.1% | 89.9% |
| DeepSeek-R1 | DeepSeek | 14.3% | 85.7% |
Source: Vectara HHEM Leaderboard, GitHub repository, April 2025 [1]
On this dataset, the numbers look encouraging. Google's Gemini models dominate the top three spots. OpenAI's GPT family clusters between 0.8% and 2.0%. Even the worst performers stay under 15%.
But this dataset is easy. The documents are short, the summarization tasks are clean, and the real world is neither.
Vectara HHEM Leaderboard: Full model ranking with provider color-coding on original dataset. Source: Vectara [1]
New Dataset — 7,700 Articles (November 2025 - February 2026)
Vectara launched a refreshed benchmark in late 2025 with longer documents (up to 32K tokens) spanning law, medicine, finance, technology, and education. This version better reflects what enterprise AI systems actually face.
The rates jumped across the board:
| Model | Provider | Hallucination Rate |
|---|---|---|
| Gemini-2.5-Flash-Lite | 3.3% | |
| Mistral-Large | Mistral | 4.5% |
| DeepSeek-V3.2-Exp | DeepSeek | 5.3% |
| GPT-4.1 | OpenAI | 5.6% |
| Grok-3 | xAI | 5.8% |
| DeepSeek-R1-0528 | DeepSeek | 7.7% |
| Claude Sonnet 4.5 | Anthropic | >10% |
| GPT-5 | OpenAI | >10% |
| Grok-4 | xAI | >10% |
| Gemini-3-Pro | 13.6% |
Source: Vectara Hallucination Leaderboard, new dataset, November 2025 [1]
Feb 25, 2026 Snapshot — Latest Model Additions
The most recent Vectara snapshot adds the newest frontier models to the new dataset evaluation:
| Model | Provider | Hallucination Rate |
|---|---|---|
| o3-mini-high | OpenAI | 4.8% |
| GPT-4.1 | OpenAI | 5.6% |
| Grok-3 | xAI | 5.8% |
| DeepSeek-V3 | DeepSeek | 6.1% |
| Command R+ | Cohere | 6.9% |
| Gemini 2.5 Pro | 7.0% | |
| Llama 4 Scout | Meta | 7.7% |
| GPT-5.2-low | OpenAI | 8.4% |
| Gemini 3.1 Pro Preview | 10.4% | |
| Claude Sonnet 4.6 | Anthropic | 10.6% |
| GPT-5.2-high | OpenAI | 10.8% |
| DeepSeek-R1 | DeepSeek | 11.3% |
| Claude Opus 4.6 | Anthropic | 12.2% |
| Grok-4-fast-reasoning | xAI | 20.2% |
Source: Vectara HHEM Leaderboard, Feb 25, 2026 research report snapshot [1]
The Reasoning Tax
The new dataset exposed something counterintuitive: reasoning models — the ones marketed as the most capable — consistently perform worse on grounded summarization. GPT-5, Claude Sonnet 4.5, Grok-4, and Gemini-3-Pro all exceeded 10%. The Grok-4-fast-reasoning variant hit 20.2%. [48][49]
The hypothesis is straightforward. Reasoning models invest computational effort into "thinking through" answers. During summarization, this thinking leads them to add inferences, draw connections, and generate insights that go beyond what's in the source document. That's helpful for analysis. It's hallucination on a summarization benchmark.
This creates a critical decision for enterprise teams: reasoning mode helps on open-ended tasks and hurts on grounded tasks. Knowing when to enable it and when to turn it off is not optional.
AA-Omniscience Benchmark (Artificial Analysis)
AA-Omniscience asks a fundamentally different question than Vectara. Instead of "can you summarize without adding stuff," it asks "when you don't know something, do you admit it or make something up?" [2]
The benchmark covers 6,000 questions across 42 topics in six domains. The Omniscience Index (scale: -100 to +100) penalizes wrong answers and doesn't penalize refusal. This makes it the only major benchmark that explicitly rewards models for knowing their own limits.
Top Models by Accuracy and Hallucination Rate
| Model | Provider | Accuracy | Hallucination Rate | Omniscience Index |
|---|---|---|---|---|
| Gemini 3 Pro Preview (high) | 55.9% | 88% | 16 | |
| Gemini 3.1 Pro Preview | 55.3% | 50% | 33 | |
| Gemini 3 Flash (Reasoning) | 54.0% | 92% | – | |
| GPT-5.3 Codex (xhigh) | OpenAI | 51.8% | – | – |
| Claude Opus 4.6 (max) | Anthropic | 46.4% | – | 14 |
| Claude Opus 4.5 (thinking) | Anthropic | 45.7% | 58% | Negative |
| GPT-5.2 (xhigh) | OpenAI | 43.8% | – | – |
| Grok 4 | xAI | 41.4% | 64% | Positive |
| Claude Opus 4.5 | Anthropic | 40.7% | – | – |
| GPT-5 (high) | OpenAI | 40.7% | – | – |
| Claude Sonnet 4.6 (max) | Anthropic | 40.0% | – | – |
| Claude Sonnet 4.6 | Anthropic | 38.0% | ~38% | – |
| GPT-5.1 (high) | OpenAI | 37.6% | 81% | Positive |
Source: Artificial Analysis AA-Omniscience, November 2025 - February 2026 [2]
AA-Omniscience: Accuracy vs. hallucination rate. The green quadrant shows reliable models. Source: Artificial Analysis [2]
Lowest Hallucination Rates
| Model | Provider | Hallucination Rate |
|---|---|---|
| Claude 4.1 Opus (Reasoning) | Anthropic | 0% |
| Claude 4 Opus (Reasoning) | Anthropic | 0% |
| Claude 4.5 Haiku | Anthropic | 25% |
| Claude Sonnet 4.6 | Anthropic | ~38% |
| Claude 4.5 Sonnet | Anthropic | 48% |
| Gemini 3.1 Pro Preview | 50% | |
| Claude Opus 4.5 | Anthropic | 58% |
| Grok 4 | xAI | 64% |
| Grok 4.1 Fast | xAI | 72% |
| DeepSeek R1 0528 | DeepSeek | 83% |
| Llama 4 Maverick | Meta | 87.6% |
| Gemini 3 Pro Preview | 88% |
Note: Hallucination rate in AA-Omniscience measures how often the model answers incorrectly when it should have refused — the proportion of incorrect answers out of all non-correct responses. This is an overconfidence metric. Source: Artificial Analysis AA-Omniscience [2]
The Gemini 3 Pro Paradox
Gemini 3 Pro tells the most interesting story in this data. It achieved the highest accuracy (55.9%) by a wide margin — it knows more than any other model tested. But it also showed an 88% hallucination rate. When it doesn't know an answer, it fabricates one 88% of the time rather than admitting uncertainty. [2]
High knowledge + low self-awareness = a model that's brilliant when it's right and dangerous when it's wrong.
The Gemini 3.1 Pro update partially addressed this. Google's calibration tuning cut the hallucination rate from 88% to 50% while maintaining nearly identical accuracy (55.3% vs 55.9%). The Omniscience Index jumped from 16 to 33 — the highest of any model. This proved that dramatic hallucination reduction is possible without meaningful accuracy sacrifice. [15]
Domain-Specific Leaders
No single model dominates all knowledge areas:
| Domain | Best Model |
|---|---|
| Law | Claude 4.1 Opus |
| Software Engineering | Claude 4.1 Opus |
| Humanities & Social Sciences | Claude 4.1 Opus |
| Business | GPT-5.1.1 |
| Health | Grok 4 |
| Science & Math | Grok 4 |
Source: Artificial Analysis AA-Omniscience [2]
Claude models lead in domains where precise reasoning and citation accuracy matter. Grok leads in domains where broad knowledge coverage matters. GPT leads in business applications. This fragmentation is itself data — it means no single model is the safest choice for every professional use case.
One Statistic That Matters More Than the Rest
Accuracy correlates with model size. Hallucination rate does not.
Bigger models know more, but they don't necessarily know what they don't know. Throwing more parameters at the problem increases knowledge without increasing self-awareness. This is why the hallucination problem won't simply disappear with the next model generation.
FACTS Benchmark (Google DeepMind)
The FACTS benchmark, published in December 2025, breaks factuality into four distinct dimensions. This makes it possible to see exactly where each model is strong and where it fails. [3]
What the Four Slices Measure
Grounding: Can the model faithfully use information from provided documents? Tested through summarization and extraction tasks with source material.
Multimodal: Can the model accurately describe and reason about visual content alongside text?
Parametric: Does the model's internal knowledge (stored in its weights from training) produce correct answers without external tools?
Search: How accurate is the model when it has access to web search and retrieval tools?
Model Scores Across All Four Slices
| Model | Overall | Grounding | Multimodal | Parametric | Search |
|---|---|---|---|---|---|
| Gemini 3 Pro | 68.8 | 69.0 | 46.1 | 76.4 | 83.8 |
| Gemini 2.5 Pro | 62.1 | – | – | – | – |
| GPT-5 | 61.8 | – | – | – | 77.7 |
| Grok 4 | 53.6 | – | – | – | 75.3 |
| GPT o3 | 52.0 | 36.2 | – | 57.1 | – |
| Claude 4.5 Opus | 51.3 | – | – | – | – |
| GPT 4.1 | 50.5 | – | – | – | – |
| Gemini 2.5 Flash | 50.4 | – | – | – | – |
| GPT 5.1 | 49.4 | – | – | – | – |
| Claude 4.5 Sonnet Thinking | 49.1 | – | – | – | – |
| Claude 4.1 Opus | 46.5 | – | – | – | – |
| GPT 5 mini | 45.9 | – | – | – | – |
| Claude 4 Sonnet | 42.8 | – | – | – | – |
| GPT o4 mini | 37.6 | – | – | – | – |
| Grok 4 Fast | 36.0 | – | – | – | – |
Note: Dashes indicate slice-level scores not separately reported in published sources. Overall FACTS score is an aggregate across all four slices. Source: FACTS Benchmark Suite, December 2025 [3]
What This Data Reveals
No model breaks 70%. The best score on FACTS is Gemini 3 Pro's 68.8. Every model is wrong more than 30% of the time on this multi-dimensional factuality evaluation.
Search is the strongest slice for everyone. Gemini 3 Pro hits 83.8 and GPT-5 hits 77.7 on search-enabled factuality. When models can look things up, they're materially more accurate. When they rely on stored knowledge alone, accuracy drops. This matches the browse-on vs browse-off findings from OpenAI's system cards.
Grok 4 has a 50-point internal gap. It scores 75.3 on Search but 25.7 on Multimodal — a massive inconsistency that means it can find facts well but struggles with visual content. Any evaluation that averages these into a single score hides this gap.
Gemini 3 Pro's improvement is real. Compared to Gemini 2.5 Pro, Gemini 3 Pro reduced error rates by 55% on the Search slice and 35% on the Parametric slice. That's a large generation-over-generation improvement in factual accuracy, driven primarily by better search and grounding capabilities.
Frontier Model Hallucination Profiles
Every model below is profiled across multiple benchmarks. Single-benchmark comparisons mislead — the profiles show where each model is reliable and where it isn't.
Frontier model profiles across 5 hallucination dimensions. Sources: Vectara [1], AA-Omniscience [2], FACTS [3], SimpleQA [4]
GPT-5 Family (OpenAI)
GPT-5.3 Instant (March 2026) — OpenAI's newest. Reduces hallucination by 26.8% with web search and 19.7% without, relative to prior models. [10]
GPT-5.2 (December 2025) — The professional workhorse. AA-Omniscience accuracy: 43.8%. With web search: 93.9% error-free responses. Without: error rate jumps to 12%. HalluHard: 38.2% with web. FACTS overall: 61.8. [9]
GPT-5 (August 2025) — Vectara old dataset: 1.4% (strong). Vectara new dataset: >10% (weak). HealthBench thinking mode: 1.6% — one of the best medical hallucination scores recorded. SimpleQA without web: 47%. With web: 9.6%. FACTS overall: 61.8. [8][12]
The pattern across the GPT-5 family: web search access is the single biggest variable. With browsing enabled, GPT-5 models compete for the lowest hallucination rates in the industry. Without it, rates jump 3-5x. If you're deploying a GPT-5 variant, keep web access on.
Claude Family (Anthropic)
Claude 4.1 Opus — AA-Omniscience hallucination rate: 0%. The absolute lowest of any model tested. Achieved this by refusing to answer when uncertain. FACTS: 46.5. Domain leader in Law, Software Engineering, and Humanities. [2]
Claude Opus 4.6 (February 2026) — AA-Omniscience accuracy: 46.4%, index: 14. Vectara new dataset (Feb 2026 snapshot): 12.2%. Third-highest non-Gemini Omniscience Index. [14][2]
Claude Opus 4.5 (November 2025) — AA-Omniscience hallucination: 58%, accuracy: 45.7%. HalluHard: 30% with web search (lowest of any model tested), 60% without. FACTS: 51.3. [5]
Claude Sonnet 4.6 (February 2026) — AA-Omniscience hallucination: ~38%, down from Sonnet 4.5's 48%. Users preferred Sonnet 4.6 over Opus 4.5 59% of the time, citing fewer hallucinations. Vectara new dataset: 10.6%. [13][50]
The pattern across Claude: Anthropic's models are calibrated to refuse rather than guess. This gives them the lowest hallucination rates on knowledge benchmarks (AA-Omniscience) but lower raw accuracy compared to Gemini. For applications where a wrong answer is worse than no answer — legal research, medical consultation, compliance work — Claude's approach is structurally safer.
Gemini Family (Google)
Gemini 3.1 Pro Preview (February 2026) — AA-Omniscience index: 33 (highest of any model). Accuracy: 55.3%. Hallucination rate: 50%, down from Gemini 3 Pro's 88%. This was the biggest single-update hallucination improvement in 2025-2026. Vectara new dataset: 10.4%. [15]
Gemini 3 Pro — FACTS overall: 68.8 (highest of any model). FACTS Search: 83.8. FACTS Parametric: 76.4. AA-Omniscience accuracy: 55.9% (highest) with 88% hallucination. The Gemini Paradox: most knowledgeable, least self-aware. [3]
Gemini 3 Flash (December 2025) — AA-Omniscience accuracy: 54.0% (highest of any model at launch). Hallucination rate: 91%. Speed: 218 tokens/s. The most extreme version of the Gemini Paradox — brilliant and unreliable in equal measure. Suitable only for tasks with external verification. [16]
The pattern across Gemini: Google's models know the most but admit the least. They attempt every question, which gives them top accuracy scores but catastrophic hallucination rates when they encounter their knowledge limits. The 3.1 Pro update showed this is addressable through calibration tuning — hallucination dropped 38 percentage points with only 1% accuracy loss.
Grok Family (xAI)
Grok 4 — Vectara old dataset: 4.8%. AA-Omniscience: 41.4% accuracy, 64% hallucination, positive index. FACTS: 53.6 (Search: 75.3, Multimodal: 25.7). Domain leader in Health and Science on AA-Omniscience. [2]
Grok 4.1 Fast — xAI claims 65% hallucination reduction (12.09% to 4.22% on internal benchmarks). AA-Omniscience tells a different story: 72% hallucination rate, worse than Grok 4's 64%. Sycophancy also increased (MASK benchmark: 0.07 to 0.19-0.23). [17]
Grok-3 — Columbia Journalism Review: 94% citation hallucination rate. By far the worst score on this benchmark. [6]
The pattern across Grok: Internal benchmarks and independent benchmarks disagree sharply. xAI reports improvements; AA-Omniscience shows regression. The 94% CJR citation hallucination rate is not from an older model — Grok-3 was tested in March 2025. Domain-specific value exists in Health and Science, but the inconsistency across benchmarks makes Grok risky as a sole model for any high-stakes application.
Perplexity Sonar (Perplexity AI)
Sonar Reasoning Pro — Search Arena score: 1136, statistically tied with Gemini 2.5 Pro for #1. SimpleQA F-score: 0.858, the highest of any model at time of testing. CJR citation accuracy: 37% hallucination (best tested). Response accuracy: >90% for factual queries (94% overall, 95% academic, 94% technical). [18][19]
Sonar Pro — Built on Llama 3.3 70B, fine-tuned for search factuality. SimpleQA F-score: 0.858. Outperforms GPT-4o and Claude 3.5 Sonnet on factuality benchmarks. [19]
The Perplexity risk: Perplexity introduces a failure mode no other model shares. It cites real URLs with fabricated claims. The sources look legitimate — real websites, real publication names — but the information attributed to those sources may be invented. This makes Perplexity hallucinations harder to detect than hallucinations from models that don't present external citations. A 37% citation hallucination rate means more than one in three source attributions may contain fabricated content. [51]
DeepSeek (DeepSeek AI)
DeepSeek-V3 — Vectara old dataset: 3.9%. A strong performer on grounded summarization.
DeepSeek-R1 — Vectara old dataset: 14.3%, nearly 4x higher than V3. AA-Omniscience hallucination: 83%. Vectara analysis found R1 produces 71.7% "benign hallucinations" (plausible-sounding additions) vs V3's 36.8%. [49][48]
The pattern: DeepSeek's reasoning model (R1) hallucinates dramatically more than its base model (V3). This is the reasoning tax in its most extreme form. The gap (3.9% vs 14.3%) makes it one of the clearest examples that reasoning capabilities and factual reliability don't move in the same direction.
Open-Source Models
Llama 4 Maverick (Meta) — Vectara old dataset: 4.6% (competitive). AA-Omniscience hallucination: 87.6% (catastrophic). The gap between grounded summarization and open-ended knowledge is wider for open-source models than for any proprietary family. [2]
Open-source models exceeded 80% hallucination rates in medical scenarios in MedRxiv testing. For critical applications, the hallucination gap between open-source and proprietary frontier models remains large. [40]
Head-to-Head Model Comparisons
The model profiles in Section 6 show individual performance. This section answers the questions people actually search for: "Is Claude or GPT more accurate?" "Should I use Gemini or Claude?" The answer is always "it depends on what you're doing" — but the data makes the tradeoffs specific.
Head-to-head comparison heatmap: which provider wins on which benchmark. Green = winner, yellow = tied, red = loser.
Claude vs GPT
The most searched comparison in AI, and the most context-dependent.
| Benchmark | Claude | GPT | Winner |
|---|---|---|---|
| Vectara (old dataset) | 4.4% (Sonnet 3.7) | 1.4% (GPT-5) | GPT |
| Vectara (new dataset, Feb 2026) | 10.6% (Sonnet 4.6) | 10.8% (GPT-5.2-high) | Tied |
| AA-Omniscience Hallucination | 0% (Claude 4.1 Opus) | ~78% (GPT-5.2) | Claude |
| AA-Omniscience Accuracy | 46.4% (Opus 4.6) | 43.8% (GPT-5.2) | Claude (slight) |
| FACTS Overall | 51.3 (Opus 4.5) | 61.8 (GPT-5) | GPT |
| HealthBench | – | 1.6% (GPT-5 thinking) | GPT |
| HalluHard (with web) | 30% (Opus 4.5) | 38.2% (GPT-5.2) | Claude |
Sources: HealthBench [52], HalluHard [5], FACTS [3], Vectara [1], AA-Omniscience [2]
The pattern isn't "one is better." It's two different philosophies measured on different scales.
GPT models are stronger when the task has source material to work from. Summarization, document analysis, RAG pipelines, search-grounded Q&A — GPT sticks closer to provided text and scores well on faithfulness benchmarks. The FACTS advantage (61.8 vs 51.3) reflects this: GPT-5 handles grounding and search tasks with higher accuracy.
Claude models are stronger when the task requires the model to know its own limits. On AA-Omniscience, Claude 4.1 Opus achieved a 0% hallucination rate by refusing to answer questions it couldn't verify. Claude Sonnet 4.6's ~38% hallucination rate is less than half of GPT-5.2's ~78% on the same benchmark. On HalluHard's realistic conversation test, Claude Opus 4.5 with web search hit 30% — the lowest of any model tested.
The practical split: Use GPT for document-grounded workflows where the source material is available and complete. Use Claude for advisory workflows where the model must draw on its own knowledge and flag uncertainty. This isn't brand preference — it's what the benchmark data supports.
One more variable that often gets overlooked: web search access changes GPT's performance dramatically. GPT-5 drops from 47% hallucination to 9.6% with browsing. Without web access, the Claude-GPT comparison shifts in Claude's favor on open-ended factual tasks. With web access, GPT pulls ahead.
Claude vs Gemini
| Benchmark | Claude | Gemini | Winner |
|---|---|---|---|
| AA-Omniscience Index | 14 (Opus 4.6) | 33 (3.1 Pro) | Gemini |
| AA-Omniscience Accuracy | 46.4% (Opus 4.6) | 55.3% (3.1 Pro) | Gemini |
| AA-Omniscience Hallucination | 0% (Claude 4.1 Opus) | 50% (3.1 Pro) | Claude |
| FACTS Overall | 51.3 (Opus 4.5) | 68.8 (3 Pro) | Gemini |
| Vectara (old dataset) | 4.4% (Sonnet 3.7) | 0.7% (2.0-Flash) | Gemini |
| Vectara (new dataset, Feb 2026) | 10.6% (Sonnet 4.6) | 10.4% (3.1 Pro) | Tied |
| HalluHard (with web) | 30% (Opus 4.5) | – | Claude |
Sources: HalluHard [5], FACTS [3], Vectara [1], AA-Omniscience [2]
Gemini knows more. Claude is more honest about what it doesn't know.
Gemini 3.1 Pro leads on nearly every accuracy metric. It scores highest on FACTS (68.8), highest on AA-Omniscience accuracy (55.3%), and holds the top Omniscience Index (33). When Gemini has the answer, it delivers it more often than Claude does.
The problem is when it doesn't have the answer. Even after the 3.1 calibration update that cut hallucination from 88% to 50%, Gemini still fabricates an answer half the time when it should say "I don't know." Claude 4.1 Opus fabricates 0% of the time in that scenario.
The practical split: Gemini for breadth-of-knowledge tasks where external verification exists — research, comparative analysis, information gathering. Claude for depth-of-trust tasks where a fabricated answer has consequences — compliance reviews, legal research, medical consultation. If you can check Gemini's work, use Gemini. If you can't, use Claude.
GPT vs Gemini
| Benchmark | GPT | Gemini | Winner |
|---|---|---|---|
| Vectara (old dataset) | 0.8% (o3-mini) | 0.7% (2.0-Flash) | Tied |
| Vectara (new dataset) | 5.6% (GPT-4.1) | 3.3% (2.5-Flash-Lite) | Gemini |
| FACTS Overall | 61.8 (GPT-5) | 68.8 (3 Pro) | Gemini |
| FACTS Search | 77.7 (GPT-5) | 83.8 (3 Pro) | Gemini |
| AA-Omniscience Accuracy | 43.8% (GPT-5.2) | 55.3% (3.1 Pro) | Gemini |
| HealthBench | 1.6% (GPT-5 thinking) | – | GPT |
Sources: FACTS [3], Vectara [1], AA-Omniscience [2]
Gemini leads on most benchmarks. GPT's advantage is task-specific: medical applications (1.6% HealthBench), production claim-level accuracy with thinking mode (4.5% incorrect claims), and the sheer volume of internal evaluation data OpenAI publishes.
The practical split: Both are strong with tool access. Without it, Gemini's higher parametric knowledge (FACTS Parametric: 76.4) gives it an edge on stored-knowledge tasks. GPT's thinking mode gives it a specific advantage for medical and health-related queries where reasoning reduces hallucination dramatically.
Grok vs the Field
| Benchmark | Grok | Field Average |
|---|---|---|
| xAI internal factuality | 4.22% (Grok 4.1) | – |
| AA-Omniscience | 64% hallucination (Grok 4) | ~60% average |
| AA-Omniscience (Fast variant) | 72% hallucination (Grok 4.1 Fast) | Worse than base |
| FACTS Overall | 53.6 (Grok 4) | ~52 average |
| FACTS Search | 75.3 (Grok 4) | Competitive |
| FACTS Multimodal | 25.7 (Grok 4) | Far below avg |
| CJR Citation | 94% hallucination (Grok-3) | Worst tested |
| Vectara (new dataset) | 20.2% (Grok-4-fast) | Worst tested |
Sources: Grok 4.1 [17], CJR [6], FACTS [3], AA-Omniscience [2]
xAI reports a 65% hallucination reduction from Grok 4 to 4.1 on internal tests. AA-Omniscience shows the opposite: Grok 4.1 Fast hallucinates at 72% vs Grok 4's 64%. The CJR citation study found Grok-3 hallucinated 94% of the time on news source attribution.
Grok does have genuine domain strengths — it leads Health and Science categories on AA-Omniscience. But the gap between xAI's claims and independent measurements is wider than for any other provider.
The practical takeaway: Don't use Grok as a sole model for high-stakes decisions. Its value is as one voice in a multi-model evaluation where its domain strengths (health, science) can contribute while its inconsistencies get caught by other models.
Perplexity vs ChatGPT vs Claude
| Benchmark | Perplexity | ChatGPT | Claude |
|---|---|---|---|
| CJR Citation Accuracy | 37% hallucination | 67% hallucination | – |
| SimpleQA F-score | 0.858 (best) | 0.38 (GPT-4o) | 0.35 (Sonnet 3.5) |
| Search Arena Ranking | #1 (tied) | – | – |
| Response Accuracy | >90% factual | – | – |
Sources: Perplexity Sonar [18][19], CJR [6]
Perplexity wins on factual search queries. Its RAG-native architecture, built around retrieval rather than parametric knowledge, gives it a structural advantage for questions with verifiable answers.
The catch: Perplexity cites real URLs with fabricated claims. The sources look legitimate — real websites, real publication names — but the information attributed to those sources may be invented. At a 37% citation hallucination rate, more than one in three source attributions could contain fabricated content. This makes Perplexity hallucinations harder to spot than hallucinations from models that don't present external citations.
The practical split: Perplexity for initial research and fact-finding where you'll verify key claims. Not for final-answer scenarios where someone reads the cited source and assumes the attribution is accurate.
Domain-Specific Hallucination Rates
Hallucination rates vary dramatically by subject matter. A model that's accurate on general knowledge can be dangerously wrong on legal questions. This table shows the spread across eight knowledge domains:
Rates by Domain
| Knowledge Domain | Top Models | All Models Average |
|---|---|---|
| General Knowledge | 0.8% | 9.2% |
| Historical Facts | 1.7% | 11.3% |
| Financial Data | 2.1% | 13.8% |
| Technical Documentation | 2.9% | 12.4% |
| Scientific Research | 3.7% | 16.9% |
| Medical / Healthcare | 4.3% | 15.6% |
| Coding & Programming | 5.2% | 17.8% |
| Legal Information | 6.4% | 18.7% |
Source: AllAboutAI, 2025 [31]
Domain-specific hallucination rates: top models vs. average. The 3x gap in Legal and Coding shows how much model selection matters. Source: AllAboutAI [31]
The gap between top models and the average tells you how much model selection matters. On legal information, the best models hallucinate 6.4% of the time. The average model hallucinates 18.7%. Choosing the right model for your domain isn't a preference — it's a 3x difference in reliability.
Legal: The Courtroom Crisis
AI hallucinations in legal filings are accelerating despite growing awareness.
Court cases involving AI hallucinations grew from 10 documented rulings in 2023 to 37 in 2024 to 73 in just the first five months of 2025, with 50+ cases in July 2025 alone. Legal researcher Damien Charlotin has documented 120+ cases where courts found AI-hallucinated quotes, fabricated case citations, or invented legal precedents. [38][37]
Legal AI hallucination incidents: the acceleration from 10 → 37 → 73 → 50+ cases. Sources: Business Insider [38], Charlotin [37]
The problem is no longer amateur. In 2023, most hallucination cases involved self-represented litigants. By May 2025, 13 of 23 caught cases were from practicing lawyers. Morgan & Morgan, one of America's largest personal injury firms, sent an urgent warning to 1,000+ attorneys after sanctions threats for AI-generated citations. Courts have imposed monetary sanctions exceeding $10,000 in at least five cases, four of them in 2025.
The underlying benchmark data explains why. Stanford RegLab and the Stanford Human-Centered AI Institute found that LLMs hallucinate between 69% and 88% on specific legal queries. On questions about a court's core ruling, models hallucinate at least 75% of the time. Even purpose-built legal AI tools fail: Lexis+ AI produced incorrect information more than 17% of the time, and Westlaw AI-Assisted Research hallucinated more than 34%. [36]
Healthcare: Where Hallucinations Can Kill
ECRI, the global healthcare safety nonprofit, listed AI risks as the #1 health technology hazard for 2025. The numbers back up the concern. [39]
The FDA has authorized 1,357 AI-enhanced medical devices — double the figure from end of 2022. Of those, 60 devices were involved in 182 recalls, with 43% of recalls occurring within the first year of approval. [42]
A 2025 MedRxiv study measured hallucination rates on clinical case summaries: 64.1% without mitigation prompts, dropping to 43.1% with mitigation (a 33% improvement). GPT-4o performed best in this study, dropping from 53% to 23% with structured mitigation. Open-source models exceeded 80% hallucination in medical scenarios. [40]
The bright spot: GPT-5 with thinking mode achieved 1.6% hallucination on HealthBench, compared to GPT-4o at 15.8%. For medical applications specifically, reasoning-enabled frontier models with thinking mode active show a dramatic improvement over previous generations. [41][52]
Finance: Quiet Failures with Loud Consequences
Financial AI hallucinations don't make headlines the way legal ones do, but the costs are larger.
78% of financial services firms now deploy AI for data analysis. Without safeguards, hallucination rates on financial tasks run 15-25%. Firms report 2.3 significant AI-driven errors per quarter, with individual incident costs ranging from $50,000 to $2.1 million. [44]
A benchmark study found ChatGPT-4o hallucinated 20.0% on financial literature references. Gemini Advanced hallucinated 76.7% on the same task.
67% of VC firms use AI for deal screening, but the average time to discover an AI-generated error is 3.7 weeks — often too late to reverse a decision. One robo-advisor hallucination affected 2,847 client portfolios, costing $3.2 million in remediation. The SEC imposed $12.7 million in fines for AI misrepresentations across 2024-2025. [43]
Business Impact Statistics
The Cost of Trusting AI Without Verification
$67.4 billion — Global business losses attributed to AI hallucinations in 2024. [31]
47% of business executives have made major decisions based on unverified AI-generated content. [32]
82% of AI bugs in production systems stem from hallucinations and accuracy failures. [34]
4.3 hours per week — Time the average employee spends verifying AI-generated content. At scale, that's $14,200 per employee per year in verification overhead. [33][31]
39% of customer service chatbots required rework due to hallucination-related failures. [34]
54% of companies experienced investor confidence drops directly attributable to AI-generated errors.
The Institutional Response
91% of enterprise AI policies now include hallucination-specific protocols. [31]
64% of healthcare organizations delayed AI adoption specifically because of hallucination concerns. [31]
$12.8 billion invested in hallucination-specific detection and mitigation solutions between 2023 and 2025. [31]
318% market growth in hallucination detection tools from 2023 to 2025. [35]
The Academic Credibility Crisis
53+ papers accepted at NeurIPS 2025 — one of AI's most prestigious conferences — contained AI-hallucinated citations that survived 3+ peer reviewers. NeurIPS acceptance rate is 24.52%, meaning these hallucinated papers beat 15,000+ competing submissions. [45]
When hallucinated citations pass peer review at the field's top venue, the verification problem extends beyond enterprise into the foundations of AI research itself.
When one AI hallucinates, another catches it.
See how multi-model validation works — test it with a real question where accuracy matters.
Try Multi-Model ValidationThe Reasoning Paradox
One of the most counterintuitive findings in 2025-2026 hallucination research: the AI models marketed as most intelligent are often the least reliable on basic factual tasks.
The Core Contradiction
Reasoning models — GPT-5 with thinking, Claude with extended thinking, DeepSeek-R1 — use chain-of-thought processes that dramatically improve performance on complex problems. They're measurably better at math, logic, multi-step analysis, and medical diagnosis.
They're also measurably worse at sticking to facts they've been given.
The Evidence
Vectara new dataset: Every reasoning model tested exceeded 10% hallucination. GPT-5, Claude Sonnet 4.5, Grok-4, and Gemini-3-Pro all crossed that threshold. The Grok-4-fast-reasoning variant hit 20.2%. Non-reasoning models like Gemini-2.5-Flash-Lite scored 3.3%. [1]
DeepSeek: R1 (reasoning) hallucinates at 14.3% on Vectara vs V3 (base) at 3.9%. Nearly a 4x difference from the same provider. Vectara analysis found R1 produces 71.7% "benign hallucinations" (plausible-sounding additions) compared to V3's 36.8%. [48][49]
PersonQA regression: OpenAI's o3 hallucinates 33% on questions about real people vs o1's 16%. The o4-mini is worse at 48%. These are newer, more capable models performing worse on a basic factual test. [53][54]
GPT-5 thinking mode: HealthBench hallucination drops to 1.6% (excellent). But on Vectara new dataset, GPT-5 exceeds 10% (poor). Same model, same thinking mode, opposite results depending on the task.
Why This Happens
The mechanism is straightforward. When a reasoning model processes a summarization task, it doesn't just extract — it thinks. It draws inferences, identifies patterns, and generates insights. These additions go beyond the source document. On a benchmark measuring faithfulness to source material, every insight the model adds counts as a hallucination.
It's the difference between "summarize this contract" and "analyze this contract." Reasoning mode adds analysis even when you ask for a summary. That analysis is often useful. On a summarization benchmark, it's scored as a failure.
The Browse Effect Is Bigger Than the Reasoning Effect
OpenAI's system card data reveals something that gets less attention: web access has a larger impact on hallucination rates than reasoning mode does. [11][8]
| Model | Browse-OFF | Browse-ON | Reduction |
|---|---|---|---|
| o4-mini FActScore | 37.7% | 5.1% | 86% |
| o3 FActScore | 24.2% | 5.7% | 76% |
| GPT-5 thinking FActScore | 3.7% | 1.0% | 73% |
| GPT-5 SimpleQA | 47% | 9.6% | 80% |
Sources: o3/o4-mini system card [11], GPT-5 system card [8]
The browse effect: 73-86% hallucination reduction from a single configuration toggle. Sources: OpenAI system cards [8][11][10]
Turning on web search reduces hallucination more than turning on reasoning. For enterprise deployments, ensuring tool access is more impactful than selecting reasoning vs non-reasoning model variants.
The Decision Framework
This creates a practical matrix for model selection:
Reasoning ON + Web ON: Best for complex analysis, medical diagnosis, multi-step research where both depth and access to current information matter. Lowest hallucination rates on open-ended tasks.
Reasoning OFF + Web ON: Best for document summarization, RAG pipelines, grounded Q&A where you want the model to stay close to source material. Lower risk of "overthinking" additions.
Reasoning ON + Web OFF: Risky combination. The model overthinks and can't verify. Suitable only for closed-world logic problems, math, and code where external facts aren't needed.
Reasoning OFF + Web OFF: Highest hallucination risk across the board. Avoid for any factual task.
Why Zero Hallucination Is Mathematically Impossible
This isn't speculation. Two independent research teams proved it.
Proof 1: Hallucination Is Innate to the Architecture
Xu et al. (2024) formalized the hallucination problem mathematically and proved that eliminating hallucination in large language models is impossible. Not difficult. Not requiring more compute or better training data. Impossible — as in, provably so given the fundamental architecture of how these systems generate text. [20]
The core argument: any system that generates text by predicting probable sequences from learned statistical distributions will, by mathematical necessity, sometimes produce outputs not grounded in fact. The generative mechanism itself guarantees it.
Proof 2: Four Goals That Can't All Be True
Karpowicz (2025) attacked the problem from three different mathematical frameworks — auction theory, proper scoring theory, and log-sum-exp analysis for transformer architectures — and reached the same conclusion each time. [21]
No LLM inference mechanism can simultaneously achieve all four of these properties:
- Truthful response generation — always producing factually correct output
- Semantic information conservation — preserving the meaning of source material
- Relevant knowledge revelation — surfacing stored knowledge when applicable
- Knowledge-constrained optimality — staying within the bounds of what it actually knows
You can optimize for any three. You cannot get all four. The math doesn't allow it.
OpenAI Agrees
OpenAI publicly acknowledged these findings and identified three mathematical factors that make hallucination inevitable: [22]
Epistemic uncertainty — when information appears rarely in training data, the model has no reliable basis for generating accurate output about that topic but will attempt to anyway.
Model limitations — some tasks exceed what the architecture can represent, regardless of training data volume or quality.
Computational intractability — certain verification problems are computationally hard enough that even a theoretical superintelligent system couldn't solve them in reasonable time.
What This Means in Practice
Hallucination is not a bug being fixed in the next model release. It's a permanent mathematical property of how language models work.
This changes the question. The right question isn't "which AI doesn't hallucinate?" — every AI hallucinates. The right question is: what systems do you have in place to catch hallucinations before they reach a decision-maker?
The organizations getting this right aren't waiting for a hallucination-free model. They're building detection layers, cross-validation pipelines, and human review checkpoints. The data on what works (and how much it helps) is in the Reduction Techniques section below.
What Actually Reduces Hallucination — Ranked by Evidence
Not all hallucination reduction techniques are equal. Some are backed by controlled studies with precise measurements. Others have strong theoretical support but limited production data. This ranking reflects the evidence base, not marketing claims.
Hallucination reduction techniques ranked by measured impact. Sources: OpenAI [8][11], AllAboutAI [31], HealthBench [52], UAF [24], CoVe [23], VeriFY [25], Gemini 3.1 [15], MedRxiv [40]
Tier 1: Largest Measured Impact
1. Web Search Access
Measured impact: 73-86% hallucination reduction (FActScore, browse-on vs browse-off)
The single highest-impact intervention documented in 2025-2026 research. GPT-5 drops from 47% to 9.6% hallucination with web access. The o4-mini drops from 37.7% to 5.1%. GPT-5.3 Instant shows 26.8% reduction when using web vs prior models. [8][11][10]
The mechanism is simple: instead of relying on potentially stale or incorrect training data, the model retrieves current information and grounds its response in external sources. For any enterprise deployment, enabling web or tool access should be the first configuration decision, not an afterthought.
2. RAG (Retrieval Augmented Generation)
Measured impact: Up to 71% reduction on enterprise knowledge base tasks [31]
RAG connects models to external knowledge bases — company documents, databases, verified sources — and instructs the model to generate responses grounded in retrieved content rather than parametric memory. Hybrid retrievers combining sparse and dense methods achieve the strongest mitigation.
RAG is most effective for knowledge-gap hallucinations (the model lacks relevant training data). It's less effective for logic-based hallucinations (the model reasons incorrectly from correct premises). For enterprise document Q&A and knowledge base applications, RAG is the standard of care.
Tier 2: Strong Evidence, Context-Dependent
3. Thinking/Reasoning Mode
Measured impact: 55-75% reduction on open-ended medical and factual tasks; increases hallucination on grounded summarization [52]
GPT-5 thinking mode: HealthBench drops from 3.6% to 1.6%. Production ChatGPT traffic: 4.8% of responses contain major incorrect claims vs 11.6% without thinking. These are significant improvements.
But reasoning mode increases hallucination on Vectara's summarization benchmark (see Section 10). The impact is task-dependent. Enable reasoning for analysis, diagnosis, and complex queries. Disable it for summarization, extraction, and source-faithful tasks.
4. Multi-Model Cross-Validation
Measured impact: 8% accuracy improvement over single-model approaches (UAF framework) [24]
Amazon's Uncertainty-Aware Fusion framework (published ACM WWW 2025) combined multiple LLMs weighted by their accuracy and self-assessment quality. The key finding: different models excel on different question types, so combining them captures complementary strengths.
Cross-model disagreement detection catches hallucinations because models rarely fabricate the same false information. When one model makes an unsupported claim, others typically flag the inconsistency or provide conflicting data. Research on "wisdom of the silicon crowd" shows LLM ensembles can rival human crowd forecasting accuracy through simple aggregation.
The 8% figure understates the practical value. In production, multi-model approaches catch errors that no single-model check would flag — because the checking model has different training data, different biases, and different blind spots.
5. Chain-of-Verification (CoVe)
Measured impact: 28% FActScore improvement [23]
A four-step pipeline: generate baseline response, plan verification questions, answer those verification questions independently, then refine the final output. Published at ACL 2024, it outperforms zero-shot, few-shot, and chain-of-thought prompting on long-form generation accuracy.
The cost is latency and compute: four steps instead of one. For applications where accuracy matters more than speed — report generation, research synthesis, compliance documentation — the tradeoff is worth it.
Tier 3: Meaningful but Narrower
6. VeriFY (Training-Time Verification)
Measured impact: 9.7-53.3% hallucination reduction across model families [25]
Published at ICML 2025, VeriFY teaches models to assess factual uncertainty during generation rather than relying on post-hoc checking. The model learns to verify its own claims as it produces them. Recall loss is modest: 0.4-5.7%.
This is a training-time intervention, meaning end users don't control it. Its value is in signaling where the field is heading: future model generations will likely internalize verification as a core capability rather than bolting it on after generation.
7. Calibration Tuning
Measured impact: 38 percentage point AI hallucination reduction (Gemini 3.1 Pro, 88% to 50%) with only 1% accuracy loss [15]
Google demonstrated that tuning a model's calibration — its ability to match confidence to actual accuracy — can dramatically reduce hallucination without sacrificing knowledge. Gemini 3.1 Pro's Omniscience Index jumped from 16 to 33 with this approach.
Like VeriFY, this is a provider-side intervention. Users benefit from it when selecting newer model versions but can't apply it themselves.
8. Domain-Specific Mitigation Prompts
Measured impact: 33% reduction on medical tasks (64.1% to 43.1%); GPT-4o dropped from 53% to 23% [40]
Structured prompts that instruct the model to constrain outputs to verified information, flag uncertainty, and avoid speculation. These work best in narrow domains with clear boundaries and well-defined terminology.
The medical results are encouraging but the absolute rates remain high (43.1% with mitigation is still dangerously wrong for clinical use). Domain prompts are a layer, not a solution.
What Doesn't Work (Or Works Less Than Claimed)
Larger models alone: Accuracy correlates with model size. Hallucination rate does not. Bigger models know more but don't necessarily know what they don't know.
Simple temperature reduction: Lowering generation temperature reduces variety but doesn't eliminate hallucination. The model still picks the most probable token — it just does so more consistently, including consistently wrong tokens.
"Be accurate" system prompts: Generic instructions to avoid hallucination show minimal measured effect. Models already "try" to be accurate. The issue is architectural, not motivational.
The Multi-Model Evidence
Research published across 2024-2026 increasingly converges on a specific finding: querying multiple AI models on the same question catches errors that single-model approaches miss. This isn't a theoretical argument. Multiple peer-reviewed studies provide measured evidence.
The Amazon UAF Framework (ACM WWW 2025)
The Uncertainty-Aware Fusion (UAF) framework combines multiple LLMs weighted by two factors: each model's accuracy on the task and each model's ability to self-assess when it's uncertain. The measured result: 8% accuracy improvement over any individual model. [24]
The critical insight from the study: "LLMs' accuracy and self-assessment capabilities vary widely with different models excelling in different scenarios." No single model dominates all question types. GPT may be strongest on grounded tasks, Claude on knowledge-calibration tasks, Gemini on breadth-of-knowledge tasks. The ensemble captures all three strengths.
The Disagreement Detection Mechanism
Models trained on different data, with different architectures and different alignment tuning, develop different failure patterns. When five models analyze the same question, they rarely fabricate the same false information.
One model claims a legal precedent exists. Four others don't mention it. That disagreement is a signal. A human reviewer can investigate the specific claim rather than reviewing the entire output.
This works because hallucinations are stochastic, not systematic. A model doesn't consistently hallucinate the same incorrect fact — it fills gaps with different plausible-sounding content each time. When multiple models fill the same gap with conflicting content, the gap becomes visible.
The "Wisdom of the Silicon Crowd" Research
Multiple studies show that simple aggregation across LLM outputs can rival the accuracy of human crowd forecasting. The mechanism parallels Galton's ox-weight experiment and Surowiecki's "Wisdom of Crowds" — individual estimates are biased, but the aggregate cancels out uncorrelated errors. [28]
For AI, this means: five models with 60% individual accuracy, with uncorrelated errors, can produce aggregate outputs significantly above 60% accuracy. The math favors diversity over individual excellence.
What Cross-Validation Catches (And What It Misses)
Catches well:
- Fabricated citations and references (different models cite different sources — conflicting citations flag the problem)
- Invented statistics and data points (one model's fabricated 47% is unlikely to match another model's fabricated 47%)
- Made-up entities, case law, research papers (hard for five models to independently invent the same nonexistent case)
- Reasoning errors where one model takes a logical shortcut another model questions
Catches less well:
- Errors present in shared training data (all models trained on the same incorrect Wikipedia article will reproduce the same error)
- Widely-believed misconceptions coded into multiple training sets
- Systematic biases shared across model families (e.g., Western-centric historical narratives)
Multi-model validation is a detection layer, not a guarantee. It raises the probability of catching hallucinations. It doesn't eliminate them. The organizations getting the best results combine multi-model cross-validation with domain-specific verification, human review checkpoints, and tool-enabled grounding. [27]
The Research Gap
There is still limited standardized public reporting measuring "five-model cross-validation reduces hallucination by X%" across domains under controlled conditions. The UAF framework's 8% improvement is the strongest single number. Production case studies from multi-model platforms are emerging but not yet published in peer-reviewed venues.
The safest evidence-based position: multi-model orchestration is a risk-reduction architecture that increases detection probability. It is not a guarantee of zero hallucination. No approach achieves that guarantee — as the mathematical proofs in Section 11 demonstrate.
Try cross-model fact-checking on your own question.
Ask something where accuracy matters. Watch five AI models respond — and see where they disagree.
Open the PlaygroundAI Hallucination Detection Tools
The Tools Landscape
The hallucination detection market grew 318% from 2023 to 2025, with $12.8 billion invested in dedicated solutions. This growth rate reflects how seriously enterprises take the problem — and how inadequate built-in model guardrails are for production use. [35]
Leading Detection Tools (2025-2026)
| Tool | Detection Accuracy | Key Strength |
|---|---|---|
| W&B Weave | 91% | Chain-of-thought reasoning, production pipeline integration |
| Arize Phoenix | 90% | Label-based outputs, confidence scoring, real-time monitoring |
| Comet Opik | 72% | 100% precision (zero false positives), conservative approach |
| Galileo | N/A | Hallucination Index scoring, real-time blocking, CI/CD integration |
| GPTZero Citation Check | 99%+ | Verified citations against web/academic databases |
| Future AGI | N/A | RAG-specific hallucination detection, experiment monitoring |
| Pythia | N/A | Knowledge graph-based fact-checking, regulated industries |
Sources: AIMultiple benchmark (2026) [46], Future AGI (2025) [47], GPTZero/Fortune [45]
What the Accuracy Gap Means
The top detection tools catch 90-91% of hallucinations. That means roughly 1 in 10 hallucinated outputs still passes undetected through the best available automated checking. For applications where a single undetected hallucination has material consequences — legal filings, medical decisions, financial reporting — automated detection is a necessary layer but not a sufficient one.
Comet Opik's approach is worth noting separately. At 72% detection accuracy, it catches fewer hallucinations. But it has 100% precision — zero false positives. It never flags a correct statement as hallucinated. For workflows where false alarms are costly (interrupting a doctor mid-diagnosis, flagging a correct legal citation for review), this tradeoff may be preferable.
Historical Progression
Four Years of Improvement on Simple Tasks
| Year | Best Hallucination Rate | Context |
|---|---|---|
| 2021 | ~21.8% | Early GPT-3 era |
| 2022 | ~15.0% | RLHF alignment improvements |
| 2023 | ~8.0% | GPT-4 launch and competitive pressure |
| 2024 | ~3.0% | Rapid iteration across all providers |
| 2025 | 0.7% | Gemini-2.0-Flash on Vectara original dataset |
Four years of hallucination improvement on simple summarization tasks: 21.8% → 0.7%. Sources: Vectara [1], AllAboutAI [31]
That's a 96% reduction in best-model hallucination rates over four years on the Vectara summarization benchmark. The trend line is real and it's steep.
The Reality Check
These improvements measure the easiest version of the problem: summarizing short documents without adding unsupported facts. When you move to harder, more realistic evaluations, the picture changes:
AA-Omniscience (hard knowledge questions): 36 out of 40 models are more likely to give a confident wrong answer than a correct one. Only four models achieved a positive Omniscience Index. [2]
HalluHard (realistic conversations): Even the best model (Claude Opus 4.5 with web search) hallucinates 30% of the time. Most models fall in the 50-70% range. [5]
Vectara new dataset (enterprise-length documents): Rates jump 3-10x compared to the original dataset. The best score is 3.3%, not 0.7%. [1]
Domain-specific tasks: Legal hallucination averages 18.7%. Medical averages 15.6%. These haven't shown the same improvement trajectory as general summarization. [31]
Improvement is real. But extrapolating from simple benchmarks to enterprise reliability is a mistake the data doesn't support.
Methodology and How to Read This Data
Sources
This page draws from the following primary sources:
Benchmarks: Vectara HHEM Leaderboard (both the original ~1,000 document dataset and the refreshed 7,700-article dataset), Artificial Analysis AA-Omniscience, Google DeepMind FACTS Benchmark, OpenAI SimpleQA and PersonQA, HalluHard (Swiss-German research consortium), and the Columbia Journalism Review citation accuracy study.
System cards and technical reports: OpenAI GPT-5 system card, GPT-5.2 deployment update, o3/o4-mini system card, Anthropic model announcements for Claude Opus 4.5/4.6 and Sonnet 4.6, Google DeepMind FACTS methodology paper.
Industry studies and incident data: Stanford RegLab/HAI legal AI study, MedRxiv medical hallucination research, Deloitte Global AI Survey, Forrester enterprise AI cost analysis, AllAboutAI hallucination statistics compilation, Business Insider court ruling tracker, Damien Charlotin legal citation hallucination database, and the GPTZero/Fortune NeurIPS 2025 analysis.
Academic research: Xu et al. (2024) on impossibility of hallucination elimination, Karpowicz (2025) on mathematical impossibility across three proof frameworks, Amazon/ACM WWW 2025 Uncertainty-Aware Fusion framework, ICML 2025 VeriFY training-time verification, ACL 2024 Chain-of-Verification.
What We Excluded
TruthfulQA — partially saturated. Included in model training data, contains some incorrect gold answers, and can be gamed to 79.6% accuracy by a decision tree that never sees the question.
HaluEval — solvable by answer length. A classifier that flags answers over 27 characters as hallucinated achieves 93.3% accuracy, undermining the benchmark's validity for model comparison.
Unverified community benchmarks — Reddit posts, Twitter claims, and blog articles citing benchmark numbers without methodology documentation or reproducibility information were excluded unless they could be cross-referenced against primary sources.
Vendor marketing claims — where a provider claims a specific hallucination rate but independent benchmarks show different numbers, both are presented with the discrepancy noted. This applies particularly to xAI's internal Grok benchmarks versus AA-Omniscience results.
Benchmark Dates and Versions
Vectara snapshots are dated. The original dataset was evaluated through April 2025. The refreshed dataset covers November 2025 through February 2026, with the most recent snapshot dated February 25, 2026. AA-Omniscience launched November 2025 and has been updated as new models release. FACTS was published December 2025. OpenAI system cards are dated per release.
When two benchmarks show different numbers for the same model, this usually reflects different evaluation dates, different dataset versions, or different aspects of factuality being measured. We flag these discrepancies rather than averaging them.
Known Data Gaps
Perplexity Sonar models are not listed on AA-Omniscience or Vectara. Perplexity uses underlying models (including GPT and DeepSeek variants) making hallucination attribution complex. Their SimpleQA and Search Arena results are included where available.
Claude Opus 4.6 and Sonnet 4.6 were released in February 2026. AA-Omniscience data is appearing but early. Vectara new-dataset scores are not yet available for the 4.6 generation.
GPT-5.3 has AA-Omniscience data (51.8% accuracy for Codex variant) but limited coverage on other benchmarks as of this writing.
Domain-specific breakdowns for most benchmarks test general knowledge. Industry-specific hallucination data (financial, medical, legal) comes primarily from specialized studies rather than the major leaderboards.
Business cost figures come from surveys and estimates rather than verified incident databases. The $67.4 billion figure, the per-employee verification costs, and the per-incident ranges should be treated as indicative rather than precise.
Update Cadence
Monthly: Vectara leaderboard snapshots, AA-Omniscience new model additions, OpenAI system card updates, new model release data.
Quarterly: FACTS leaderboard changes, new benchmark introductions, academic paper findings, regulatory developments (particularly EU AI Act enforcement related to accuracy requirements).
As needed: Major model releases, significant incident reports, court ruling milestones, and changes to benchmark methodology.
References and Sources
Benchmarks and Leaderboards
- Vectara. "Hallucination Leaderboard (HHEM-2.3)." GitHub Repository. Last updated February 25, 2026. github.com/vectara/hallucination-leaderboard
- Artificial Analysis. "AA-Omniscience: Knowledge and Hallucination Benchmark." November 2025. artificialanalysis.ai/evaluations/omniscience
- Google DeepMind. "FACTS Grounding: Evaluating and Improving Factuality in Large Language Models." FACTS Benchmark Suite, December 2025.
- OpenAI. "SimpleQA: Measuring Short-form Factuality." OpenAI Research, 2024.
- Müller, R. et al. "HalluHard: A Challenging Hallucination Benchmark for Realistic Conversations." 2025. the-decoder.com
- Columbia Journalism Review. "AI Citation Accuracy Study." March 2025.
- OpenAI. "HALOGEN: Evaluating Hallucination of Generative Foundation Models." arXiv, 2024. arxiv.org/abs/2404.00730
Model System Cards and Provider Announcements
- OpenAI. "GPT-5 System Card." August 2025. W&B summary
- OpenAI. "Introducing GPT-5.2." December 2025. openai.com
- OpenAI. "GPT-5.3 Instant: Smoother, more useful everyday conversations." March 2026. openai.com
- OpenAI. "o3 and o4-mini System Card." 2025. openai.com (PDF)
- OpenAI. "GPT-5 hallucinates less." Mashable, August 2025. mashable.com
- Anthropic. "Introducing Claude Sonnet 4.6." February 2026. anthropic.com
- Anthropic. "Claude Opus 4.5 Benchmarks and Analysis." Artificial Analysis, November 2025. artificialanalysis.ai
- Artificial Analysis. "Gemini 3.1 Pro Preview: The new leader in AI." February 2026. artificialanalysis.ai
- Artificial Analysis. "Gemini 3 Flash — Everything you need to know." December 2025. artificialanalysis.ai
- Digital Applied. "Grok 4.1: xAI Emotional AI Complete Guide." 2026. digitalapplied.com
- Perplexity AI. "Perplexity Sonar Dominates New Search Arena Evaluation." perplexity.ai
- Perplexity AI. "Introducing the Sonar Pro API." perplexity.ai
Academic Research — Hallucination Impossibility and Theory
- Xu, Z. et al. "Hallucination is Inevitable: An Innate Limitation of Large Language Models." arXiv, 2024. arxiv.org/abs/2401.11817
- Karpowicz, M. "On the Fundamental Impossibility of Hallucination Control in Large Language Models." arXiv, 2025. arxiv.org/abs/2506.06382v3
- OpenAI / Computerworld. "OpenAI admits AI hallucinations are mathematically inevitable." computerworld.com
Academic Research — Hallucination Reduction Techniques
- Dhuliawala, S. et al. "Chain-of-Verification Reduces Hallucination in Large Language Models." ACL 2024 Findings. aclanthology.org
- Luo, Y. et al. "Uncertainty-Aware Fusion: An Ensemble Framework for Mitigating Hallucinations in Large Language Models." Amazon / ACM WWW 2025. arxiv.org/abs/2503.05757
- Zhou, Y. et al. "Do I Really Know? Learning Factual Self-Verification for LLMs (VeriFY)." ICML 2025. arxiv.org
- Singh, A. et al. "Combining CoT, RAG, Self-Consistency, and Self-Verification." arXiv, 2025. arxiv.org/abs/2505.09031
- Li, J. et al. "Mitigating Hallucination in Large Language Models (LLMs): Survey." arXiv, 2025. arxiv.org
Academic Research — Ensemble and Multi-Model Approaches
- Schoenegger, P. et al. "Wisdom of the silicon crowd: LLM ensemble prediction capabilities rival the human crowd." PNAS / PMC, 2025. pmc.ncbi.nlm.nih.gov
Benchmark Methodology Critiques
- Hilgard, S. "Gaming TruthfulQA: Simple Heuristics Exposed Dataset Weaknesses." turntrout.com
- Li, J. et al. "HaluEval: A Large-Scale Hallucination Evaluation Benchmark." arXiv. Referenced critique: solvable by answer-length heuristic.
Industry Studies and Reports
- AllAboutAI. "AI Hallucination Statistics and Research Report 2025-2026." Primary compilation source for domain-specific rates, business impact figures, and historical progression data.
- Deloitte. "Global AI Survey 2025." Source for executive decision-making statistics (47% made decisions on unverified AI content).
- Forrester. "Enterprise AI Cost Analysis 2025." Source for per-employee verification cost data ($14,200/year, 4.3 hours/week).
- Testlio. "AI Testing and Quality Report 2025." Source for production AI bug statistics (82% from hallucinations, 39% chatbot rework rate).
- Gartner. "Hallucination Detection Tools Market Report 2025." Source for 318% market growth figure and $12.8B investment total.
Legal Hallucination Data
- Stanford RegLab / Stanford Human-Centered AI Institute (HAI). "Legal AI Hallucination Study." hai.stanford.edu
- Charlotin, D. "Legal Citation Hallucination Database." 120+ documented cases of AI-hallucinated legal citations.
- Business Insider. Court ruling tracker: 10 cases (2023), 37 (2024), 73 (first 5 months 2025), 50+ (July 2025 alone).
Healthcare Hallucination Data
- ECRI. "Top 10 Health Technology Hazards for 2025." AI risks listed as #1.
- MedRxiv. "Medical Case Hallucination Study 2025." 64.1% without mitigation, 43.1% with mitigation, GPT-4o 53% to 23%.
- NIH / PMC. "Marked reduction in hallucination rates with GPT-5." pmc.ncbi.nlm.nih.gov
- FDA. AI-enhanced medical device data: 1,357 authorized, 60 involved in 182 recalls, 43% within first year.
Financial Hallucination Data
- SEC enforcement data: $12.7 million in fines for AI misrepresentations, 2024-2025.
- Industry reports (aggregated): 78% of financial firms deploy AI; 15-25% hallucination without safeguards; $50K-$2.1M per incident.
Academic Integrity
- GPTZero / Fortune. "NeurIPS research papers contained 100+ AI-hallucinated citations that survived peer review." January 2026. fortune.com
Detection Tools
- AIMultiple. "AI Hallucination Detection Tools Benchmark 2026." W&B Weave 91%, Arize Phoenix 90%, Comet Opik 72%. research.aimultiple.com
- Future AGI. "Top 5 AI Hallucination Detection Tools in 2025." futureagi.com
Vectara Deep-Dive Studies
- Vectara. "DeepSeek-R1 hallucinates more than DeepSeek-V3." vectara.com
- Vectara. "Why does Deepseek-R1 hallucinate so much?" vectara.com
Model-Specific Data (Additional)
- Reddit / AA-Omniscience community data. "Sonnet 4.6 significantly decreases hallucinations compared to Opus." reddit.com
- Incremys. "Perplexity AI statistics: 2025-2026 trends and SEO impact." incremys.com
- Vellum. "GPT-5 Benchmarks." HealthBench deep-dive. vellum.ai
- Tech Transformation. "OpenAI's o3 and o4-mini Reasoning Models Exhibit Increased Hallucination." tech-transformation.com
- Blockchain.news. "PersonQA Benchmark Reveals Increasing Hallucination Rates in OpenAI Models." blockchain.news
- Voronoi App. "Leading AI Models Show Persistent Hallucinations Despite Accuracy Gains." voronoiapp.com
Regulatory References
- EU AI Act, Article 15. "High-risk AI systems must achieve an appropriate level of accuracy and perform consistently throughout lifecycle." EUR-Lex.
- NIST. "AI Risk Management Framework (AI RMF 1.0)." Including companion profile AI 600-1, approved July 2024.
Stop trusting a single AI with decisions that matter.
Five frontier models. One conversation. Every answer cross-checked. See why professionals who can't afford to be wrong are switching to multi-model validation.
Select Your Plan -->