A hallucination is when an AI produces something false and presents it with the same confidence as the truth. The model is not lying — it has no concept of truth. As a large language model, it generates the most plausible-sounding next words, and sometimes the most plausible-sounding answer is simply wrong: a case that was never decided, a study that was never run, a dosage that is dangerously off.

The reason this is the defining risk of professional AI use is that hallucinations are fluent. A bad answer does not look broken; it looks polished, cited, and ready to file. That is precisely what makes it dangerous.

Why it matters at your desk. A lawyer who has read the news about fabricated case citations knows the stakes; the all-pass legal benchmarks now used to evaluate models exist because one invented clause can sink a filing. The practical defences are tools built to show their sources — Consensus and Perplexity link to real papers and pages, and Harvey grounds answers in your actual documents — which is the applied version of retrieval-augmented generation and grounding.

What to watch for: confidence is not a signal of correctness, and "show me the source" is the cheapest insurance you have. If a model cannot point to where a fact came from — and you cannot verify it yourself — treat it as unconfirmed, no matter how sure it sounds.