What it is
Some claims an agentic feature makes about call data reduce to a checkable fact — a caller
asked a specific question at a specific timestamp. Others don’t. “This call was likely
misrouted” or “consider lowering the bid on this campaign” are judgments: interpretations built
on a partial view of what happened, not a fact with a passage to point to. A manager reading
either kind of claim in the same confident prose has no way to tell them apart — and acting on a
wrong judgment as if it were a checked fact is exactly the failure this section exists to guard
against.
Caveat hedges the claim in its own wording, at the moment it’s stated, instead of attaching a
numeric score or a disclaimer somewhere else on the page. “Likely misrouted — the caller asked
for billing but was connected to sales. Based on transcript keywords only; call audio was not
analyzed” tells the manager two things a bare confidence number cannot: what the judgment rests
on, and what it doesn’t — which is the actual information a hedge needs to carry to be useful
rather than decorative.
This is the counterpart to Verification:
verification is for a claim that has a specific source to check against; caveat is for a claim
that doesn’t, because it’s an interpretation rather than a fact. A single piece of output can
need both — a factual claim with a citation, sitting next to a judgment with a hedge — and this
page and Verification’s are written as a pair for exactly that reason.
Choose this when / choose something else when
Agency tier
Suggests. A caveat is definitionally attached to output the user still has to weigh before
acting on it — pairing acknowledged uncertainty with unsupervised authority would be a
contradiction, since the whole point of hedging is that a human needs to make the call the
system won’t.
Caveat can still appear on Drafts-tier output for the user to review before submitting. It
should never appear on the confirmation copy for an Acts-irreversible or Acts-unsupervised
action without that action first being downgraded back to a human decision.
Anatomy
Outcome states
Disclosure & recourse
- Does the user know this is AI? Yes — the caveat text is the disclosure, visible at the
point the claim is read, not deferred to a footer or a settings page.
- What did it use? This is exactly what a caveat should name — what was considered and,
just as importantly, what wasn’t (“transcript keywords only; call audio was not analyzed”).
- How sure is it? This pattern’s entire purpose. Expressed in words tied to what the user
should do (“likely misrouted” implies check before acting), never a bare number — see
the overview’s own constraint on this. A caveat that
doesn’t change the recommended next step should be cut, not softened.
- How does the user check it? Where possible, the caveat points to how — composing with
Verification when a checkable
passage exists. For a genuinely unverifiable judgment (tone, intent), the honest answer is
that there is no check beyond human review, and the caveat says that rather than implying a
check exists.
- How does the user correct it? The user can disregard or override a caveated claim — it’s
Suggests tier, so no formal correction step is required. Whether an override is logged for
future model evaluation is undecided; see Gaps.
- How does the user get out? Not accepting the suggestion is sufficient at this tier; no
further mechanism is needed.
Reference
No model, threshold, or confidence-scoring method has been defined for this pattern yet, and no
mapping from a numeric score to hedge wording exists. This is fact register — nothing below is
invented to fill the gap.
Evaluation
Not evaluated. No set of hedge/no-hedge decisions has been checked against ground truth, and no
eval set exists for whether a given hedge’s wording matches the actual reliability of the claim
it attaches to.
Content
Accessibility
- The hedge icon and label are always paired with text, never color alone — see
Color’s own constraint on this.
- If a caveated claim streams in, the live region announces once the claim and its hedge are
both final — never per token, matching
Stream of thought.
- An indeterminate “based on partial analysis” state needs the same non-visual equivalent as any
other indeterminate wait — text, not a spinner alone.
- The caveat itself does not move focus; it renders inline. If the user expands “Why?” into a
longer methodology note via progressive disclosure, focus moves into the revealed content and
that move is announced.
Constraints
Divergences
Not applicable. Nothing is shipped yet to diverge from.
Gaps
- No decided threshold or mechanism for when a claim needs a caveat at all versus none.
This page’s own rule requires deciding first, but not what the decision is based on.
- No decided vocabulary for degrees of hedge (“likely,” “possibly,” “unclear”) — whether Invoca
standardizes a small hedge-word ladder or leaves the wording to whoever writes each feature’s
copy is undecided.
- Whether a dismissed or ignored caveat is logged anywhere for future model evaluation is
undecided.
- Whether Caveat and Verification can legitimately appear on the same claim at once (a hedge
with a partial citation) is undecided — the two pages describe themselves as alternatives, but
a real output could plausibly need both at the same time.
Volatility
This guidance depends on the eventual model or pipeline being able to express calibrated,
claim-specific uncertainty at all, rather than a single global confidence number — a capability
that varies significantly across model families and that this page cannot verify against
nothing shipped. It also depends on whatever specific limitation a given caveat names (for
example, “audio tone was not analyzed”) remaining true — that kind of claim is the first thing
to go stale, since it expires the moment the underlying capability changes. Reverify when a
model is selected for the first feature that would use Caveat, when the hedge-word vocabulary
referenced above is decided, and whenever a named limitation in a shipped caveat is resolved.
Dated 2026-09-02.
Verification and
Stream of thought, the other
two pages in this batch. AI Experience overview,
for the vocabulary and the agency-tier and outcome-state definitions this page uses.
Actions: Summarize, Signal AI’s shipped
transcript summary, the most likely first place a judgment like this would ship.
Alert,
Tooltip, and
Link, the components this pattern composes.
Progressive disclosure, for the “Why?”
expansion. Error handling, for the refusal case
this pattern is not.
Why it works this way
Hedging in prose rather than a score works because prose can carry what a number cannot: what
the recommended action should be, not just how confident the system feels. A score is precise
looking and mute about action — 82% confident of what, and what should the manager do
differently than at 94%? A sentence that says “based on transcript keywords only; audio tone was
not analyzed” tells the manager exactly what would make the judgment more trustworthy and lets
them decide, which is the only thing a confidence signal is required to do under
the overview’s own constraint on this.
Status
Exemplar page — first pass, entirely proposal. No Invoca product ships this pattern
yet. Nothing below is code fact or measured behavior — it is a proposal for review. See
Coverage, stated honestly.Last modified on September 17, 2026