Quality check · lesson 22 of 23 · AI And Automation UX

AI answer without sources

Underlying principle: An automated system should expose what it is doing, the evidence behind its output, the limits of its authority, and the action a person can take next.

Help users know whether they can rely on an AI answer by exposing its evidence state before they act.

Start with the decision

Does this fit your task?

Users may rely on the answer for policy, compliance, customer support, operations, finance, legal, medical, safety, or public content.

Review the boundary: Compare the task with the alternatives in the decision section.

Review the decision →
Study the interaction

Follow the task before choosing the component

An automated system should expose what it is doing, the evidence behind its output, the limits of its authority, and the action a person can take next.

01 / Recognize the need

What the person is doing

The answer contains claims users may rely on for policy, compliance, support, operations, money, safety, medicine, law, customer communication, product decisions, or public publication.

02 / Design the response

What the interface must communicate

Help users know whether they can rely on an AI answer by exposing its evidence state before they act.

Sourced answer state with citations or grounding visible.

03 / Judge the outcome

What to look for

Which claims in this answer require evidence before users act?

Related links are clearly separated from evidence used by the answer.

Decision first

Choose this pattern when the problem matches

Use when

  • Users may rely on the answer for policy, compliance, customer support, operations, finance, legal, medical, safety, or public content.
  • A product needs to distinguish sourced, unsourced, pending, failed, permission-limited, and draft-only generated answers.

Avoid when

  • The answer already includes valid claim-level citations and source previews; use citation display for improvements.
  • The answer has answer-wide source coverage; use source grounding display for coverage quality.

Problem it prevents

The answer contains claims users may rely on for policy, compliance, support, operations, money, safety, medicine, law, customer communication, product decisions, or public publication.

Test the behavior

Try strong and weak versions of the interaction

Open the working example, try its controls, and compare the behavior against the decision guidance.

In the lab you can
  • switch between strong UI, weak UI, strong UX, and weak UX;
  • trigger required, empty, loading, error, and recovery states;
  • inspect keyboard and accessibility expectations beside the demo.
Launch AI answer without sources in the lab
Pattern anatomy

What a strong implementation has to make clear

User need

The answer contains claims users may rely on for policy, compliance, support, operations, money, safety, medicine, law, customer communication, product decisions, or public publication.

Pattern promise

Help users know whether they can rely on an AI answer by exposing its evidence state before they act.

Required state

Sourced answer state with citations or grounding visible.

Failure to inspect

Retrieval fails but the UI hides the failure and returns a confident answer.

Access contract

Make source search, retry, upload source, request access, ask human, and draft-only controls keyboard reachable.

Quality bar

The difference between expert and weak execution

Strong implementation

Specific, visible, recoverable

  • A user sees that a customer-facing answer is unsourced, runs source search, reviews one unsupported claim, then sends only after the source state changes.
  • A user with missing document permission requests access rather than trusting an incomplete answer.
Weak implementation

Vague, hidden, hard to recover from

  • A retrieval failure is hidden and the model returns an answer from prior knowledge.
  • A Learn more list appears under the answer and looks like evidence even though none of the links were used.
  • A user sends an unsourced renewal-policy answer to a customer because the fluent answer looked complete.
  • Retrieval fails but the UI hides the failure and returns a confident answer.
UI guidance
  • Do not present evidence-dependent AI answers as final when no citations, grounding, source scope, or no-source status is visible.
  • Show sourced, pending, not searched, retrieval failed, no supporting source found, permission-limited, and draft-only states beside the answer and preserve them through copy, apply, export, and handoff actions.
UX guidance
  • Help users know whether they can rely on an AI answer by exposing its evidence state before they act.
  • When sources are missing, provide recovery routes such as search sources, upload documents, choose source scope, retry retrieval, request access, ask a human, or continue only as a draft.
Implementation contract

What the implementation must handle

States

  • Sourced answer state with citations or grounding visible.
  • Retrieval failed state with retry source search path.
  • Pending source search state while streaming or retrieval is still resolving.
  • Draft from model knowledge state that blocks source-dependent apply or publish actions.

Interaction

  • Related links are clearly separated from evidence used by the answer.

Accessibility

  • Make source search, retry, upload source, request access, ask human, and draft-only controls keyboard reachable.
  • Tab reaches answer source status, recovery actions, and any gated copy/apply controls in a predictable order.
  • After a source recovery action completes, focus remains near the updated source status or moves to the first unsupported claim.

Review

  • Which claims in this answer require evidence before users act?
  • Can users tell whether the answer came from retrieved evidence or model prior knowledge?
  • Would source grounding display, citation display, confidence / uncertainty display, streaming response, or correction feedback be the precise pattern?
Evidence trail

Source-backed claims behind this guidance

OpenAI File search guide

OpenAI - checked

Supports annotations and search result inclusion for file-backed generated output.

OpenAI Retrieval guide

OpenAI - checked

Supports retrieval over selected source stores rather than source-free answers.

Full agent/debug reference

Problem Context

  • The answer may be generated from web search, file search, enterprise knowledge sources, selected documents, uploaded files, chat history, model prior knowledge, tool outputs, or no retrieval at all.
  • The answer contains claims users may rely on for policy, compliance, support, operations, money, safety, medicine, law, customer communication, product decisions, or public publication.
  • The system may have skipped retrieval, failed retrieval, hidden permission-limited sources, mixed model knowledge with retrieved evidence, or returned a no-source answer after a source-backed request.
  • Users need to know whether the answer is sourced, not searched, unsupported, permission-limited, stale, or draft-only before acting on it.

Selection Rules

  • Flag this anti-pattern when an AI answer makes evidence-dependent claims and provides no source link, citation marker, grounding panel, source scope, or verification action.
  • Flag it when the UI presents a polished answer as final even though source search was not run, failed, or returned no supporting source.
  • Use source grounding display when the answer needs answer-wide source scope, searched/retrieved/used evidence, and unsupported-claim coverage.
  • Use citation display when individual claims need inline citation markers and source previews.
  • Use confidence / uncertainty display when the issue is model reliability or calibrated uncertainty; confidence is not a replacement for sources.
  • Use streaming response when source events are still pending during generation; keep the answer labelled pending until sources settle.
  • Use correction feedback when users need to report that an answer is wrong, unsupported, or uses the wrong source after the answer is shown.
  • Use AI limitation onboarding when users need upfront expectations about what the system can and cannot source before they ask.
  • Do not show related links, suggested reading, or a generic Learn more list as if those links were evidence used by the answer.
  • If no source is available, label the answer as not sourced, not searched, no supporting source found, or draft from model knowledge, and provide a path to search, upload, cite, ask a human, or continue with explicit risk.

Required States

  • Sourced answer state with citations or grounding visible.
  • Not searched state where retrieval was not run and the answer is labelled accordingly.
  • No supporting source found state with unsupported claims separated from answer text.
  • Retrieval failed state with retry source search path.
  • Permission-limited source state that explains an access gap without pretending the answer is verified.
  • Pending source search state while streaming or retrieval is still resolving.
  • Draft from model knowledge state that blocks source-dependent apply or publish actions.
  • User-provided source needed state with upload, connect, or choose source action.
  • Human verification state for high-stakes answers that remain unsourced.
  • Copy/apply gated state when sources are missing.
  • Bad confident answer state with no source route.
  • Bad related links as evidence state.
  • Bad hidden retrieval failure state.
  • Bad permission omission state.
  • Bad citation promised but missing state.
  • Bad stale source claim state.
  • Bad copy final state that strips no-source warning.

Interaction Contract

  • Evidence-dependent answers must expose whether sources were searched, retrieved, used, unavailable, permission-limited, failed, or not required.
  • Copy, publish, apply, send, export, and automate controls must preserve or surface no-source status when the answer lacks evidence.
  • No-source answers must offer at least one recovery path when possible: search sources, choose corpus, upload file, request access, retry retrieval, ask a human, or mark as draft.
  • When users intentionally continue without sources, the UI records the no-source state and does not convert it into a verified answer.
  • If sources arrive after streaming, answer status updates from pending to sourced, unsupported, permission-limited, or no supporting source found.
  • Related links are clearly separated from evidence used by the answer.
  • Accessible names and status text include the source state, not only a visual badge.

Implementation Checklist

  • Track answer provenance as structured state: source mode, source scope, retrieval status, used evidence, unsupported claims, permissions, freshness, and no-source reason.
  • Render no-source and not-searched labels beside the answer summary, not only in hidden metadata or logs.
  • Provide search, retry, source selection, upload, request access, ask human, and draft-only actions when those routes can change the source state.
  • Block or warn before copy, publish, apply, send, or automate when evidence-dependent claims remain unsourced.
  • Preserve source state in copied text, exports, audit logs, handoffs, and regenerated answer versions.
  • Do not replace missing sources with confidence percentages, related links, generic disclaimers, or decorative citation numbers.
  • Test no retrieval, retrieval failure, zero results, permission-limited sources, stale sources, streaming pending, mobile layout, high zoom, keyboard flow, and screen reader status.

Common Generated-UI Mistakes

  • Showing a polished answer with no citations or grounding after the user asked for a policy-backed answer.
  • Adding a generic disclaimer while still letting users copy or send the unsourced answer as if it were verified.
  • Hiding retrieval failure and returning an answer from model memory.
  • Showing related links below the answer without saying they were not used as evidence.
  • Promising citations in the prompt or product copy and then returning an answer with no source state.
  • Letting regenerated or edited output drop citations without changing the answer status.
  • Treating high confidence as a substitute for source evidence.

Critique Questions

  • Which claims in this answer require evidence before users act?
  • Were sources searched, retrieved, used, unavailable, permission-limited, or not searched?
  • Can users tell whether the answer came from retrieved evidence or model prior knowledge?
  • What happens when retrieval fails or finds no supporting source?
  • Does copy, publish, apply, or send preserve the no-source warning?
  • Would source grounding display, citation display, confidence / uncertainty display, streaming response, or correction feedback be the precise pattern?
Accessibility
  • Expose source state as text near the answer and in status regions, not only as color or icon.
  • Make source search, retry, upload source, request access, ask human, and draft-only controls keyboard reachable.
  • Ensure copied or exported unsourced answers preserve the no-source status when that status changes user risk.
  • Announce transitions from pending to sourced, no supporting source found, retrieval failed, or permission-limited without moving focus unexpectedly.
  • Do not rely on decorative superscripts or link styling to imply evidence.
  • Keep no-source labels readable and reachable in mobile, high-zoom, and screen-reader flows.
Keyboard Behavior
  • Tab reaches answer source status, recovery actions, and any gated copy/apply controls in a predictable order.
  • Enter or Space activates Search sources, Retry retrieval, Upload source, Request access, Ask human, Copy draft, or Continue without sources according to native control behavior.
  • If copy or apply is gated, focus moves to the no-source explanation and recovery actions rather than silently failing.
  • Streaming source status updates do not steal focus from the answer or composer.
  • After a source recovery action completes, focus remains near the updated source status or moves to the first unsupported claim.
Variants
  • No citations on factual answer
  • Not searched answer
  • Retrieval failed but answered
  • No supporting source found
  • Permission-limited source omitted
  • Related links presented as evidence
  • Generated answer from model memory
  • Copied unsourced answer
  • Unsourced customer reply
  • Unsourced policy summary
  • Mobile no-source answer

Verification

Source trail checked:

Saved items