Designing AI Chat That Professionals Trust
Designing AI Chat That Professionals Trust
You can have excellent retrieval and a strong model and still build something professionals abandon after two sessions. Trust is an interface property.
How experts evaluate a tool
An expert tests a new tool by asking it something they already know the answer to. This is the moment that decides adoption, and it happens in the first minute.
Three outcomes:
- Right, with a checkable reference. Credibility established.
- Honest refusal. Also credibility established, sometimes more.
- Confidently wrong. Tool is dead. There is no recovering with the same user.
Everything in the design should optimise for the first two and make the third structurally difficult.
Show the source, always
Every substantive claim should carry a visible reference the user can verify — an article number, a table, a standard.
Two reasons, and the second is the important one:
- It lets the user check the work.
- It constrains the system. A design where every claim must be attributable makes unsupported claims harder to produce in the first place.
We render references as distinct visual chips rather than inline prose. They read as citations rather than as part of the sentence, which is exactly the distinction we want the user to make.
Make refusal a designed state
Most chat interfaces treat "I cannot answer that" as an error path. In a professional tool it is a first-class response and should look like one.
A good refusal has structure:
- What cannot be determined
- Why (out of scope, not in the corpus, depends on a measurement)
- What the user should do instead
"I cannot tell you the target subcooling without the data plate — here is how to read it" is a genuinely useful response. Rendered as a shrug, it looks like failure.
Formatting is a trust signal
Wall-of-text answers get skimmed and distrusted. The formatting decisions that measurably helped:
- Lead with the answer, then the reasoning. Experts want the conclusion first.
- Bullets for parallel facts, prose for reasoning. Do not bullet an argument.
- Bold the numbers. They are what gets acted on.
- Keep it short. Length reads as padding, and padding reads as uncertainty.
The things that break trust instantly
Observed repeatedly:
- Hedging on things that are not ambiguous. If the code is unambiguous, say it plainly. Excessive caveats read as not knowing.
- Fabricated references. Fatal, immediately, permanently.
- Answering a slightly different question. Experts notice, and read it as evasion.
- Inconsistency between sessions. Same question, different answer, no visible reason.
The underlying principle
A professional tool is not trying to seem intelligent. It is trying to be accountable. Every design decision should make it easier for the user to verify you and harder for you to bluff.
Get that right and the model quality matters less than you would think.