Guide · From the book

How to measure whether users understood

Measure understanding on four dimensions: whether people can explain what happened, predict what will happen, feel sure the task is done, and say why the outcome occurred. Convert each to a 0 to 100 distance score and average them. The result is the Cognitive Distance Index (CDI), where lower means better understanding.

The four dimensions

Understanding cannot be observed directly, and no single indicator is enough. Self-reports are direct but people do not always know what they do not know. Prediction questions resist that bias but only test what they ask. Open explanations capture what people actually think but must be scored by hand. The Cognitive Distance Index combines all four so that no single measure carries the construct alone.

The four dimensions of the Cognitive Distance Index
DimensionQuestion it answersTypical instrument
Perceived understandingCan the user explain, in plain words, what the system just did?Agreement items after the task, plus “In your own words, what just happened?” scored against a rubric
Predictive accuracyCan the user anticipate the outcome before it is shown?Multiple-choice prediction questions asked after the user confirms but before the result appears
Interaction confidenceDoes the user feel certain about what happened and what to do next?Confidence ratings on each prediction, plus “Is the task done?” (certain / think so / not sure)
Conceptual transparencyCan the user identify why the outcome occurred, not only what it was?Comprehension questions that test the rule behind the outcome

Two details that matter

Ask the prediction before the result. A person who predicts correctly beforehand and explains correctly afterwards holds a causal model of the system. A person who answers correctly only after seeing the result may be repeating what the screen said.

Test causes, not facts. Knowing that an appointment is on Thursday at 14:30 is recall. Knowing why the system booked a general consultation instead of the specialist the person asked for requires understanding the rule behind its behavior.

How to compute the score

Convert each dimension to a distance score from 0 (complete alignment) to 100 (maximal misalignment). Predictive accuracy, for example, becomes 100 minus the percentage of correct predictions. The CDI for a person or a group is the mean of the available dimension scores. Do not report it on fewer than two dimensions, because partial composites are hard to compare.

CDI interpretation bands
CDIBandResponse
0–25Strong alignmentMonitor.
26–45Early warningReview terminology and feedback wording; run targeted tests.
46–65Needs attentionRedesign result screens, explanatory copy and causal labels.
66–100Serious misalignmentRestructure how outcomes are communicated and how information is organized.

The bands are a working proposal, not a validated standard. The CDI is most useful for comparing versions of the same flow, or the same flow across user groups, rather than ranking unrelated products. Treat a score as a reason to look closer, not as a diagnosis.

Watch for the calibration gap

When the dimensions disagree, the pattern is informative. The most worrying combination is high confidence with prediction accuracy near chance. People who know they do not understand will ask for help. People who are wrong but confident cannot correct themselves (Kruger and Dunning 1999). In a license renewal or a medical booking, that is the person who leaves believing the task is finished when it is not.

Start with one flow

The free CDI Starter Kit has a four-page guide, a scoring spreadsheet and an editable Figma file for running the checks on one flow, with a bank transfer as the worked example.

Questions people ask

What is the Cognitive Distance Index?

A 0 to 100 score of how far people’s understanding is from what a system requires. It averages four distance scores: perceived understanding, predictive accuracy, interaction confidence and conceptual transparency. Lower is better.

How many participants do you need to measure understanding?

It depends on the question. To find where one flow confuses people, a small group of sessions is enough to see repeated patterns, and the CDI Starter Kit scores each person and the group’s middle person. To show that one version beats another, you need a planned study with a larger sample, as in the Everyday Services Study.

Can I use the CDI to compare two different products?

Not reliably. The index is baseline-relative: it is most informative for comparing versions of the same system, or the same system across user groups.

Read more in the book

This guide is drawn from From Cognitive Load to Cognitive Distance by Izaias Cavalcanti. The whole book is free to read online and as a PDF.

Cite this guide

Cavalcanti, I. (2026). From Cognitive Load to Cognitive Distance: Reframing Usability and Accessibility in Information Systems. https://book.izaias.xyz/