Guidelines
Suggest edit

Add direct delta encodings for average-difference judgments

For overview judgments of paired quantitative differences in grouped displays, use direct delta encoding on paired-value charts to improve fidelity and mitigate errors from mentally subtracting each pair before averaging for viewers.

  • purpose:refine
  • basis:empirical
  • scope:grouped-result
  • data:quantitative
  • quality:fidelity:use
  • lever:encoding
  • operator:difference
  • reading-mode:overview

advice

Direct delta marks for average difference

Encode each pairwise difference with one delta mark when readers need the average difference across many pairs. For example, replace separate point pairs or bar pairs with one delta mark per pair when readers must estimate the mean delta across the display.

reason

Why direct delta marks work for averaging

A direct delta mark lets readers average the differences themselves. It avoids forcing them to first infer a difference from every pair and only then summarize those inferred values.

Mechanism: Readers can average already-visible differences more precisely than differences they must first mentally extract from separate paired values.

Evidence: In the collated record, the direct delta version of the paired-value display produced lower error than matched individual-value encodings for the aggregate task; the original study reports significantly lower average-difference error for direct delta encodings than for separate point-pair and bar-pair encodings (Zeng & Battle, 2023; Nothelfer & Franconeri, 2020).

Notes: The reported improvement for average-difference estimation was smaller than the search advantage, but it was still consistent and statistically reliable.

context

Use when readers must summarize many pairwise differences

  • User Goal: Judge the overall size of the difference across many pairs.
  • Task: Estimate the average delta across the display.
  • Data: Paired quantitative values with one derived difference per pair.
  • Chart Setting: The current display shows each member of a pair separately and can be revised to show one computed difference per pair.
  • Success Criterion: Lower error in estimating the average difference.

exceptions

Do not use when the original values are still part of the question

  • Break it when: Readers must interpret the average difference together with the original values. Why: A delta-only encoding removes the original-value context.
  • Break it when: Readers must subset or interpret differences by conditions on the original values. Why: Those source values are not visible in the delta-only view.
  • Break it when: The number of required pairings would force too many delta encodings into the display. Why: The added pairwise views can consume too much space.

costs

Costs of direct delta marks for average-difference judgments

Sacrifice: You lose direct visibility of the original values when you show only deltas. Risk: Readers may miss patterns that are tied to the individual data points rather than to their differences. Mitigation: Use the delta-focused view only when the average difference is the main question, and restrict it to the needed pairings.

mistakes

Common failure mode with direct delta marks for averaging

Mistake: Asking readers to estimate an average difference from a display that still requires mental subtraction for every pair. Why it fails: The reader has to perform pairwise difference extraction before they can even start averaging.

check

Check whether the average-difference view needs deltas

Failure Sign: Readers appear to mentally subtract each pair before giving an overall average-difference estimate. Quick Check: Build a matched delta version of the same display and ask a reviewer to estimate the average difference from both versions. Stronger Test: Compare the absolute error of the two estimates; keep the delta version if the error drops.

fix

Fix the average-difference view

  • Compute one difference value for each pair.
  • Replace the separate paired-value marks in the summary view with one delta mark per pair.
  • Encode positive and negative deltas with opposite direction relative to a baseline so the sign of the difference remains explicit.
  • Limit delta encodings to the pairings that actually feed the average-difference judgment.

References

Nothelfer, C., & Franconeri, S. (2020). Measures of the Benefit of Direct Encoding of Data Deltas for Data Pair Relation Perception. IEEE Transactions on Visualization and Computer Graphics, 26(1), 311–320. https://doi.org/10.1109/TVCG.2019.2934801
Zeng, Z., & Battle, L. (2023). A Review and Collation of Graphical Perception Knowledge for Visualization Recommendation. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3544548.3581349