Use hypothetical outcome plots for ambiguous trend judgments
For trend judgment in ordered-time displays, use animated hypothetical outcome samples on time-series uncertainty charts to improve fidelity and mitigate misreading of sampling variability for novice public audiences.
- purpose:refine
- basis:empirical
- task:trend
- time:ordered-time
- quality:fidelity
- lever:encoding
- operator:uncertainty
- temporal-pattern:dynamic
- literacy:novice
advice
Animate hypothetical outcomes
Encode uncertainty as animated hypothetical outcome samples when readers must decide which trend most likely produced noisy observations. For example, replace bar-chart error bars with a bar HOP, or replace a static line ensemble with a line HOP, when the chart asks viewers to choose between competing trends.
reason
Lower the evidence threshold for correct trend judgments
Animated hypothetical outcomes let readers experience variability as repeated sampled cases instead of decoding a summary statistic. That makes the uncertainty part of the comparison rather than a separate abstraction that readers may ignore or misread.
Mechanism: Sequential samples expose how noisy observations can still come from different underlying trends, so readers can judge the likelihood of each trend with less evidence.
Evidence: In experiment 1, bar HOPs produced lower JNDs than bar charts with error bars, meaning participants could identify the underlying trend with less evidence. In experiment 2, regular-rate line HOPs also produced lower JNDs than static line ensembles for the same trend-inference task (Kale et al., 2019).
context
Use when readers must compare noisy trends
- User Goal: Decide which of a small number of alternative trends is more likely.
- Task: Compare uncertain trends and infer which one produced a noisy sample.
- Data: Quantitative ordered-time samples with visible sampling error or other process noise.
- Chart Setting: The chart can show uncertainty as repeated samples on the same bars or lines used for the main series.
- Audience: Untrained readers with limited statistical background.
- Success Criterion: Readers make correct trend judgments from more ambiguous samples.
exceptions
Do not use when motion will not be attended
Break it when: Viewers cannot or will not watch the display long enough to integrate several frames. Why: HOPs depend on temporal integration, so the uncertainty cue weakens when the motion is not actually read.
costs
Trade off static glanceability for experiential uncertainty
Sacrifice: A HOP needs time to play repeated samples instead of showing everything in one static glance. Risk: Readers who ignore the motion may miss the variability cue. Mitigation: Keep the motion focused on the uncertainty comparison and use a trackable playback rate.
mistakes
Do not fall back to summary uncertainty marks for this task
Mistake: Adding error bars or another summary-only uncertainty layer for the same ambiguous trend judgment. Why it fails: Summary marks hide the sampled process that readers need to compare, so viewers need stronger evidence before they can make the correct call.
check
Test the same ambiguous sample both ways
Failure Sign: Readers succeed only when the slope is obvious and fail on borderline samples. Quick Check: Show the same ambiguous sample with the current uncertainty display and with a HOP; if correct choices appear only with the HOP, the current encoding is under-communicating variability. Stronger Test: Run repeated forced-choice judgments across samples with different evidence levels and check whether the HOP lowers the evidence needed for correct decisions.
fix
Replace summary uncertainty with sampled outcomes
- Draw repeated plausible outcomes from each model or trend and animate them as the same bars or lines used in the chart.
- Remove summary uncertainty marks such as error bars for this judgment task.
- If the current uncertainty view is a static line ensemble, convert those sampled lines into a sequential HOP.