Guidelines
Suggest edit

Keep denominators consistent in numerical risk comparisons

For compare tasks on grouped-result numerical risk displays, use consistent denominators across groups to improve fidelity and mitigate denominator neglect for audiences with low numeracy.

  • purpose:refine
  • basis:empirical
  • task:compare
  • scope:grouped-result
  • quality:fidelity
  • lever:text-annotation
  • chart:text:use
  • knowledge:low

advice

Consistent denominators

Use the same denominator for each group when presenting a numerical risk comparison. For example, rewrite treated-versus-untreated outcomes so both groups are shown as x out of 100 or x out of 800, rather than mixing one numerator over 100 with another over 800.

reason

Why consistent denominators work here

Matched denominators make the two groups directly comparable in a numbers-only display. Readers do not have to normalize mentally before comparing the event counts, so they are less likely to rely on raw numerators.

Mechanism: Keeping the same denominator across groups reduces the chance that readers will compare absolute event counts as if they were proportions.

Evidence: When the study presented equally effective treatments with different denominators in the treated and untreated groups, many participants misestimated risk reduction; errors were much lower when the denominators were equal. This pattern was strongest among low-numeracy participants, showing that consistent denominators improve numerical comparisons (Garcia-Retamero & Galesic, 2009).

context

Where to use consistent denominators

  • User Goal: Understand how much one option changes risk relative to another.
  • Task: Compare two group risks from numbers alone.
  • Data: Two-group outcome counts that can be expressed on a common base.
  • Chart Setting: Text-heavy or numbers-only risk communication without paired icon arrays.
  • Audience: Mixed public audiences, especially readers with low numeracy.
  • Success Criterion: Readers estimate the same treatment effect regardless of which raw group size was larger.

exceptions

When to use a different fix

Break it when: You can add icon arrays that show the full denominator for each group. Why: The source found that icon arrays eliminated the denominator-size effect even when the group totals remained unequal.

costs

Costs of consistent denominators

Sacrifice: You may need to restate the comparison on a common base instead of presenting only the original raw counts.
Risk: Leaving mixed raw denominators prominent beside the common-base rewrite can keep attention on the raw numerators.
Mitigation: If the original unequal totals must remain visible, pair the standardized numbers with icon arrays.

mistakes

Common failure with consistent denominators

Mistake: Mix denominators across groups in a numbers-only comparison. Why it fails: Readers compare raw event counts instead of proportions and overestimate or underestimate the treatment effect.

check

How to test denominator consistency

Failure Sign: Reader judgments change when only the group denominators change, even though the true relative risk reduction stays the same.
Quick Check: Rewrite the same comparison once with matched denominators and once with unmatched denominators; if answers differ, standardize the denominators.
Stronger Test: Ask readers to estimate deaths per 1000 after reading the comparison; if the implied relative risk reduction is too high when the treated group is smaller or too low when it is larger, change the denominators.

fix

How to fix the display

  • Convert each group’s outcome to the same denominator before presenting the comparison.
  • Replace mixed forms such as x out of N versus y out of M with matched forms such as x out of 100 versus y out of 100.
  • Keep the comparison on that common base wherever readers are expected to judge treatment effect from the numbers.
  • If unequal raw totals must remain visible, add paired icon arrays that show each full denominator.

References

Garcia-Retamero, R., & Galesic, M. (2009). Communicating Treatment Risk Reduction to People With Low Numeracy Skills: A Cross-Cultural Comparison. American Journal of Public Health, 99(12), 2196–2202. https://doi.org/10.2105/AJPH.2009.160234