Skip to main content

STATISTICAL TEST CHOOSER

Which statistical test should I use?

Answer four questions about your research question and data. You get the recommended test, a safer alternative, the assumptions to check, and an APA-style sentence to report it.

YOUR STUDY

Describe your question and data

4 QUESTIONS
1. WHAT DO YOU WANT TO FIND OUT?
2. WHAT TYPE IS YOUR OUTCOME VARIABLE?
3. HOW MANY GROUPS OR TIME POINTS?
4. ARE THE GROUPS THE SAME PEOPLE OR DIFFERENT PEOPLE?

Not sure if your data are normal? Check with the Shapiro-Wilk test. Likert items, ranks, and small skewed samples count as "ordinal / skewed". Summed scale scores from many items are often treated as numeric.

QUICK REFERENCE

Statistical test flowchart in words

Comparing groups (numeric outcome)

  • 2 different groups → independent t-test (Welch) · skewed/ordinal → Mann-Whitney U
  • Same people twice → paired t-test · skewed/ordinal → Wilcoxon signed-rank
  • 3+ different groups → one-way ANOVA · skewed/ordinal → Kruskal-Wallis
  • Same people 3+ times → repeated-measures ANOVA · skewed/ordinal → Friedman

Relationships and categories

  • Two numeric variables → Pearson correlation · skewed/ordinal → Spearman
  • Two categorical variables → chi-square test of independence · small counts → Fisher's exact
  • One categorical variable vs expected proportions → chi-square goodness-of-fit
  • Yes/no measured twice on the same people → McNemar's test

Should I use ANOVA or a t-test?

Use a t-test for exactly two groups and ANOVA for three or more. Running several t-tests instead of one ANOVA inflates the chance of a false positive: with three groups and three t-tests at α = .05, the familywise error rate rises to about 14%.

Should I use ANOVA or chi-square?

It depends on the outcome. If the outcome is a number (a score, time, or scale total), use ANOVA. If the outcome is a category (passed/failed, chose A/B/C), use chi-square.

References

  • Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th ed.). SAGE.
  • American Psychological Association. (2020). Publication Manual of the American Psychological Association (7th ed.).
  • Delacre, M., Lakens, D., & Leys, C. (2017). Why psychologists should by default use Welch's t-test instead of Student's t-test. International Review of Social Psychology, 30(1), 92–101.