StatsToTable

Parametric or nonparametric?

"My data are not normally distributed, so I need a nonparametric test" is the most common wrong inference in applied statistics. The t test does not assume your data are normal. It assumes the mean would be normal if you repeated the study — and that holds far more often than a histogram suggests.

The short answer

Judge the departure and the sample size together. Strong skew with n = 10: use a rank test. Mild skew with n = 80: the t test is fine. When the two agree, report that they agree. When they disagree, you have learned something about your data and it belongs in the write-up.

What "parametric" is actually claiming

A t test estimates a mean and relies on a known sampling distribution to convert the estimate into a p value. That distribution is approximately normal by the central limit theorem, regardless of the shape of the raw data. The assumption is about the sampling distribution, not the histogram.

A rank test makes a weaker claim: it asks whether one group tends to produce larger values than the other, using only the ordering. Fewer assumptions, but also less information used — the magnitude of each value is discarded.

Where they disagree, on real numbers

Two groups drawn from a strongly right-skewed distribution, eighty per group — the shape you get with cost data, reaction times, or anything bounded at zero.

TestStatisticp
Welch independent-samples t testt(145.61) = −0.35.723
Mann–Whitney UU = 2513, z = −2.34.019

Same data. One test finds nothing, the other finds a significant shift. Neither is broken.

The t test is asking about the difference in means, and in a heavily skewed distribution the mean is dominated by a few extreme values, so its standard error is large. The rank test is asking whether values from one group tend to sit higher, which the skew does not obscure.

This is the case where the choice is the answer. If your research question is about typical values — "do these patients usually recover faster" — the rank test is closer to what you meant. If it is about the total or the average, the mean is the quantity of interest and the t test is measuring the right thing, even when it fails to reach significance.

The small-sample case

The opposite situation: the same shape, but ten per group. There the t test and the rank test both come out non-significant, with p values far apart and neither meaningful. That is not a contradiction, it is underpower. With ten observations from a skewed distribution there is simply not enough information, and the right response is to collect more data rather than to choose the test whose p value you prefer.

Three things that decide it in practice

Never do this

Do not run both tests and report whichever gives the smaller p value. That is not robustness checking, it is choosing your answer after seeing it, and it inflates the error rate in a way no correction can recover.

The defensible version: decide from the design and the shape before looking at the comparison, state the decision, and — if a reviewer might object — report the alternative in a footnote.

What the rank tests are called

ParametricRank-based counterpartWhat the rank test asks
Independent t testMann–Whitney UDoes one group tend to score higher?
Paired t testWilcoxon signed-rankDo the differences tend to be positive?
One-way ANOVAKruskal–WallisDoes any group tend to score higher?
Repeated-measures ANOVAFriedmanDoes any condition tend to score higher?

Frequently asked

Do I need a nonparametric test if my data are not normal?

Not automatically. The assumption is about the sampling distribution of the mean, which is far more forgiving than the histogram. Strong skew with a small sample is the real warning sign.

Do the two kinds of test answer the same question?

No. One compares means, the other asks about the ordering of values. That is why they can disagree on the same data without either being wrong.

Is nonparametric always safer?

It is more robust but less powerful. On well-behaved data it can miss effects the t test would have found.

What if a reviewer insists on normality?

Report the check, report the effect size and confidence interval, and show that the conclusion does not depend on the choice — either because both tests agree, or because you can say why the mean is the quantity of interest.

Which test should I use? · t test vs ANOVA · Run a t test · Method notes