statistics

Statistical Parametric and Non-Parametric Tests

Statistical tests can be either parametric or non-parametric.

Parametric Tests: The Power of Normality

  • Parametric tests assume an approximately normal distribution.
  • They involve continuous or interval-type variables and require a sufficiently large sample size (typically > 30).
  • They also assume homogeneity of variances (homoscedasticity).

These tests have a higher statistical power because they provide a greater probability of correctly rejecting a false statistical hypothesis.

Examples of parametric tests we have covered include the Z-test for the standardized normal distribution, Student’s t-test, ANOVA (Analysis of Variance), and the Pearson correlation coefficient r.

Non-Parametric Tests: Versatility and Flexibility

Non-parametric tests, on the other hand, do not assume any specific type of distribution and do not require the estimation of statistical parameters such as mean, variance, or standard deviation.

In simple terms, non-parametric tests can be broadly categorized as follows:

1) Goodness-of-fit tests (comparing observed values with expected values).
2) Tests that serve as non-parametric alternatives to parametric tests.

Examples of non-parametric tests we have discussed, with links for more detailed information, include the Chi-square test, the Wilcoxon test, the Spearman rank correlation coefficient, and the Kendall rank correlation coefficient.

General Considerations

Generally, parametric tests are more powerful than non-parametric tests, but they require data to meet certain conditions. When these conditions are not met, non-parametric tests provide a viable alternative.

Additionally, it is important to note that non-parametric tests can sometimes be used even when data meet the requirements for parametric tests; in such cases, they are often chosen for greater robustness or to avoid making overly restrictive assumptions.


Further Reading

To navigate the choice between parametric and non-parametric tests, with the applicability conditions of each, Statistica by Newbold, Carlson and Thorne (Italian edition) offers a thorough, systematic coverage.

paolo

Recent Posts

The peeking problem: why sneaking a look at an A/B test inflates false positives

On 21 January 2015 Optimizely — one of the most widely used A/B testing platforms…

2 days ago

Regression to the Mean: the SEO Fix That Worked… by Accident

In the Israeli Air Force, Daniel Kahneman recounts, the flight instructors were sure of one…

3 days ago

A/B Testing: How to Run Statistically Valid Experiments (and the Mistakes to Avoid)

Over the previous articles we have looked at how hypothesis testing works and how the…

6 days ago

An Introduction to Principal Component Analysis (PCA)

Principal Component Analysis (PCA) is a widely used statistical technique for reducing the complexity of…

6 days ago

Correlation: Pearson, Spearman and Kendall (and Why It Isn’t Causation)

Anyone who looks at a website's data does it constantly, often without noticing: they spot…

6 days ago

Effect Size and Power Analysis: How Big Is the Effect (and How Much Data You Need)

We closed the article on the A/B test significance calculator with a promise. We said…

1 week ago