Have you ever run an A/B test and wondered whether you should use a t-test or a Wilcoxon test? The choice matters: using the wrong test can cause you to miss a significant result — or, worse, make you think a result is significant when it’s not.
Statistical tests fall into two broad families: parametric and non-parametric. The fundamental difference? Parametric tests assume the data follow a known distribution (usually the normal); non-parametric tests make no such assumption. This is not a technical detail — it determines which tests you can use, how powerful they are, and how much you can trust the results.
In this article we’ll look at the differences, when to use each, and how the choice impacts the analysis of your site’s data.
Continue reading “Statistical Parametric and Non-Parametric Tests”