{"id":3841,"date":"2026-06-22T09:51:37","date_gmt":"2026-06-22T08:51:37","guid":{"rendered":"https:\/\/www.gironi.it\/blog\/?p=3841"},"modified":"2026-06-22T09:51:37","modified_gmt":"2026-06-22T08:51:37","slug":"regression-to-the-mean","status":"publish","type":"post","link":"https:\/\/www.gironi.it\/blog\/en\/regression-to-the-mean\/","title":{"rendered":"Regression to the Mean: the SEO Fix That Worked\u2026 by Accident"},"content":{"rendered":"\n

In the Israeli Air Force, Daniel Kahneman recounts<\/strong>, the flight instructors were sure of one thing: praising a cadet after an excellent manoeuvre made him worse, scolding him after a terrible one made him better.
They had seen it happen a thousand times in the field, so it had to be true: with pilots, severity works and compliments backfire.
Except it wasn’t true. An exceptional manoeuvre \u2014 in either direction \u2014 is part skill and part luck; and luck, on the next attempt, doesn’t repeat. After a brilliant flight you tend to drift back toward your own average (and it looks as if the praise hurt), after a disastrous one you drift back toward the average (and it looks as if the scolding helped). The instructors were crediting themselves with an effect that was just regression to the mean<\/strong>.<\/p>\n\n\n\n

The very same illusion waits for us every time we look at a site’s data and decide whether one of our changes “worked”.<\/p>\n\n\n\n\n\n\n\n

It’s worth clearing up the name straight away, because it misleads: regression to the mean has nothing to do with linear regression<\/a><\/strong>, the model that fits a line between two variables. Here “regression” means going back<\/em>, reverting<\/em>: extreme values sliding back toward their average. They are two different things that happen to share a word.<\/p>\n\n\n\n

What regression to the mean is<\/h2>\n\n\n\n

The mechanism is simple, and once you see it you can’t unsee it.
Almost every number we measure is the sum of two parts: a “true”, stable value and a dose of noise<\/strong> \u2014 random fluctuation of the moment. A page’s average SERP position in a given month depends on its real relevance, but also on chance: the algorithm wobbling, a competitor who pushed hard that month, the query’s seasonality, a handful of clicks more or fewer.<\/p>\n\n\n\n

Now, when we single out the extreme<\/strong> cases \u2014 the worst-performing pages, the worst month \u2014 we are almost always picking situations where the noise pushed everything in the same unfavourable direction<\/em>.
At the next measurement that noise won’t repeat identically, and the value will tend to climb back toward its true mean \u2014 without anyone having done anything.<\/strong> It’s a purely statistical fact, not an SEO phenomenon: the more extreme a measurement, the more likely the next one is less extreme.<\/p>\n\n\n\n

The optimization that worked by accident<\/h2>\n\n\n\n

Let’s see what this mechanism does in everyday work. Suppose we track the average SERP position of 300 pages over two consecutive months. I simulate the scenario in R, giving each page a stable “true” position and adding a random fluctuation each month:<\/p>\n\n\n\n

set.seed(48)\n\n# 300 pages, each with its \"true\" SERP position (stable over time)\npos_vera <- runif(300, 3, 40)\n\n# two consecutive months: same true position, different random noise\nmese1 <- pos_vera + rnorm(300, 0, 8)\nmese2 <- pos_vera + rnorm(300, 0, 8)\n\n# the 60 worst pages in month 1 (in the SERP \"worse\" = higher number)\npeggiori <- order(mese1, decreasing = TRUE)[1:60]\n\nround(mean(mese1[peggiori]), 1)   # starting average position\n# [1] 39.1<\/code><\/pre>\n\n\n\n
Our 60 worst pages start from an average position of 39.1<\/strong>: bottom-of-the-third-page territory. We decide to act \u2014 rewrite the titles, update the content, fix internal links \u2014 and we check again a month later. 
Here’s the result, with no algorithm change in the meantime and, above all, with no real intervention at all in the simulation<\/strong>:<\/p>\n\n\n\n
round(mean(mese2[peggiori]), 1)   # one month later\n# [1] 33<\/code><\/pre>\n\n\n\n
From 39.1<\/strong> to 33<\/strong>: about six positions gained<\/strong>. A jump that would look great in a report, and that anyone would be tempted to credit to the optimization just carried out. 
Too bad there is no<\/em> optimization in the code: the pages improved on their own, because they had been chosen precisely for being extreme and the noise that had sunk them in month 1 didn’t repeat. For scale: the average position of all<\/em> 300 pages is about 22, and it’s toward that value that the worst ones are reverting.<\/p>\n\n\n\n
How not to be fooled: the control group<\/h2>\n\n\n\n
If the improvement comes anyway, how can we tell whether our optimization had any real<\/em> effect? 
The answer is the same one we’d use for a drug: we need a control group<\/strong>. We split the 60 worst pages into two random halves: one we “optimize”, the other we deliberately leave alone. Then we compare how much they improve:<\/p>\n\n\n\n
# split the 60 worst pages into two random groups\ngruppo <- sample(rep(c(\"optimized\", \"control\"), each = 30))\n\n# average improvement (month1 - month2) in the two groups\nround(tapply(mese1[peggiori] - mese2[peggiori], gruppo, mean), 1)\n# control optimized\n#     6.0       6.1<\/code><\/pre>\n\n\n\n
The “optimized” group gains 6.1<\/strong> positions, the control group \u2014 left untouched \u2014 gains 6.0<\/strong>. 
Practically the very same improvement. Our optimization, in the simulation, added nothing: all of the gain was regression to the mean, and the control exposes it by showing it would have happened anyway.<\/p>\n\n\n\n
The lesson is this: an improvement, on its own, proves nothing.<\/strong> 
When you act precisely on the pages (or campaigns) that were doing worst, part of their rebound is guaranteed regardless of you. Without a comparison against what you did not<\/em> touch, you can’t know how much of the result is your doing and how much is just reversion toward the mean.<\/p>\n\n\n\n
It’s the same reasoning, it should be said, behind a properly run A\/B test<\/a>: you compare the variant against a concurrent control, not against the “before”. And it’s a close cousin of the trap we met discussing correlation and causation<\/a>: here too we mistake a sequence in time (“I acted, then it improved”) for a causal link.<\/p>\n\n\n\n
Try it yourself<\/h2>\n\n\n\n
To lock in the mechanism, try rebuilding the scenario changing a single detail: instead of the 60 worst<\/em> pages, select the 60 best<\/em> of month 1 (order(mese1)[1:60]<\/code>, without decreasing<\/code>) and watch how they behave in month 2.<\/p>\n\n\n\n
What to expect: the champions revert toward the mean too, but by getting worse<\/em> \u2014 top positions contain luck that doesn’t repeat. It’s the mirror image of the same phenomenon, and it explains why “that golden month” or “that page that was flying” so often can’t be reproduced: you hadn’t lost your magic touch, you were just drifting back toward your average.<\/p>\n\n\n\n
\n\n\n\n
There’s an even more insidious variant of this trap, because it hides inside the very tools we use to<\/em> decide with rigour. If we look at a test while it’s still running and stop as soon as the numbers please us, we are picking an extreme instant exactly as we picked the worst pages \u2014 and we’ll be fooled in the same way. It’s the peeking problem<\/em>, and it’s the next stop on our tour of marketing-data pitfalls.<\/p>\n\n\n\n
\n\n\n\n
Further Reading<\/h3>\n\n\n\n
The flight-instructor story we opened with comes from Thinking, Fast and Slow<\/em><\/a> by Daniel Kahneman, Nobel laureate in economics: it’s the book that made regression to the mean \u2014 and dozens of other biases in our reasoning \u2014 widely known, told through examples that stick. If you keep one thing from this article, keep this one: it’s a vaccine against the illusion of having understood why the numbers move.<\/p>\n","protected":false},"excerpt":{"rendered":"
In the Israeli Air Force, Daniel Kahneman recounts, the flight instructors were sure of one thing: praising a cadet after an excellent manoeuvre made him worse, scolding him after a terrible one made him better. They had seen it happen a thousand times in the field, so it had to be true: with pilots, severity … Leggi tutto “Regression to the Mean: the SEO Fix That Worked\u2026 by Accident”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","footnotes":""},"categories":[161],"tags":[],"class_list":["post-3841","post","type-post","status-publish","format-standard","hentry","category-statistics"],"lang":"en","translations":{"en":3841,"it":3840},"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"post-thumbnail":false},"uagb_author_info":{"display_name":"Paolo Gironi","author_link":"https:\/\/www.gironi.it\/blog\/author\/autore-articoli\/"},"uagb_comment_info":0,"uagb_excerpt":"In the Israeli Air Force, Daniel Kahneman recounts, the flight instructors were sure of one thing: praising a cadet after an excellent manoeuvre made him worse, scolding him after a terrible one made him better. They had seen it happen a thousand times in the field, so it had to be true: with pilots, severity…","_links":{"self":[{"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/posts\/3841","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/comments?post=3841"}],"version-history":[{"count":1,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/posts\/3841\/revisions"}],"predecessor-version":[{"id":3845,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/posts\/3841\/revisions\/3845"}],"wp:attachment":[{"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/media?parent=3841"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/categories?post=3841"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.gironi.it\/blog\/wp-json\/wp\/v2\/tags?post=3841"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}