statistics

The month the form stopped counting: finding and reconstructing tracking gaps

The September report is almost ready, and there is one number that does not fit: in August the contact form…

1 week ago

How many pages should we protect in a site migration? The Lorenz curve and traffic thresholds

The redesign is approved, the launch date is set, and sooner or later the question nobody wants to face comes…

1 week ago

When the yardstick changes: structural breaks in SEO metrics

The annual report lands on the desk with good news on the front page: the site's average position went from…

1 week ago

Are Google’s AI answers taking our clicks? Measuring it with expected CTR and a control group

A site's technical guides climb in the search results, show up more often, and yet get fewer clicks. The CTR…

2 weeks ago

When clicks vary more than expected: overdispersion

Clicks and sessions vary more than Poisson allows: how to detect it in R and fix confidence intervals with quasi-Poisson…

2 weeks ago

Two years of data and a seasonality to remove: doing year-over-year right

An annual report often ends with a single line: clicks from Google fell 11.8% compared with the previous year. The…

2 weeks ago

Did requests really drop? Comparing two periods when counting events

A site receives 612 requests this year and received 640 the year before. The arithmetic is quick: −4.4%. The search…

2 weeks ago

Survivorship Bias: Why Success Case Studies Fool Us

We have all read it, perhaps on LinkedIn, complete with an upward-sloping chart: "We rewrote the titles of 300 pages…

1 month ago

The p-value and Its Misconceptions: What p < 0.05 Really Means

"The new title has a p-value of 0.03: there is a 97% probability that it works." It is a sentence…

1 month ago

Multiple Comparisons: Why Out of 200 Queries Some Always «Improve» by Chance

In 2009 a group of neuroscientists put a salmon in a functional MRI scanner, showed it a series of photographs…

2 months ago