Before fix: Sep 09-Jul 10 / After fix : Nov 09 – Oct 10
Unfortunately I need to announce yet another major correction on page views stats. This time caused by a bug in wikistats scripts. Reports that show page views per region and per language were meant to be exclusive of automated requests, by crawlers, spiders, bots. Due to a bug these automated requests were not excluded on recent reports. Thanks to Ziko for detecting this. My apologies for any confusion caused.
Reports on page edits were hardly affected: very few crawlers request edit pages.
Most crawlers operate from the United States. Therefore the share of page visits from the US was considerably overreported. Not only that. Also the share of crawler requests versus total requests apparently has risen in the last year, thus skewing the quarterly trend reports as well.
Here are a few examples of the effects of the correction:
North vs South
Ratio of page views for North and South went from 83% – 17% before fix to 80% – 20% now.
Europe vs North America
The imbalance between views and edits from Europe vs North America did shrink. Ratio of page views for Europe and North America went from 36% – 39% before the fix to 40% – 32% now. As said, share of edits hardly changed: Europe 52%, N-AM 24%.
Breakdown per country
Breakdown of page views from the US was much affected, other countries much less or hardly at all. Share of page views from the US to the English Wikipedia went from 78% to 92%.
Before the correction a few countries showed a significant rise in page views to the English Wikipedia from quarter to quarter. This growth disappeared or lessened considerably after the fix, again indicating that the share of crawlers requests vs total requests is growing over time.
Breakdown per language
This report has been most affected: for many Wikipedia’s readership from the US moved severals steps down in rank. Example of a massive shift: before the fix 21% of page views for Hungarian Wikipedia came from US, after the fix a mere 0.6%.
Note: For comparison faulty reports are still online.