The 1000 most-visited sites on the web (by Google)

latch 15 years ago |

I extracted the data, added IP, country and response headers, and dumped it into a usable format:

You can do some decently interesting analysis..like the fact that nginx is the front-end for nearly as many sites as IIS.

lazyant 15 years ago | |

Thanks for the data.

"nginx is the front-end for nearly as many sites as IIS", oh I wished that was true but according to my naive counting IIS is over 3 times more popular, am I missing something?:

$ wget http://openmymind.net/top1000data.txt

$ grep -c '"Server": "nginx"' top1000data.txt

39

$ grep -c '"Server": "Microsoft-IIS' top1000data.txt

149

ireadzalot 15 years ago | |

Could you share how you extracted the data? I thought it was nifty that way you have it in that txt file. Thanks.

sonnyz 15 years ago | |

Why is dropbox 'myth and folklore'???

latch 15 years ago | | |

The categories of the json dump come directly from the original google source..so i don't know (and dropbox certainly isn't the only mis-categorized entry):

http://www.google.com/adplanner/static/top1000/

rmorrison 15 years ago | | |

Oh god, and I've been trusting them w/ my backups!!!!!

sosuke 15 years ago | |

Over what time period is pageviews calculated on?

latch 15 years ago | | |

The page views is pulled from the original google list. They have more information at: http://www.google.com/support/adplanner/bin/answer.py?hl=en&...

They don't say what time frame page view is, but they do say unique visits is over the course of 1 month - so its probably safe to assume page view is also over 1 month.

jpdbaugh 15 years ago |

They must have filtered porn. There is no way redtube.com is not in the top 100.

sucuri2 15 years ago | |

They did: " Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites. "

jcl 15 years ago | | |

A curious list of restrictions... I wonder what kind of site would be in the top 1000 that didn't have publicly visible content or load properly? Pure Flash sites, maybe?

papachito 15 years ago | | |

Alexa has a top 500 list with google and porn sites included http://www.alexa.com/topsites

jpdbaugh 15 years ago | | |

Sorry! I must have missed that.

remi 15 years ago |

Source: http://www.google.com/adplanner/static/top1000/

petercooper 15 years ago | |

Not sure why that's not the main link here instead of a useless blog article that removes half the data and adds no insight or extra information whatsoever.. :-)

portman 15 years ago |

Amazing that Facebook has ONE THOUSAND pageviews per unique visitor compared to about 100 pageviews per unique visitor on the rest of the sites.

rayvega 15 years ago |

# 824 stackoverflow vs # 994 expertsexchange

Perhaps another confirmation of what the SO folks have been saying about their popularity.

petercooper 15 years ago | |

Note that StackOverflow is listed as being in the "Music" category :-) Wha..?

cadr 15 years ago | | |

I always go to StackOverflow to find out what the kids are listening to these days.

sucuri2 15 years ago |

#20 - ask.com #252 - digg.com #261 - justin.tv

Reddit not in the list... What I don't understand is how come sites like openoffice.org, kaspersky.com, mcafee.com are so high in the list. Do people really visit them that often?

CapitalistCartr 15 years ago | |

It's more likely that their computer does. For stuff like Auto-updates.

lftl 15 years ago | | |

Ahh that probably explains counduit.com at #29 as well.

michaelbuckbee 15 years ago | | |

And likely HP.com as well. Stupid printer drivers.

michaelbuckbee 15 years ago | |

Given how inaccurate the categorizations are I think it's possible that Reddit got put in the "adult" category.

pg 15 years ago |

Anyone care to do a scatterplot of domain name length vs rank?

tewks 15 years ago | |

It looks somewhat periodic:

http://images.rdujour.com/wp-content/uploads/2010/05/domainL...

I did not include the length of the tld.

tewks 15 years ago | |

Monthly uniques versus domain name length:

http://images.rdujour.com/wp-content/uploads/2010/05/uniques...

icey 15 years ago |

Depressingly, Mahalo is on the list (#946).

trun 15 years ago |

Dropbox on the list at 985. Impressive.

darien 15 years ago | |

But reddit.com is nowhere to be seen... surprising.

drats 15 years ago | | |

My question is, if reddit were on that list, would the moderation system be able to prevent it turning into Digg? I don't think it could, although maybe the subreddit system could. Places like /r/politics/ are fairly useless for intelligent debate already. Such link sharing sites don't have the same "my friends are there" grounding force that Facebook has, it's just the "vibe" and community so running away to a new site is easily mounted.

petercooper 15 years ago | |

And listed as a "Myth and Folklore" site. I wonder who came up with these "categories" - there are some crazy assignments in the list.

sucuri2 15 years ago |

Did you guys notice Wordpress.com and .org in there:

.com: 120,000,000 uniques

.org: 8,100,000 uniques

Impressive.

larryfreeman 15 years ago |

Keep in mind that the numbers listed are estimations.

For example, HubPages, the site where I work, is listed at #270 with 11M unique visitors and 97M page views.

Our monthly absolute unique visitors (according to Google Analytics) is more than three times that. Our monthly page views are greater than 100M.

monos 15 years ago |

"...as measured by Ad Planner."

the list is a decent guesstimate. unless every single site on the planet uses the facebook like button, google analytics, google ads, or something else that tracks globally, there is now way to correctly measure UC or PI.

jhaglund 15 years ago |

it reassures me that foxnews.com is farther down than I would have expected.

43. http://bbc.co.uk 83. http://nytimes.com 179. http://reuters.com 257. http://foxsports.com 279. http://foxnews.com

dolinsky 15 years ago |

Mashable - #696 Techcrunch - #850. Nice to see I'm not the only one that prefers Cashmore to Arrington.

ElbertF 15 years ago | |

Why? All Mashable does is post about Twitter trends and recycle Techcrunch posts a week later.

arst 15 years ago |

I really doubt that usgs.gov (#978) gets anywhere near the number of visits that nfl.com gets (#993).

ojbyrne 15 years ago | |

Everytime there's an earthquake in California, half the state goes there.

wheaties 15 years ago |

Wow, yahoo is up there. It's a shame they can't monetize their websites more.

ThomPete 15 years ago | |

I think their problem is that they are to big an operation. They probably could be if they trimmed the company.

zandorg 15 years ago |

Geocities still running in Japan after being shut down in the west? Wierd!

alexyim 15 years ago |

It's interesting how hard it is to come up with http://windows.com even though I tried explicitly searching for it

volida 15 years ago |

where s youtube?

jcl 15 years ago | |

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites."

hokkos 15 years ago |

where is google in that list ?

bond 15 years ago | |

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites." reply

retube 15 years ago |

the daily mail at 236 aarrgghhhhh!!!!!!!

rokhayakebe 15 years ago |

Scribd 102. Excellent. I would like to know how much financing each one of those site took to date.

ori_b 15 years ago |

google isn't on that list?