“The size of the Web is 800 million pages, and the biggest search engine only covers about 16% of it.”
(Lawrence and Giles, 8 July 1999)
For various reasons (e.g. script/dynamic/unlinked/limited-access/non-html content) the indexed web is only a portion of the world wide web and later studies want further claiming that the deep (un-indexed/unknown) web is ~500 times larger than the indexed web!
So… What is the size of the internet?
Well, how many pages are there?
According to boutell.com guesstimate we have ~ 29.7 billion indexed pages on the World Wide Web (updated to Feb. 2007)
http://worldwidewebsize.com suggest a ~22.34 billion indexed pages (Sep. 2007)
and I used a simple Google search for “or | -or +*” and got about 17,340,000,000 documents estimation from Google…
=> We are left out with nice round guesstimate average of 20 billion indexed pages.
Now, multiplying it with an average page size of 70K (based on my experience, utexas.edu and optimizationweek.com)
= ~1300* Tera = ~1.3 Peta of known/indexed web which might hide a ~600 Peta of deeper web…
3 responses so far ↓
1
Dr. Leslie Brown
// Oct 1, 2007 at 4:59 am
Interesting subject… thanks!
I too have a short post about growth of the internet, and its size!!
http://tenerife-training.net/Tenerife-News-Cycling-Blog/2007/08/thats-business/interesting-internet-statistics/
2
Moti Karmona
// Oct 2, 2007 at 11:20 pm
Thanks :-)
Dr. Brown, it was really great to see that we got more or less the same numbers (~1 Peta) with different calculations.
Moti
3
stan stanley
// Oct 7, 2007 at 7:31 pm
Now all I have to figure is how to generate ,001% of that traffic and it would still be huge
Leave a Comment