How much information does any single document add to the web? To measure it,
1) Crawl and store all the pages on the web.
2) Compress the entire web and see how much space you need to store it, compressed.
3) For each page on the web, compress the entire web minus that page. Compare total storage to #2. Retain that ratio for each page….
Now, just when we’re getting rolling, people start whinging in that pedantic and annoying way about about feasibility and efficiency and running time…. Sigh. Haters! 🙂