The web is the largest and most diverse collection of information in human history. Web crawl data can provide an immensely rich corpus for scientific research, technological advancement, and innovative new businesses.
The web is in essence a digital copy of our world and therefore can be analyzed in ways that the physical world could never be analyzed. Machine-scale analysis of web crawl data can grant us insight into politics, art, economics, health, popular culture and almost every other aspects of life.
It is crucial for our information-based society that the web be openly accessible to anyone who desires to utilize it