Big data has the potential to change the world. The talent exists and the tools are already there. What’s lacking is access to data. Imagine the questions we could answer and the problems we could solve if talented, creative technologists could freely access more big data.

At Common Crawl, we are passionate about getting big open data into the hands of talented and creative people. Increasing access to data enables everything from business innovation to groundbreaking research.

Common Crawl is proud of what we have accomplished in 2014 thanks to our dedicated team and the support of donors like you.

This year:

  • 19 academic publications using Common Crawl data were published
  • Several Open Educational Resources designed to teach big data tools and methods were created
  • 1.3 petabytes containing 18.5 billion web pages were added to the Common Crawl corpus
  • Numerous presentations and tutorials were given at international conferences, local meetup groups, and academic workshops in six countries

100% of our funding comes from donors like you — Thank you! We accomplish a great deal with a small, dedicated staff on a limited budget so your investment in us has a big impact.

More resources for Common Crawl means more access to data for everyone. In 2015 we have big plans to scale up crawling to more rapidly increase the Common Crawl corpus and to grow our educational programs and catalogue of tutorials in order to invest in the next generation of data-driven technologists.

Whether it’s $10 or $10,000, Common Crawl needs your donation today.

Donate here!

Thank you very much,
Lisa Green and the Common Crawl team