Search results

Common Crawl - Privacy Policy

For the purposes of this Privacy Policy: “Organization”. (referred to as either. "the Organization". , “Common Crawl”. , "We". , "Us". or.…

Common Crawl - Blog - White House Briefing on Open Data’s Role in Technology

We recently had the honor of briefing the White House Office of Science and Technology Policy (OSTP) on the role of The Common Crawl Foundation as critical infrastructure in the artificial intelligence ecosystem and how we can support U.S. federal efforts in…

Common Crawl - Blog - The Promise of Open Government Data & Where We Go Next

Allison Domicone was formerly a Program and Policy Consultant to Common Crawl and previously worked for Creative Commons.…

Common Crawl - Blog - Common Crawl at the United Nations Open Source Week, June 2025

The Common Crawl Foundation team took part in the United Nations Open Source Week in New York City this June, meeting with global developers, researchers, and policymakers to discuss all things open source and AI. Common Crawl Foundation.…

Common Crawl - Team - Thom Vaughan

Thom is active in policy and standards development, contributing to initiatives that shape best practices in emerging technologies. A strong advocate for OSS principles, he speaks English and Swedish and lives in South–West London. The Data. Overview.…

Common Crawl - Team - Lisa Green

She has worked in the areas of Open Access publishing, Open Science, Open Data, copyright, digital rights and policy. Lisa was Chief of Staff at Creative Commons and served as the director of Common Crawl from 2011 to 2015.…

Common Crawl - Blog - March 2014 Crawl Data Now Available

We're working hard to get a few machines always crawling domains with large numbers of pages to go even deeper while still maintaining our politeness policy. Thanks again to. Blekko. for their ongoing donation of URLs for our crawl. The Data. Overview.…

Common Crawl - Blog - 5 Good Reads in Big Open Data: Feb 13 2015

If the majority of the world’s online population spends time on Facebook, then policymakers, businesses, startups, developers, nonprofits, publishers, and anyone else interested in communicating with them will also, if they are to be effective, go to Facebook…

Common Crawl - Blog - August/September 2024 Newsletter

Updates on our Policy Efforts. Roadmap and Future Plans. Common Crawl Citations in Academic Research. Common Crawl's impact on research has grown substantially since its beginning.…

Common Crawl - Impact

Researchers and activists use this data to analyse social media, news sites, and other web sources, providing insights that can drive social change and inform policy decisions.…

Common Crawl - Blog - OSCON 2012

Allison Domicone was formerly a Program and Policy Consultant to Common Crawl and previously worked for Creative Commons. We're just one month away from one of the biggest and most exciting events of the year, O'Reilly's Open Source Convention (OSCON).…

Common Crawl - Our Team