FOIA Uncovers Part of U.K. Shadow Regulation on Search Engines and Copyright

Last month we wrote about the adoption of a new secret agreement between copyright holders and the major search engines, brokered by the U.K. Intellectual Property Office, aimed at making websites associated with copyright infringement less visible in search results. Since the agreement wasn't publicly available, we simultaneously issued a request under the U.K.'s Freedom of Information Act (FOIA), asking for a copy of the text. Today we received it.1

The agreement requires search engines to:

expand efforts to more effectively use [copyright infringement] notices to demote domains demonstrated to be dedicated to infringement, and work collaboratively with rights holders to consider other technically reasonable, scalable avenues empirically demonstrated to help materially reduce the appearance of illegitimate sites in the top search rankings.

Even before this agreement, Google had already begun to factor the Digital Millennium Copyright Act notices issued against websites into its search ranking algorithm, and Google has confirmed to us that the agreement won't cause it to do anything differently than it was already doing. However the difference is that its independent efforts to demote links associated with copyright infringement are now taking place under an explicit threat of government regulation if it doesn't make good enough progress by 1 June.

It's important to know, then, what amounts to "good enough". And, wouldn't you know it, we can't answer that question because the metrics for measuring progress under the agreement were redacted. The response to our FOIA request explains:

Disclosure of this agreement in full would compromise its effectiveness in combatting copyright piracy, resulting in the perpetuation of commercial detriment of legitimate copyright holders. In effect, disclosure of the exempt information could assist persons intent on circumventing an agreed anti-piracy measure.

The redacted information is also exempt under section 31(1)(a), which relates to the prevention or detection of crime. Disclosure of the redacted information could compromise the effectiveness of the Code as a measure to prevent or reduce the likelihood of copyright theft.

What we can be sure of, though, is that the more search engines tighten the criteria that demote websites from the top rankings, the more legitimate websites will trigger a false positive against these criteria, and be unfairly demoted. The U.K. agreement actually recognizes this, stating:

A whitelist process would need to be created to exclude legitimate sites that could be caught within this lower threshold. For an agreed sample of searches using neutral queries in conjunction with artist or content name, the aggregate results should be as follows...

The remainder of that paragraph, though, was also redacted—and a footnote (we would guess added by the copyright lobbyists) notes "Any such process will need to include a mechanism for challenging entries which are not clearly legitimate websites".

For a company that previously sustained a record $500m settlement for failing to kow-tow to the demands of rights holders, there are obvious reasons why Google has played along with this process so far. However it must be very careful that its acquiescence to this shadowy regulation doesn't escalate into a series of capitulations to copyright holder demands. You can read the full text of the agreement that we obtained below.

Related Updates

Rejecting years of settled precedent, a federal court in New York has ruled [PDF] that you could infringe copyright simply by embedding a tweet in a web page. Even worse, the logic of the ruling applies to all in-line linking, not just embedding tweets. If adopted by other...

In a case illustrating copyright abuse of standard software protocols, Cisco Systems filed a lawsuit to prevent its competitor, Arista Networks, from building competing Ethernet switches that rely in part on commands Cisco argues it initially developed. A jury rightly found that Arista was not liable for copyright infringement based...

If you watched this year’s Super Bowl, you might have seen an advertisement for Dodge Ram featuring a Dr. Martin Luther King, Jr. voiceover. To criticize the ad, and to show how antithetical it was to King’s views, Current Affairs magazine created a new version. The ...

Threat of Imprisonment for Colombian Scientist Demonstrates the Far-Reaching Implications of Copyright Policy In 2011, Colombian graduate student Diego Gómez did something that hundreds of people do every day: he shared another student’s Master’s thesis with colleagues over the Internet. He didn’t know that that simple, common act could ...

Washington, D.C.—The Electronic Frontier Foundation (EFF) asked the Librarian of Congress today to limit the legal barriers people face when they want to repair and modify software-enabled products, so that they—not manufacturers— control the appliances, computers, toys, vehicles, and other products they own. In comments filed in Washington D.C. today...

The Digital Millennium Copyright Act (DMCA) safe harbors are a vital protection for websites and Internet services of all sizes. But thanks to a new Copyright Office rule, website owners could lose safe harbor protections if they don’t register online by December 31. And that’s not all: Hollywood lobbyists are...

A photographer and a photo agency are teaming up to restart a legal war against online linking in the United States. When Internet users browse websites containing images, those images often are retrieved from third-parties, rather than the author of the website. Sometimes, unbeknownst to the website author, the linked...

It’s almost too strange to believe, but a federal court ruled earlier this year that copyright can be used to control access to parts of our state and federal laws—forcing people to pay a fee or sign a contract to read and share them. On behalf of Public.Resource.Org...