China is launching a comprehensive “credit score” system, and the more I learn about it, the more nightmarish it seems. China appears to be leveraging all the tools of the information age—electronic purchasing data, social networks, algorithmic sorting—to construct the ultimate tool of social control. It is, as one commentator put it, “authoritarianism, gamified.” Read this piece for the full flavor—it will make your head spin. If that and the littleotherreporting I’ve seen is accurate, the basics are this:

Everybody is measured by a score between 350 and 950, which is linked to their national identity card. While currently supposedly voluntary, the government has announced that it will be mandatory by 2020.

The system is run by two companies, Alibaba and Tencent, which run all the social networks in China and therefore have access to a vast amount of data about people’s social ties and activities and what they say.

In addition to measuring your ability to pay, as in the United States, the scores serve as a measure of political compliance. Among the things that will hurt a citizen’s score are posting political opinions without prior permission, or posting information that the regime does not like, such as about the Tienanmen Square massacre that the government carried out to hold on to power, or the Shanghai stock market collapse.

It will hurt your score not only if you do these things, but if any of your friends do them. Imagine the social pressure against disobedience or dissent that this will create.

Anybody can check anyone else’s score online. Among other things, this lets people find out which of their friends may be hurting their scores.

Also used to calculate scores is information about hobbies, lifestyle, and shopping. Buying certain goods will improve your score, while others (such as video games) will lower it.

Those with higher scores are rewarded with concrete benefits. Those who reach 700, for example, get easy access to a Singapore travel permit, while those who hit 750 get an even more valued visa.

Sadly, many Chinese appear to be embracing the score as a measure of social worth, with almost 100,000 people bragging about their scores on the Chinese equivalent of Twitter.

A few years ago I wrote a piece about how the fall of the Soviet Union, for all its benefits, has made it harder to defend privacy in the United States. During the Cold War, I argued, we defined ourselves in opposition to an enemy that exemplified and embodied in very real form the nightmarish potential of widespread surveillance and control. This made it easy to point to surveillance and shout, “un-American!”

We have thankfully seen the end of the old totalitarian regimes, but often they have been replaced by authoritarian regimes, which operate with free markets and greater personal freedom, but continue to apply just enough power to stave off threats to their rule. Arrests, beatings, imprisonment, and shootings are such crude tools for the silencing of political opposition and dissent—so much subtler and more effective to pressure people, to turn the exercise of power from a hammer, striking the body politic from without, into a drug, which permeates social life from within and shapes it in the desired directions. In today’s world, all the tools are in place to allow a government to do just that in stunningly subtle yet powerful ways, and the Chinese government appears to be wasting no time in exploiting that potential to the fullest.

The United States is a much different place than China, and the chances that our government will explicitly launch this kind of a program any time in the near future is nil, but there are consistent gravitational pulls toward this kind of behavior on the part of many public and private U.S. bureaucracies, and a very real danger that many of the dynamics we see in the Chinese system will emerge here over time. On the government side, for example I have written about how the TSA’s airline passenger “whitelist” system could evolve in this direction. In the private sector, Frank Pasquale notes that elements of its judgment-and-reward system already exist in the U.S. private-sector credit scoring infrastructure.

I hope this new Chinese system becomes household knowledge in the United States, and can provide the kind of widely recognized paradigm for what to avoid and how not to be that the old totalitarian regimes used to give us. At the ACLU we are constantly warning of the dangers of abuses of power, and often the dangers we cite, while well-founded, consist of potential futures, leading critics to say we’re being “merely theoretical.” With this Chinese system, a whole range of things we’ve warned about are no longer theoretical.

Update (10/8/15): I’m starting to hear questions raised (here and here) about the accuracy of the source on which I based this blog post. I did include a passing caution about my lack of direct knowledge of the source’s accuracy, but I wish I had been more explicit in offering that caution given the language and cultural barriers between the United States and China, and the scarcity of reporting on this system by professional journalists with direct knowledge of Chinese society. I hope to see such reporting soon. That said, the Chinese scoring systems still sound plenty bad, and we all still need to consider the danger that our own institutions will drift toward such systems and their potential abuses.

Atomicrob

Anonymous

You're an idiot. "Duhhhhhh, alcohol sounds a lot like water because they're both clear and wet." It is this type of reductionist mentality that allows bureaucracies to cram their exploitative policies down the throats of unquestioning simpletons like yourself. Unfortunately, I think Americans are doomed to follow the same trajectory as the Chinese because most of you are too complacent or lazy to do anything about it beyond complaining on Internet message boards.

October 8, 2015

3:28 AM

Gullible White ...

That's right. At least China is ruled by Chinese, whereas US is ruled by hostile Jewish elite. this is not left vs right, legal vs illegal, GOP vs Dems, Socialism vs liberty. This is war on White people.

Why do hostile elite defend Israel as a Jewish ethnostate with Jewish only immigration, but ravage White majority Europe/North America into a multi-ethnic, multi-cultural Gulag with non-White colonization?

The world is 91% non-White, only 9% White. But non-White colonizers are aggressively annihilating gullible Whites, just as China annihilates Tibet.

Anonymous

Experian (or whatever) isn't mandatory though

October 23, 2015

3:26 PM

Anonymous

I'm actually quite impressed that ACLU left up the "gullible white" rant posted above. Even though I completely disagree with it, thumbs up for defending freedom of speech on your site, and I mean this without any sarcasm. "I disapprove of what you say, but I will defend to the death your right to say it." - Beatrice Evelyn Hall

November 7, 2015

9:15 AM

Anonymous

That would never happen here. While I never say never, the chances are zero unless you become a person of interest to the government other than that our Judges and the law of the land does not allow it

Anonymous

its already happening... google, apple, facebook and other corporations are already tracking you... your likes... your purchases... hobbies... etc... that data is tracked, aggregated and sold to whoever wants it and has some money.

Privacy is an illusion.

October 7, 2015

1:22 AM

Anonymous

What's the difference between the government using social media to deny you a visa for saying something "un-chinese" and your boss using social media to deny you a job for saying something "un-american"? Very little at the heart of it and this is undeniably happening.

The fact is that social behavior scores are irresistible to American insurance companies and HR departments (check out the staggering number of US Patents for this). The US merely outsources enforcement of "correct" behavior.

Now that everyday item like fridges have WiFi, your behavior will not only be collected by your phone and the websites you visit, but eventually by every object you interact with.

Behavior scores plus the " Internet of Things" means you had better spend your entire day exhibiting behaviors that are profitable for those with leverage on you, or else you will find financial survival (that is to say, survival) very difficult indeed.

October 7, 2015

5:44 AM

Anonymous

oh, really??? How about Snowdon and his discoveries? At least China if the story is really true, does it open compared to the USA government.

October 7, 2015

10:17 AM

Anonymous

It's a fallacy to say that you won't be affected by bulk surveillance unless you're targeted. That's why it's called bulk/mass surveillance and not targeted surveillance.