Back
over 200 million AI-powered surveillance cameras
webRelevant as a corrective to inflated narratives about AI-enabled social control; useful for grounding governance discussions about real versus imagined AI surveillance risks, though peripheral to core technical AI safety topics.
Metadata
Importance: 28/100organizational reportcommentary
Summary
MERICS analyst Vincent Brussee debunks the widespread myth of a unified AI-driven social credit score in China, arguing the actual system is fragmented, low-tech, and business-focused. He cautions that the bogeyman narrative distracts from more legitimate surveillance concerns, both in China and globally.
Key Points
- •No unified citizen 'social credit score' exists in China; the system is fragmented, poorly digitalized, and primarily targets businesses.
- •The myth likely originates from tangentially related private initiatives like Alibaba's Sesame Credit, which was denied an official credit license.
- •China's actual surveillance concerns are elsewhere: over 200 million AI-powered cameras and other invasive practices deserve more scrutiny.
- •Scoring pilots in some Chinese cities became controversial even domestically and were largely discontinued.
- •Misrepresentation of China's SoCS risks misdirecting AI governance policy debates away from real surveillance threats.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| AI Value Lock-in | Risk | 64.0 |
Cached Content Preview
HTTP 200Fetched Apr 7, 20269 KB
China’s social credit score – untangling myth from reality | Merics
Skip to main content
Share this Article
Comment
Feb 11, 2022
5 min read
China’s social credit score – untangling myth from reality
The idea that China gives every citizen a “social credit score” continues to capture the horrified imagination of many. But it is more bogeyman than reality. Instead, we should be worrying about other, more invasive surveillance practices – and not just in China, argues MERICS analyst Vincent Brussee.
“What if every action that you took in your life was recorded in a score like it was a video game?” … “If your score drops to 950, you will be subject to re-education.” … “It is the beginning of slavery, complete control, and the disappearance of all freedoms ... In China, they call it social credit.” These are just some of the statements made in parliamentary debates in Europe and online commentaries about China’s Social Credit System. Given the vehemence of these views, and the attention they attract, it must have come as a real headscratcher to many when China recently pledged that would ban the use of AI for social scoring.
So, what are the facts relating to China’s Social Credit System (SoCS)? First, a system does exist, but it is very different from what is imagined by many critics outside China. The biggest disconnect is around the notion of scores. Some commentators seem to imagine that a magic algorithm draws from AI cameras and internet surveillance all over the country to calculate a score that determines everyone’s place in society. In reality, the SoCS is not the techno-dystopian nightmare we fear: it is lowly digitalized, highly fragmented, and primarily focuses on businesses . Most importantly, such a score simply does not exist.
Yet the myth still persists - even governments that acknowledge the complexities of the SoCS still express concerns about scoring and how it could be developed in the future. So, what is behind the idea of social credit scoring?
Provenance and early attempts
The SoCS, which first emerged in China in the early 2000s, was inspired by credit scoring practices elsewhere in the world, such as FICO in the United States and Schufa in Germany. In the main blueprints for the system there was no reference to large-scale scoring of individuals. It did, however, spawn tangentially-related initiatives like Alibaba’s Sesame Credit, but this was only indirectly rel
... (truncated, 9 KB total)Resource ID:
3e03a6e800128f8c | Stable ID: sid_d9EnmTcnin