Misuse of artificial intelligence in China

It is unhelpful to reduce China's rapid AI development into a simplistic narrative about China as a threat or as a villain.
Misuse of Artificial Intelligence in China
Image © Misuse of Artificial Intelligence in China

By 2030, China plans to become the world’s leading country in artificial intelligence (AI). Beijing’s AI development and implementation approach are fast-paced and pragmatic, with a focus on finding applications to help solve real-world problems. Several advances are being made in healthcare, such as “AI doctor” chatbots, machine learning for pharmaceutical research, and deep learning for medical image processing. Aside from this rapid development in artificial intelligence, China’s AI policies are deeply troubling and deserve condemnation. Nevertheless, portraying China as a “villain” in this way may be overly simplistic and potentially costly. 

The unexpected

The way China uses artificial intelligence poses serious concerns. However, AI advances that benefit citizens and society shouldn’t overshadow the fact that China’s authoritarian government abuses citizens’ data and violates their privacy. Due to a massive police surveillance apparatus powered by big data and artificial intelligence, China is living up to the fictional scenario every day. The government, for instance, now requires national IDs to buy train tickets, making it easier to block human rights activists or anti-corruption journalists from travelling. 

THE BELAMY

Sign up for your weekly dose of what's up in emerging technology.

According to reports and leaked documents, the government in Xinjiang, home of China’s Uighur Moslem minority, uses AI-sifted big data to screen people entering mosques and even shopping malls. The government can collect data on everything from bank accounts to family planning through thousands of checkpoints that require national IDs. The New York Times confirmed Soros’ fears when it reported that the Chinese authorities are using facial recognition technology to track and target members of the Uighurs, a persecuted Muslim minority in China. The recently released report by Human Rights Watch, titled “China’s Algorithms of Oppression,” provides additional evidence of Beijing’s use of new technologies to restrict the rights and liberties of Uighurs.

Privacy rights

In democratic and open societies, AI can directly interfere with human rights beyond its use by repressive regimes. As AI systems collect personal data for micro ad targeting, the right to privacy is violated. Monitoring online content enabled by AI impedes freedom of speech. Access to and the sharing of information by users are controlled in opaque and incomprehensible ways, restricting users’ freedom of expression and opinion.

Disinformation campaigns powered by AI – such as troll bots and deepfakes (altered video clips) – threaten societies’ access to accurate information, disrupt elections, and erode social cohesion. 

Concerns also exist over the emergence of opaque social governance systems that lack accountability mechanisms.

An AI-generated assessment is used to determine sentencing in the smart court system in Shanghai, for instance. Unfortunately, defendants find it difficult to assess the tool’s potential biases, the quality of the data and the soundness of the algorithm, making it difficult to contest the results.

China’s experience demonstrates the need for transparency and accountability when it comes to AI in public services. Inclusion and the protection of citizens’ digital rights must be the goals when designing and implementing systems. It is unhelpful to reduce China’s rapid AI development into a simplistic narrative about China as a threat or as a villain. Observers outside China need to engage in the debate and take more steps to understand – and learn from – the nuances of what’s really going on. According to MIT researcher Jonathan Frankle, “this is an urgent crisis we are slowly sleepwalking our way into.”

More Great AIM Stories

Sohini Das
Sohini graduated from the University of Kalyani with a master's degree in nanosciences and nanotechnology. She hopes to become a tech journalist one day. Her work focuses on digital transformation, geopolitics, and emerging technologies.

Our Upcoming Events

Masterclass, Virtual
How to achieve real-time AI inference on your CPU
7th Jul

Masterclass, Virtual
How to power applications for the data-driven economy
20th Jul

Conference, in-person (Bangalore)
Cypher 2022
21-23rd Sep

Conference, Virtual
Deep Learning DevCon 2022
29th Oct

3 Ways to Join our Community

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Telegram Channel

Discover special offers, top stories, upcoming events, and more.

Subscribe to our newsletter

Get the latest updates from AIM
MOST POPULAR

What can SEBI learn from casinos?

It is said that casino AI technology comes with superior risk management systems compared to traditional data analytics that regulators are currently using.

Will Tesla Make (it) in India?

Tesla has struggled with optimising their production because Musk has been intent on manufacturing all the car’s parts independent of other suppliers since 2017.