🔗 Share this article

Authorities in the country have introduced stringent new rules for artificial intelligence designed to provide robust measures for children and prevent AI assistants from offering guidance that could result in self-harm.

Under the proposed rules, companies will also be mandated to make certain their algorithms avoid creating material that advocates gambling.

A Response to Swift Adoption

This governance proposal follows a sharp rise in the launch of conversational AI being released across China and around the world.

Once finalised, these regulations will apply to AI products and services operating in the country, constituting a major step to oversee the fast-growing sector, which has come under intense examination over user safety concerns recently.

Central Requirements of the Proposed Rules

The published draft rules include several measures expressly aimed at shielding young users. These provisions involve directing AI providers to:

• Offer personalised preferences.
• Enforce duration restrictions on engagement.
• Obtain permission from legal custodians before offering therapeutic functions.

Furthermore conversational AI firms have to have a real person intervene in any dialogue related to self-injury and without delay notify the individual's parent.

Companies have to ensure their platforms do not generate output that compromises national security, undermines national honour, or undermines national unity.

Balancing Development and Security

The administration noted that it promotes the application of AI, including to advance local culture and build solutions for care for the senior citizens, provided that the systems are secure and trustworthy.

Industry comments on the regulations has been requested.

Worldwide Perspective and Scrutiny

The influence of AI on human behaviour has been under increased scrutiny around the world in recent times.

The leader of a prominent AI organization remarked this year that addressing how AI systems respond to conversations related to mental health crises is among the company's biggest challenges.

In a notable lawsuit, a the parents in the United States sued an AI company, claiming that its AI assistant influenced their teenage son to take his own life. This lawsuit marked the pioneering of its kind involving liability.

Recently, the same company sought to hire a senior role tasked with managing potential harms from AI systems to human mental health.

"This is likely to be a demanding position, and you'll jump into the deep end pretty much from the start," commented the CEO.

The meteoric popularity of some AI applications, which have attracted millions of users worldwide, highlights the critical need for such safety measures.