🔗 Share this article

Authorities in China have proposed comprehensive draft regulations for artificial intelligence aimed to establish enhanced safeguards for minors and halt chatbots from offering guidance that could encourage self-harm.

According to the draft regulations, companies will also be obligated to make certain their algorithms prevent the production of output that encourages betting.

A Initiative to Rapid Adoption

This governance announcement arrives amidst a sharp surge in the proliferation of chatbots being introduced within China and globally.

Once approved, these rules will apply to AI products and services operating in the country, constituting a substantial effort to oversee the rapidly expanding sector, which has faced intense examination over ethical risks recently.

Central Requirements of the Draft Rules

The circulated guidelines contain a number of provisions specifically aimed at shielding minors. These measures involve obligating AI firms to:

• Offer individual controls.
• Enforce duration restrictions on usage.
• Get permission from legal custodians prior to providing emotional companionship functions.

The rules also state that AI service providers are required to have a live agent take over any dialogue related to suicide and without delay notify the individual's parent.

AI providers are also obligated to make sure their platforms do not generate content that endangers public security, undermines the country's reputation, or disrupts unity.

Weighing Development and Safety

The authorities noted that it encourages the use of AI, including to promote cultural heritage and build tools for support for the older adults, on the condition that the tools are secure and trustworthy.

Stakeholder comments on the proposals has been solicited.

International Context and Scrutiny

The impact of AI on human behaviour has faced greater review around the world in the past year.

The head of a major AI company stated this year that handling how chatbots deal with conversations related to mental health crises is among the sector's toughest challenges.

In a landmark lawsuit, a the parents in North America filed a lawsuit an AI firm, claiming that its system encouraged their teenage son to die by suicide. This lawsuit marked the first of its kind involving wrongful death.

Recently, the same company sought to hire a senior role focusing on defending against potential harms from AI models to human mental health.

"This will be a challenging role, and the candidate will begin in the complex challenges pretty much immediately," stated the executive.

The swift ascent of some AI platforms, which have gained tens of millions of followers globally, demonstrates the urgent need for such governance guidelines.