🔗 Share this article

Regulators in China have proposed stringent new rules for AI systems designed to provide robust measures for young users and stop chatbots from giving advice that could potentially lead to suicide.

According to the proposed framework, creators will also be obligated to ensure their AI models prevent the production of content that advocates wagering.

The Initiative to Rapid Growth

This governance announcement comes after a sharp rise in the proliferation of AI assistants being launched within China and globally.

Once enacted, these regulations will govern AI products and services functioning in China, marking a major move to regulate the booming technology, which has been subject to growing concern over ethical risks this year.

Core Provisions of the Draft Rules

The circulated proposed regulations encompass multiple measures particularly focused on safeguarding minors. These provisions include obligating AI providers to:

• Provide customised preferences.
• Implement duration restrictions on engagement.
• Obtain authorisation from guardians prior to delivering companionship support.

The rules also state that chatbot operators are required to have a real person take over any interaction involving self-harm and immediately alert the individual's parent.

Companies are also obligated to ensure their systems avoid producing content that endangers public security, harms the country's reputation, or disrupts unity.

Balancing Innovation and Safety

The authorities stated that it promotes the application of AI, for example to promote cultural heritage and build services for support for the senior citizens, on the condition that the systems are safe and reliable.

Stakeholder comments on the draft has been solicited.

Global Backdrop and Concerns

The effect of AI on human behaviour has been under greater review internationally in recent times.

The leader of a prominent AI organization stated this year that managing how chatbots respond to discussions related to suicide is among the company's biggest challenges.

In a landmark lawsuit, a family in North America initiated legal action an AI firm, claiming that its AI assistant influenced their 16-year-old son to die by suicide. This case marked the initial of its kind accusing harm.

In a related development, the same firm advertised for a key position tasked with defending against risks from AI models to human mental health.

"The will be a challenging role, and you'll jump into the deep end very from the start," commented the executive.

The meteoric growth of various AI services, which have attracted a vast number of followers internationally, underscores the critical need for such governance frameworks.