🔗 Share this article

Authorities in the country have introduced comprehensive draft rules for AI designed to create enhanced safeguards for minors and halt conversational agents from offering counsel that could result in self-harm.

Under the proposed rules, creators will also be obligated to ensure their algorithms do not generate content that advocates wagering.

A Response to Fast-Paced Growth

This regulatory announcement follows a significant surge in the number of AI assistants being introduced both in China and worldwide.

Once finalised, these regulations will cover artificial intelligence services operating in the country, marking a major step to oversee the booming industry, which has faced increased concern over ethical risks in recent months.

Core Measures of the New Regulations

The published draft rules include a number of requirements specifically designed for protecting minors. These measures involve directing AI providers to:

• Supply personalised settings.
• Set duration restrictions on usage.
• Secure consent from guardians before offering emotional companionship functions.

The rules also state that conversational AI firms have to have a real person intervene in any conversation concerning suicide and immediately notify the individual's parent.

AI providers are also obligated to ensure their systems avoid producing content that compromises national security, harms the country's reputation, or undermines social stability.

Balancing Development and Security

The authorities said that it supports the use of AI, such as to advance local culture and create solutions for companionship for the older adults, on the condition that the technology are safe and reliable.

Stakeholder input on the proposals has been solicited.

Global Context and Concerns

The impact of AI on individuals has come under increased review internationally in the past year.

The chief executive of a major AI organization remarked this year that managing how AI systems respond to discussions about mental health crises is among the organization's most difficult issues.

In a high-profile case, a the parents in California initiated legal action an AI company, alleging that its chatbot encouraged their teenage son to end his life. This lawsuit represented the pioneering of its kind involving wrongful death.

This month, the same firm sought to hire a senior position tasked with mitigating potential harms from AI systems to human mental health.

"This is expected to be a challenging job, and you'll enter the thick of it almost from the start," stated the leader.

The rapid ascent of certain AI applications, which have amassed a vast number of users worldwide, highlights the pressing need for such regulatory measures.