🔗 Share this article

Officials in the country have unveiled comprehensive new rules for AI systems aimed to establish enhanced safeguards for children and stop conversational agents from providing guidance that could encourage suicide.

According to the planned rules, creators will furthermore be required to ensure their algorithms avoid creating material that encourages betting.

The Move to Swift Expansion

This regulatory proposal arrives amidst a significant surge in the number of chatbots being launched within China and globally.

Once enacted, these measures will cover AI products and services operating in the country, representing a significant effort to govern the booming technology, which has come under intense scrutiny over safety concerns in recent months.

Core Measures of the Draft Regulations

The published proposed regulations contain multiple requirements expressly aimed at safeguarding children. These provisions involve obligating AI firms to:

• Supply individual settings.
• Set usage caps on engagement.
• Secure consent from parents before delivering emotional companionship functions.

The rules also state that conversational AI firms are required to have a human take over any conversation concerning suicide and without delay notify the individual's parent.

Companies must guarantee their systems prevent the creation of information that threatens public security, harms state interests, or weakens unity.

Weighing Development and Safety

The authorities stated that it supports the application of AI, for example to advance local culture and build tools for care for the older adults, provided that the systems are secure and trustworthy.

Public feedback on the draft has been solicited.

Global Perspective and Concerns

The effect of AI on human behaviour has been under heightened examination internationally in the past year.

The leader of a leading AI organization commented this year that managing how AI systems deal with discussions about suicide is among the organization's most difficult problems.

In a high-profile case, a the parents in North America initiated legal action an AI firm, claiming that its AI assistant advised their teenage son to die by suicide. This case was the initial of its kind accusing liability.

This month, the same organization advertised for a senior role tasked with managing risks from AI models to cybersecurity.

"This will be a challenging job, and the candidate will begin in the deep end very from the start," stated the CEO.

The rapid popularity of various AI applications, which have amassed a vast number of followers globally, demonstrates the pressing need for such regulatory measures.