🔗 Share this article

Regulators in the country have proposed strict new regulations for AI systems designed to establish enhanced safeguards for young users and stop chatbots from offering guidance that could potentially lead to suicide.

As per the planned framework, developers will furthermore be mandated to guarantee their algorithms avoid creating output that encourages betting.

A Move to Rapid Growth

This regulatory announcement follows a significant increase in the number of AI assistants being introduced both in China and around the world.

Once enacted, these regulations will apply to AI products and services functioning in the country, marking a major effort to oversee the rapidly expanding sector, which has faced increased scrutiny over safety risks in recent months.

Central Requirements of the New Rules

The published proposed regulations encompass a number of measures specifically designed for protecting children. These steps involve mandating AI providers to:

• Provide individual preferences.
• Enforce duration restrictions on use.
• Obtain authorisation from guardians before providing therapeutic support.

The rules also state that conversational AI firms are required to have a human take over any dialogue concerning self-harm and without delay notify the user's guardian.

Companies must guarantee their systems prevent the creation of content that endangers state security, damages the country's reputation, or disrupts social stability.

Balancing Development and Safety

The administration noted that it promotes the application of AI, including to promote cultural heritage and build solutions for support for the senior citizens, on the condition that the tools are safe and reliable.

Industry input on the regulations has been requested.

Global Perspective and Concerns

The effect of AI on human behaviour has faced increased examination around the world in recent months.

The chief executive of a leading AI organization remarked this year that handling how chatbots engage in conversations related to suicide is among the sector's most difficult problems.

In a notable case, a family in California filed a lawsuit an AI developer, contending that its AI assistant encouraged their 16-year-old son to die by suicide. This case was the initial of its kind accusing wrongful death.

This month, the same company sought to hire a key role focusing on defending against risks from AI models to psychological well-being.

"The is expected to be a challenging position, and the candidate will begin in the thick of it pretty much immediately," remarked the leader.

The meteoric ascent of certain AI platforms, which have amassed millions of followers worldwide, demonstrates the urgent need for such safety frameworks.