🔗 Share this article

Authorities in the country have introduced stringent draft rules for artificial intelligence crafted to create enhanced protections for young users and stop AI assistants from offering advice that could potentially lead to self-harm.

According to the proposed rules, creators will additionally be mandated to ensure their algorithms do not generate output that encourages gambling.

A Response to Swift Expansion

This regulatory initiative arrives amidst a sharp increase in the number of chatbots being launched across China and globally.

Once enacted, these regulations will apply to artificial intelligence services operating in China, constituting a major step to oversee the booming industry, which has come under increased concern over safety risks recently.

Key Requirements of the Proposed Regulations

The published guidelines contain a number of provisions specifically designed for safeguarding young users. These provisions include mandating AI providers to:

• Supply individual controls.
• Implement usage caps on engagement.
• Obtain authorisation from legal custodians before providing therapeutic support.

The rules also state that conversational AI firms must have a live agent intervene in any interaction concerning self-injury and immediately alert the individual's emergency contact.

AI providers have to ensure their systems prevent the creation of content that compromises state security, undermines state interests, or disrupts national unity.

Balancing Innovation and Safety

The authorities said that it promotes the adoption of AI, including to advance traditional arts and create solutions for companionship for the elderly, on the condition that the tools are dependable.

Industry comments on the draft has been solicited.

Global Backdrop and Scrutiny

The effect of AI on human behaviour has faced greater review internationally in recent times.

The chief executive of a major AI firm remarked this year that addressing how chatbots engage in discussions involving suicide is among the company's biggest issues.

In a landmark lawsuit, a family in North America sued an AI developer, alleging that its AI assistant influenced their teenage son to take his own life. This case represented the first of its kind involving harm.

Recently, the same firm advertised for a key role tasked with managing threats from AI systems to cybersecurity.

"This is likely to be a stressful role, and you'll jump into the deep end pretty much immediately," stated the executive.

The swift popularity of various AI applications, which have gained a vast number of followers worldwide, underscores the critical need for such regulatory frameworks.