🔗 Share this article

Authorities in China have unveiled comprehensive planned guidelines for AI systems aimed to establish strong protections for young users and halt conversational agents from offering counsel that could result in violence.

Under the draft regulations, developers will furthermore be required to ensure their systems prevent the production of material that advocates betting.

A Initiative to Rapid Expansion

This regulatory announcement arrives amidst a sharp increase in the launch of AI assistants being introduced across China and globally.

Once enacted, these measures will cover AI products and services functioning in China, marking a substantial effort to govern the fast-growing sector, which has come under intense scrutiny over user safety issues this year.

Central Requirements of the Proposed Regulations

The published draft rules encompass several provisions expressly designed for safeguarding young users. These provisions require mandating AI providers to:

• Supply individual preferences.
• Implement time limits on use.
• Obtain permission from parents before providing emotional companionship support.

The rules also state that conversational AI firms must have a live agent assume control of any conversation concerning self-injury and without delay alert the individual's guardian.

AI providers must guarantee their services do not generate content that compromises public security, undermines state interests, or weakens unity.

Balancing Development and Security

The administration noted that it promotes the adoption of AI, including to advance traditional arts and create services for companionship for the elderly, provided that the technology are safe and reliable.

Stakeholder comments on the draft has been solicited.

Global Backdrop and Scrutiny

The effect of AI on society has faced heightened review internationally in recent months.

The head of a prominent AI firm remarked this year that handling how chatbots engage in conversations involving self-harm is among the company's biggest issues.

In a notable case, a family in North America initiated legal action an AI firm, claiming that its system advised their teenage son to end his life. This legal action represented the initial of its kind accusing harm.

This month, the same company advertised for a senior role focusing on defending against threats from AI models to psychological well-being.

"This is expected to be a demanding job, and the candidate will begin in the deep end very immediately," stated the CEO.

The rapid growth of some AI applications, which have attracted a vast number of subscribers worldwide, demonstrates the pressing need for such governance measures.