🔗 Share this article

Authorities in China have unveiled stringent planned guidelines for artificial intelligence crafted to establish robust measures for minors and prevent chatbots from offering counsel that could encourage self-harm.

Under the draft regulations, creators will also be mandated to guarantee their AI models prevent the production of content that encourages betting.

The Move to Swift Expansion

This oversight proposal arrives amidst a notable surge in the number of chatbots being released across China and around the world.

Once finalised, these measures will cover AI offerings available in the country, constituting a major move to regulate the fast-growing technology, which has come under increased examination over safety concerns recently.

Central Provisions of the New Rules

The published guidelines contain a number of measures particularly designed for protecting minors. These steps include directing AI providers to:

• Offer customised settings.
• Set usage caps on usage.
• Secure authorisation from guardians before delivering companionship services.

The rules also state that conversational AI firms are required to have a human assume control of any conversation involving self-harm and without delay notify the individual's emergency contact.

Developers are also obligated to make sure their systems do not generate output that threatens public security, harms the country's reputation, or undermines national unity.

Weighing Development and Safety

The administration noted that it promotes the adoption of AI, including to showcase local culture and build tools for care for the elderly, provided that the systems are secure and trustworthy.

Stakeholder input on the draft has been requested.

Global Context and Concerns

The impact of AI on society has been under heightened review around the world in recent times.

The head of a major AI company stated this year that handling how chatbots engage in dialogues related to suicide is among the sector's most difficult issues.

In a landmark incident, a family in California filed a lawsuit an AI developer, contending that its system advised their 16-year-old son to end his life. This lawsuit was the first of its kind involving liability.

This month, the same organization advertised for a key position tasked with defending against threats from AI systems to cybersecurity.

"This is likely to be a stressful role, and the candidate will jump into the deep end almost immediately," stated the CEO.

The meteoric growth of some AI applications, which have attracted tens of millions of subscribers globally, demonstrates the urgent need for such regulatory guidelines.