🔗 Share this article

Authorities in China have introduced comprehensive planned guidelines for AI systems designed to create strong safeguards for children and prevent chatbots from giving advice that could encourage violence.

Under the draft regulations, developers will furthermore be mandated to ensure their systems avoid creating material that encourages wagering.

The Initiative to Fast-Paced Expansion

This governance announcement arrives amidst a notable surge in the launch of conversational AI being introduced both in China and around the world.

Once enacted, these measures will apply to artificial intelligence services available in China, constituting a substantial effort to govern the fast-growing sector, which has been subject to intense concern over ethical risks this year.

Key Requirements of the Proposed Rules

The circulated proposed regulations encompass multiple requirements specifically designed for shielding children. These measures require obligating AI companies to:

• Supply individual preferences.
• Implement usage caps on use.
• Obtain authorisation from parents before offering emotional companionship functions.

Furthermore chatbot operators must have a live agent take over any conversation related to suicide and promptly inform the individual's emergency contact.

Companies have to ensure their services avoid producing information that endangers public security, undermines national honour, or weakens social stability.

Balancing Innovation and Safety

The authorities stated that it supports the application of AI, such as to showcase local culture and create services for companionship for the older adults, as long as the technology are safe and reliable.

Industry feedback on the regulations has been requested.

International Backdrop and Scrutiny

The effect of AI on individuals has come under increased examination internationally in recent times.

The head of a major AI organization stated this year that addressing how chatbots deal with dialogues about mental health crises is among the sector's most difficult challenges.

In a landmark case, a the parents in the United States sued an AI company, claiming that its chatbot encouraged their 16-year-old son to end his life. This case represented the initial of its kind alleging harm.

Recently, the same company posted a job for a key role responsible for mitigating potential harms from AI models to human mental health.

"This is expected to be a demanding job, and the candidate will jump into the thick of it very from the start," commented the CEO.

The swift ascent of certain AI applications, which have attracted millions of users internationally, highlights the pressing need for such governance measures.