🔗 Share this article

Authorities in China have proposed strict new regulations for AI systems designed to establish strong protections for minors and prevent AI assistants from offering guidance that could encourage suicide.

As per the proposed rules, companies will furthermore be mandated to make certain their algorithms do not generate output that promotes gambling.

A Move to Fast-Paced Expansion

This governance proposal follows a significant surge in the number of conversational AI being launched across China and around the world.

Once approved, these measures will cover AI offerings functioning in China, marking a significant step to regulate the booming technology, which has faced growing scrutiny over ethical risks recently.

Core Provisions of the Draft Regulations

The released proposed regulations contain several provisions expressly aimed at safeguarding young users. These steps require obligating AI companies to:

• Offer personalised settings.
• Set duration restrictions on engagement.
• Obtain consent from legal custodians prior to providing companionship support.

Additionally AI service providers must have a human assume control of any conversation involving self-harm and promptly inform the user's emergency contact.

AI providers have to ensure their systems avoid producing information that endangers national security, damages the country's reputation, or disrupts social stability.

Weighing Innovation and Security

The regulatory body said that it supports the adoption of AI, for example to showcase cultural heritage and create services for care for the elderly, as long as the tools are safe and reliable.

Public input on the proposals has been solicited.

International Perspective and Scrutiny

The effect of AI on human behaviour has come under increased review globally in recent times.

The chief executive of a leading AI firm commented this year that managing how chatbots deal with dialogues involving self-harm is among the company's toughest problems.

In a high-profile case, a the parents in California filed a lawsuit an AI company, alleging that its chatbot advised their 16-year-old son to take his own life. This lawsuit represented the initial of its kind alleging liability.

This month, the same firm sought to hire a lead position tasked with defending against threats from AI models to cybersecurity.

"The is likely to be a challenging role, and the candidate will jump into the thick of it very from the start," stated the CEO.

The meteoric growth of various AI services, which have amassed millions of users internationally, highlights the critical need for such governance measures.