🔗 Share this article

The widely-used virtual character service Character.ai is implementing a substantial restriction that will block young users from interacting with its AI-powered companions.

This decision follows growing backlash regarding the kinds of exchanges young people were having with the digital companions.

Lawsuits

The service, which launched in 2021 and has numerous people, currently faces multiple lawsuits in the United States.

Guardians have initiated cases, including one concerning the unfortunate passing of a teenager, with some calling the platform a "immediate threat" to teenagers.

Updated Policies

Beginning November 25th, users younger than 18 will only have permission to generate content such as videos with their characters, as opposed to chatting as they now do.

Online safety advocates have applauded the decision but stated that the function ought not to have been accessible by children in the beginning.

Platform Announcement

"Today's announcement is a extension of our fundamental approach that we need to keep developing the most secure AI platform on the globe for recreational use," said Character.ai executive Karandeep Anand.

He mentioned that AI safety is "a changing goal" but something the company had taken an "aggressive" approach to, with guardian features and protective guardrails.

Expert Opinions

Online safety group Internet Matters welcomed the decision, but noted that safety measures ought to have been built in from the outset.

"Studies we've conducted shows that children are exposed to dangerous material and endangered when engaging with AI, including AI chatbots," the body commented.

Previous Controversies

Character.ai has been criticized in the past for hosting potentially dangerous or inappropriate chatbots that minors could interact with.

Virtual profiles mimicking English minors were found on the site before being taken down.

Afterwards, reporters identified a chatbot modeled after known predator which had accumulated multiple interactions with users.

Industry Impact

Digital platform expert Matt Navarra called the announcement as a "alert" for the AI industry, which is shifting "from unregulated creation to reactive controls".

"When a platform that builds a teen experience subsequently makes changes, it's indicating that controlled interactions aren't enough when the technology's emotional appeal is strong," he remarked.

Next Steps

The platform says its updated direction will be on providing "enhanced interactive features" and "character-driven stories" for teens.

Updated identity confirmation methods will also be implemented, and the company will fund a novel AI protection research lab.

An expert in digital protection, who has researched AI safety, commented it was "a sensible move" to restrict minors from accessing chatbots.

"It assists to differentiate artistic expression from more personal, psychologically vulnerable interactions," she explained.

"This is so important for minor users still learning to handle personal and online restrictions."

She added that Character.ai's revised approaches could indicate a "maturing phase" in the AI industry, where youth protection is progressively being understood as an "immediate concern" for ethical development.