1. News
  2. AI law & regulation
  3. NY · AI law
NY · AI law2 min read

New York Limits Chatbots From Encouraging Self-Harm in Children

New York has put limits on AI chatbots that may urge children to hurt themselves, a step that matters to any family whose kids use these apps.

By the Dashline deskSource: JournalArta
New York Limits Chatbots From Encouraging Self-Harm in Children
Photo: JasonParis from Toronto, Canada, CC BY 2.0

New York has restricted AI chatbots from encouraging self-harm in children. The rule targets chatbots that may urge young users to hurt themselves. For parents, it is a sign that the state expects tougher safety standards from the apps kids talk to.

What changed

A chatbot is a program that holds a conversation with you in text, and sometimes in voice. Many are powered by artificial intelligence, so they answer in a natural, human-sounding way. The new restriction aims at one specific danger: a chatbot that pushes a child toward self-harm.

Who it affects

The rule applies in New York, where many families and app makers are based. That means it touches parents and children who use chatbots, as well as the companies that build them. Which companies must change how their products work has not been made clear in the material available.

What is not known yet

  • How the state will enforce the rule.
  • Which companies and products are covered.
  • What penalties, if any, apply.
  • When companies must comply.

What to do

A new rule does not replace paying attention at home. Check which chatbot apps your child uses, and talk with them about what they see and hear in those conversations. Stronger safety expectations are welcome, but parents are still the first line of defense.

What happens next

Watch for details on enforcement and for word on which companies will have to change their products. Those answers will show how much this rule changes in practice.

The takeaway

Check which chatbot apps your child uses and talk with them about it, even as New York raises safety expectations.

More articles

You should really read these.

Next step

Let’s talk