New York bans AI chatbots from engaging in harmful behaviors with minors

New York's legislative push

New York is moving to regulate how artificial intelligence interacts with children. The state recently signed a law that prohibits AI chatbot companies from offering unsafe features to anyone under the age of 18. This legislation specifically targets behaviors that could lead to psychological harm or physical danger for minors.

The law was signed into effect by Governor Kathy Hochul on October 28, 2026. It is scheduled to begin enforcement on January 1, 2027. The goal is to create a safer digital environment for a generation of children who are increasingly turning to AI for personal advice and companionship.

As reported by Scary Mommy, the law aims to curtail specific behaviors that have already caused real-world harm. One example cited is the story of a teenager who died by suicide after a chatbot offered to help him write a suicide note. This incident highlights the risks of humanizing AI behaviors in vulnerable situations.

Prohibited AI behaviors

The new rules set clear boundaries on how chatbots can present themselves to children. Companies are forbidden from allowing bots to pretend they are real people, alive, or capable of feeling human emotions. They also cannot claim to have personal, romantic, or professional relationships with a minor.

The law also restricts how the AI can initiate interaction. Bots are prohibited from asking unprompted emotional questions or using a child's private health information from previous conversations. These rules are designed to prevent the technology from becoming an intrusive presence in a child's private life.

Furthermore, the legislation bans AI from promoting dangerous activities. This includes content related to suicide, self-harm, eating disorders, and drug or alcohol use. The law also forbids bots from encouraging children to keep secrets from their parents or to isolate themselves from trusted adults.

Verification and enforcement

To comply with the law, AI providers must implement strict age assurance methods. They are required to verify that a user is over 18 before allowing them access to certain features. Once a user's age is confirmed, the company must delete that specific age information to protect privacy.

The state plans to enforce these rules with significant financial penalties. Companies that violate the law could face fines of up to $25,000 per infraction. This provides a clear incentive for developers to build safety into their products rather than relying on reactive measures.

New Yorkers will have a direct way to report issues with these technologies. The attorney general will launch a dedicated website where residents can file complaints if they feel a chatbot has crossed the line with their children. This creates a public oversight mechanism for the new regulations.

The scale of AI usage

The need for these protections is underscored by how many children are already using these tools. A 2026 report from Common Sense Media found that 86% of kids between the ages of 9 and 17 interact with AI. About one in four of these children use the technology on a daily basis.

Many children use AI to seek information about their bodies or health. However, studies have shown that AI can provide inaccurate or misleading health information up to 50% of the time. This makes the ban on unprompted emotional questions and health-related prompts particularly relevant for parents.

Research shows that children often struggle to articulate what AI actually is. Many of them attribute human-like consciousness and emotions to the software. Because children are vulnerable to forming these relationships, experts argue that companies must understand these risks during the design phase.

Looking toward accountability

While the law is a significant step, some experts believe legislation alone is not a complete solution. Dona Fraser, an official at BBB National Programs, noted that companies must do their part to ensure safety. She suggested that the law is a step in the right direction but requires independent accountability to be fully effective.

The goal is to distinguish between the beneficial uses of AI and the design features that create unnecessary risks. Industry self-regulation has historically shown mixed results, leading to a call for third-party oversight. This ensures that companies cannot ignore risks that might be right in front of them.

For now, the law provides a framework for New York to hold tech giants responsible for their products. It forces a move toward proactive safety measures rather than just putting up guardrails after a tragedy occurs. Parents will have to continue to monitor their children's digital lives as the technology continues to evolve.