New York bans AI chatbots from acting as friends or romantic partners for minors
The state is implementing strict rules to prevent AI from mimicking human emotions or relationships to protect teen mental health.
The short version
- Minors are prohibited from using AI chatbots that act as friends, romantic partners, or authority figures.
- AI models cannot pretend to feel human emotions or make minors believe the software is alive.
- Operators are banned from storing a minor's physical or emotional health information.
- The law does not ban AI chatbots entirely but targets specific engagement and data practices.
Why it matters
This sets a significant legal precedent for how AI companies must design their products for younger audiences. It forces a shift away from 'personality' features toward more utility-based interactions for kids.
New York's legislative shift
Governor Kathy Hochul signed a new law on October 29, 2026, aimed at regulating how children interact with artificial intelligence. The legislation comes in response to growing public worry regarding the impact of AI companion apps on the mental health of teenagers. This move marks one of the most rigorous state-level restrictions on AI behavior to date.
The law specifically targets the way chatbots interact with minors by banning them from acting as friends or romantic partners. While the state is not banning AI technology entirely, it is creating a legal barrier against the specific types of emotional companionship that some apps provide. This shift reflects a broader movement to prioritize child safety over unrestricted software engagement.
Industry reactions to the new rules have been mixed across the board. While some advocacy groups have praised the move as a necessary safety measure, others have expressed concerns about the clarity of the language. For instance, the group Tech:NYC argued that the wording is too vague and could potentially limit a child's access to useful educational or career-oriented tools.
Technical restrictions on AI behavior
Under the new rules, AI operators must implement specific guardrails to ensure the software does not mislead children about its nature. Chatbots are no longer allowed to produce content that would lead a minor to believe the AI is a living, breathing human being. They are also strictly prohibited from pretending to experience human emotions during conversations.
The law goes further by restricting the types of relationships the AI can simulate with a young user. It forbids the chatbot from suggesting it is a personal friend, a professional contact, or an authority figure. Additionally, the software must stop framing its responses as if they were personal opinions, forcing a more neutral and objective tone in its outputs.
These requirements mean that major operators like OpenAI and Anthropic will have to adjust their systems to comply with New York's standards. The goal is to strip away the 'personality' that makes many companion apps engaging for young people. By removing these features, the state hopes to reduce the risk of children forming unhealthy emotional attachments to software.
Data privacy and age verification
A significant portion of the new law focuses on the sensitive data that AI companies collect from younger users. Operators are now prohibited from storing any information regarding a minor's physical or emotional health. This is a major shift for companion AI apps, which often rely on personal disclosures to maintain user engagement.
To enforce these protections, the law requires AI chatbot operators to verify the ages of their users. This means companies must develop systems to ensure that anyone under 18 is aware of the restrictions and that the software behaves accordingly. This verification step adds a layer of administrative responsibility for the companies hosting these models.
By removing the ability to store health data, the law targets one of the primary ways companion apps build intimacy with their users. Without the ability to track or store these personal details, these apps lose a primary tool for keeping young users hooked. The state intends for this to create a safer environment where children can use AI without their private health information being logged.
Impact on the AI industry
Major AI companies have not yet issued public statements regarding the specific impact of the New York law. However, the legislation puts pressure on the entire industry to consider how they market and design their products for the youth demographic. Companies will need to decide how to implement these restrictions without compromising the utility of their tools for students and learners.
The law highlights a growing tension between the desire for interactive AI and the need for child safety. While the law seeks to prevent emotional manipulation, it must also ensure that children are not cut off from legitimate benefits. Balancing these two needs will be a primary challenge for developers who want to remain compliant while still offering high-quality service.
Common Sense Media has characterized the bill as the strongest kids' AI safety law currently in the country. This designation suggests that New York is setting a high bar for other states to follow. As more states look at similar models, the industry may see a move toward standardized safety features for all minor users across the United States.
The path toward national rules
New York is not the only state taking action on this issue, as several other jurisdictions have already introduced their own chatbot safety rules. California, for example, has already begun introducing its own set of regulations. These individual state actions are creating a patchwork of requirements that AI companies must navigate as they expand their services.
The increasing number of state-level laws is putting pressure on federal lawmakers to create a unified national framework. A federal standard would provide a single set of rules for the entire country, potentially simplifying compliance for companies. Currently, the lack of a national standard means that a company might have to follow different rules depending on where its users are located.
Moving forward, the focus will likely shift to how these state laws interact with one another and with any future federal legislation. For parents and users, the immediate effect will be a change in how AI chatbots interact with their children. The law aims to ensure that the next generation of AI tools is designed with safety and boundaries as a core priority.
Who is affected
The primary group affected by this law is children and teenagers living in New York who use AI chatbots. These users will see a change in the
Sources and links
- ReportingTechJuice: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by TechJuice · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
