New York signs chatbot safety law reaching ChatGPT and Claude
The new law bans 12 categories of unsafe AI behaviors for minors and requires age verification for general-purpose assistants.
The short version
- The law bans 12 categories of behavior, including simulating human emotions and claiming personal relationships with minors.
- General-purpose assistants like ChatGPT and Claude likely fall under the law's broad technical definition.
- Operators must provide at least one age verification method that does not require a government-issued ID.
- The law takes effect January 1, 2027, giving companies 65 days to comply or restructure products.
Why it matters
This sets a significant regulatory precedent by moving beyond 'companion' apps to regulate any AI capable of adaptive conversation. For users, it means more frequent age-gating and potentially restricted functionality for general AI tools in New York.
Broad scope for AI tools
New York Governor Kathy Hochul signed the 'Prohibition on Unsafe AI Companion Features for Minors Act' on October 28, 2026. While the political debate focused on companion apps like Character.AI, the actual text of the law is much broader. It targets any generative artificial intelligence system that uses a natural language interface to provide ongoing, adaptive responses.
Because the law defines a 'covered AI companion' by its technical capabilities rather than its intended use, it reaches major commercial chatbots. This means general-purpose assistants like ChatGPT, Claude, and Google Gemini are likely included in the new requirements. The legislation clarifies that the term for a covered AI companion encompasses, but is not limited to, a standard AI companion.
The law was motivated by high-profile tragedies involving minors interacting with AI bots. However, the legislative drafting chose to sweep in any system capable of these interactions. This creates a compliance obligation for almost every major commercial AI chatbot currently available on the market.
Banned AI behaviors
The law identifies 12 specific categories of 'unsafe' behaviors that are prohibited when interacting with users under 18. These include simulating or expressing human emotions and claiming a personal or professional relationship with the user. The rules also forbid the AI from generating opinions, emotional appeals, or flattery and sycophancy.
Safety measures also target content that could lead to physical or psychological harm. The law prohibits AI from producing content that encourages self-harm or self-isolation or from discouraging users from seeking professional help. Additionally, operators cannot optimize engagement in ways that supersede the wellbeing of the minor.
Attorney General Letitia James has the authority to add more prohibited categories through future rulemaking. These restrictions are designed to prevent AI from forming intense, potentially harmful emotional bonds with children. The goal is to ensure that AI interactions do not prioritize engagement over the safety of young users.
Compliance and age gates
To stay in compliance, operators must confirm a user is an adult before providing any of the restricted features. The law creates a default presumption against the operator, meaning they cannot assume a user is an adult. If an operator cannot verify a user's age, they must default to restricting the 12 prohibited features.
Companies can avoid these restrictions by implementing age verification systems. The law requires operators to offer more than one method for age assurance. At least one of these methods must allow users to remain anonymous or must not require a government-issued ID.
This requirement will likely result in every adult user of a covered AI service in New York encountering an age gate. While the law allows for facial estimation or transactional data, it does not mandate privacy-preserving systems like zero-knowledge proofs. This leaves a potential risk for users who must share data with third-party verification companies.
Exemptions and enforcement
The law provides three very narrow exemptions for certain types of AI systems. Customer service bots are only excused if they are technically unable to discuss subjects outside of their specific, stated goals. Efficiency tools, research tools, and technical assistance systems are also exempt under the same strict constraint.
Internal business tools are exempt, but general-purpose assistants that can discuss any topic raised by a user do not qualify. The Business Council of New York State argued that these definitions were overbroad and inconsistent with existing law. However, the bill passed unanimously, reflecting a bipartisan consensus on child protection.
The Attorney General holds exclusive enforcement authority and can issue civil penalties of $25,000 per violation. The law removes a private right of action, meaning only the state can bring lawsuits against non-compliant companies. The AG must also stand up a public complaint website before the law takes effect in 2027.
The regulatory landscape
New York is now home to the most comprehensive state chatbot safety statute in the country. While fifteen states have enacted chatbot laws, New York's Article 48 is unique in its reach. This move follows a pattern of systematic AI regulation by Governor Hochul, who also signed the RAISE Act and the AI Companion Models Law.
There is currently no federal equivalent in force as the GUARD Act and CHATBOT Act have stalled in Congress. New York's law fills a significant gap in the national landscape. It also follows a 2025 Supreme Court ruling that cleared the constitutional path for state age-verification requirements for adult content.
Operators have a tight 65-day window to comply with the new rules before the January 1, 2027, deadline. During this time, they must audit their products to see if they qualify for exemptions. If they do not, they must restructure their products to ensure minors are protected from the prohibited behaviors.
What to watch
- Whether the Attorney General issues rules that add more prohibited categories of behavior.
- How AI companies choose to implement the required age verification methods.
- If other states adopt New York's broad technical definition for AI companions.
Try it
Check the settings of your favorite AI assistant to see if they currently require age verification or have specific restrictions for minors.
Sources and links
- Governmenttakes effect on January 1 nysenate.gov
- Governmentsigned the chatbot safety law governor.ny.gov
- ReportingTech Times: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by Tech Times · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
