New York passes laws on AI chatbot risks for kids and baby monitor security

New safety standards for AI

New York has officially enacted two new laws designed to shield children from the risks of modern technology. Governor Kathy Hochul signed the legislation on October 28, targeting both artificial intelligence and smart home devices. These measures aim to address specific dangers that have emerged as these technologies become more common in households.

One of the primary focuses of the new rules involves AI chatbots. The state is moving to prohibit companies from offering certain unsafe features to anyone under the age of 18. Specifically, the law targets chatbots that might encourage self-harm, promote emotional dependency, or engage in sexually explicit conversations with minors.

The legislation was introduced by state Sen. Kristen Gonzalez and Assemblymember Alex Bores. It represents a broader effort by the state to manage the risks of emerging tech. By creating these boundaries, the state hopes to prevent companies from peddling harmful interactions to children.

Age verification and penalties

To ensure these protections reach the intended audience, the law places new requirements on tech companies. Businesses must now verify the ages of their users before allowing them to access the prohibited AI features. The state requires that companies provide multiple different methods for this verification process.

Privacy is also a core component of the new mandate. Once a company has used a user's age information to verify their status, they are required to delete that information. This is intended to balance the need for safety with the need to protect the personal data of the users.

The state has established significant consequences for companies that fail to comply with these rules. The state attorney general has the authority to seek civil penalties of up to $25,000 per violation. This financial risk is intended to encourage companies to prioritize safety over rapid deployment.

Securing the nursery

The second law addresses a different but equally pressing safety concern: internet-connected baby monitors. These devices, which allow parents to view or hear their children remotely, have been identified as potential targets for hackers. The new law requires these monitors to include specific security features to prevent unauthorized access to audio or video feeds.

The state's decision to act follows specific research into the vulnerabilities of these devices. Researchers at Rapid7 evaluated nine different internet-connected baby monitors from eight different companies. The results were concerning, as eight of those devices received an F grade for their security measures.

The law also mandates that these devices carry clear warning labels. These labels must explain the device's internet connectivity to the consumer and advise families on how to use the available security features. The goal is to ensure parents are fully aware of the risks and know how to mitigate them.

A broader legislative push

These two laws are not isolated incidents but part of a larger legislative trend in New York. The state is actively looking at how technology affects children's privacy and safety. Other measures already in place include the SAFE for Kids Act, which limits certain addictive features on social media platforms for minors.

New York is also addressing how smartphones and other devices impact the K-12 school environment. By combining these efforts, the state is creating a multi-layered approach to digital safety. The goal is to create a safer environment for children as they navigate an increasingly connected world.

Governor Hochul emphasized that the state is taking action because of tragic incidents that could have been avoided. She stated, "No company should be peddling chatbots to kids encouraging self-harm." This sentiment underscores the state's intent to hold tech developers accountable for the impact of their products.

Timeline and next steps

The implementation of these laws will happen in stages over the coming months. The baby monitor legislation is set to take effect 90 days after its enactment. This gives manufacturers a window to update their products and labeling to meet the new state requirements.

The AI chatbot legislation also provides a framework for enforcement by the state attorney general. Companies operating within New York will need to audit their current AI offerings to ensure they do not violate the new restrictions. This includes checking for features that might encourage emotional dependency or other prohibited behaviors.

Moving forward, the state will likely monitor how these laws affect the tech industry in New York. As artificial intelligence continues to advance at a rapid pace, these laws may serve as a model for other states. The focus remains on ensuring that the safety of children comes first in the development of new technologies.