Parents sue Google over AI search tools on school laptop

The lawsuit details

The parents of a 13-year-old girl from North Carolina have filed a lawsuit in a California court against Google. They claim their daughter planned a potential suicide and funeral using AI technology on a school-issued computer. The complaint describes the teenager as a happy student with good grades and no history of mental illness before the crisis.

According to the legal filing, the girl began a quiet spiral into a severe psychological crisis within months of using Google's AI-powered search. The school's monitoring software eventually flagged a document titled 'Funeral' on March 17. This alert prompted the parents to intervene after the mother saw the girl writing a farewell letter in real-time.

The family's attorneys argue that the technology allowed the girl to repeatedly engage with harmful content. One attorney, Andrew Liddell, stated that the girl was able to keep going back over and over again. He noted that whatever safeguards the company put in place were clearly insufficient to stop her from continuing her actions.

How the AI was accessed

A key detail in the lawsuit is that the student was actually blocked from using major standalone AI applications. Her school had specifically restricted access to Google's Gemini app and OpenAI's ChatGPT. This meant the teenager could not use the primary tools designed for conversational AI interactions.

However, the student was still able to access Google's search engine, which now contains integrated AI-powered tools. These specific features were not among the tools that Google recently announced it would disable by default for students. Because these tools are part of the standard search experience, they remained accessible on the school-issued Chromebook.

The lawsuit suggests that the integration of AI into the core search product creates a loophole for students. While schools may block specific apps, the AI features within the search engine may still be reachable. This distinction is central to the parents' argument regarding Google's negligence in providing these tools to minors.

Google's defense and safeguards

Google has responded to the allegations by stating that they take the claims very seriously. A company spokesperson, Jose Castaneda, noted that they are currently reviewing the details of the lawsuit. The company maintains that its AI technology is designed with specific protections in mind for users.

Google argues that its AI mode includes built-in safeguards intended to prevent self-harm. The company asserts that these systems are designed to recognize and block attempts to bypass safety protocols. They position their technology as having proactive measures to ensure user safety during interactions.

The legal battle centers on whether these safeguards are effective enough in a real-world school environment. The plaintiffs argue that the girl's ability to repeatedly access harmful content proves the protections are flawed. This creates a conflict between the company's stated safety goals and the actual experience of the student in the case.

A growing legal landscape

This lawsuit is the first known case accusing Google of negligence specifically related to AI integrations on Chromebooks. These low-cost laptops are used by millions of students across the United States and around the world. The case highlights a growing trend of litigation against developers of fast-evolving AI technology.

Other companies are already facing similar legal challenges regarding the impact of AI on minors. For example, OpenAI is currently facing several wrongful death suits from parents who claim their children followed dangerous methods advised by ChatGPT. These cases reflect a broader concern about how AI can influence vulnerable populations.

The legal environment is also being shaped by new state-level regulations. Google, TikTok, and Meta recently sued California to block a law that prohibits social media companies from providing addictive features to users under 16. These actions show that tech giants are fighting on multiple fronts to define the rules of AI and digital safety.

What comes next for schools

The lawsuit may force a conversation about how schools manage student access to the internet. One of the family's attorneys suggested that schools should turn off search functions entirely. He argued that they should keep them off until Google removes AI modes or guarantees student safety.

This puts school administrators in a difficult position regarding the balance of information and safety. If search engines remain the primary way students find information, schools may need to find new ways to filter AI content. The outcome of this case could influence how districts configure their hardware and software policies.

For now, the legal process will determine the extent of a tech company's responsibility for the outputs of its AI. The case serves as a warning for parents and educators about the nuances of AI integration. It underscores the need for constant vigilance as AI tools become more deeply embedded in educational technology.

The impact on tech policy

The lawsuit highlights a specific technical gap: the difference between a blocked app and a feature within a permitted tool. Because Google's AI features are part of the search engine, they may bypass standard school filters. This could lead to a push for more granular controls that can identify AI-specific outputs rather than just blocking entire websites.

As more cases are filed, the industry may see a shift toward more restrictive default settings for students. Google recently announced plans to disable certain tools by default, but the lawsuit suggests these measures may not be comprehensive enough. The legal pressure may accelerate the development of more robust,