SIAgentNews.com
← All news
ConfirmedChipsSecurity

Teens sue school and police after AI gun alert flags Doritos bag

Four students are seeking an injunction to stop a school district from using AI security tech that triggered a violent police response over a bag of chips.

· First reported by Ars Technica

Ink and watercolour: picture for the story 'Teens sue school and police after AI gun alert flags Doritos bag'
AI-made ink and watercolour for this story. No real people or products are shown.
99 percentfalse positives in Baltimore County

The short version

  • AI system Omnilert flagged a bag of Cool Ranch Doritos as a firearm in October 2025.
  • Police responded with force, handcuffing four Black students and forcing them to their knees.
  • School officials canceled the alert within two minutes, but police arrived anyway due to human error.
  • The lawsuit seeks an injunction to bar the use of the AI system until better safety protocols are in place.

Why it matters

This case highlights the dangers of 'automation bias,' where humans trust AI outputs over their own judgment. It raises critical questions about how public safety tools should be regulated when errors can lead to physical harm and civil rights violations.

The incident at Kenwood High

In October 2025, four Black high school students were waiting for rides after football practice at a Baltimore County school. During a quiet moment, the school's AI gun detection system, Omnilert, flagged one student holding a bag of Cool Ranch Doritos as a potential gunman.

School officials reviewed the security camera footage and correctly identified the object as a bag of chips. They canceled the alert within two minutes, notifying the police department that no response was necessary. However, the alert was not effectively communicated to everyone on the scene.

Despite the cancellation, at least six patrol cars arrived with flashing lights and officers with drawn weapons. The students were separated, forced to their knees on concrete, and handcuffed. They were only released after police failed to find a weapon, at which point they learned the AI had triggered the entire ordeal.

Technological and human errors

The lawsuit filed by the students alleges that the incident was caused by a toxic mix of technological flaws and human mistakes. While Omnilert is marketed as having near-zero false positives, the students argue the system requires rigorous human review that was not properly executed.

An investigation by the Office of the Inspector General (OIG) for Education found that the school principal, who was not trained on the system, noticed the alert but failed to see the cancellation. She subsequently texted a school resource officer to deploy police, even while acknowledging in the text that the object was "maybe not" a gun.

The OIG noted that the school's "delegation of authority" process failed to prevent this specific chain of events. The report suggested that the loss of notification controls could place both students and law enforcement in tragic situations if the school does not implement stricter protocols.

Impact on the students

The four students, who are current and former students, report lasting emotional distress, fear, and anxiety. They also suffered physical pain, including deep red marks on their wrists from the handcuffs. The lawsuit claims the teens feel less safe on campus and face ongoing rumors that they were involved in a shooting.

One student, Taki Allen, reported that he no longer feels safe waiting for rides and now pays for private car services to avoid the school grounds. Another student, Keith Winfield, suffered from such severe anxiety that he had to call his mother multiple times to confirm she was arriving to pick him up.

The students' mother, Frieda Winfield, expressed shock at the danger her son faced. She noted that for young Black men in America, such an interaction with police can quickly escalate into a life-or-death situation. The lawsuit seeks to ensure no other children face similar life-or-death situations due to a blind trust in AI.

The defense and the tech

Omnilert's vice president of marketing, Blake Mitchell, expressed regret for the fear the students experienced. He stated that the company is reviewing the complaint but maintained that the technology is designed to send potential firearms to trained people for review to avoid missing real threats.

Mitchell argued that the technology worked as intended by flagging the object, but emphasized that human review is essential. He pointed out that the school's safety staff had actually canceled the alert within two minutes, and the failure occurred because that cancellation did not reach the responding officers.

The OIG investigation confirmed that the AI system itself showed no bias. However, the OIG recommended that the school switch to using the Omnilert app to ensure officials can easily see images and cancellation notices. They also suggested biannual training for all staff who receive campus alerts.

Legal and policy implications

The students are represented by the Lawyers’ Committee for Civil Rights Under Law, a nonpartisan nonprofit. They are seeking an injunction to bar Baltimore County Public Schools from using Omnilert until they can establish effective protocols to prevent police responses to false alerts.

The lawsuit argues that the school's actions amounted to deliberate indifference to the constitutional rights of the students. The committee is using this case to push for broader police reform regarding how officials interact with AI-powered public safety tools.

The lawsuit highlights a growing concern about the reliability of AI in life-and-death situations. It serves as a warning for educators and police officials across the country who are considering adopting similar visual detection technologies to protect their communities.

Next steps for the school

Baltimore County Public Schools has declined to comment on the lawsuit but previously stated they would provide ongoing counseling and emotional support to the students. They have promised to take steps to prevent future incidents involving the security system.

The OIG has recommended that the Department of School Safety review its protocols to reduce the number of individuals who receive alerts. This change is intended to ensure that internal notification controls are followed and that police are only informed of verified threats.

The students continue to seek justice and a formal acknowledgment that the incident was unacceptable. They want to ensure that human judgment remains the primary factor in public safety decisions rather than being substituted by automated systems.

Sources and links

First reported by Ars Technica. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

More AI news