Numerous American schools are adopting AI-powered surveillance technology to monitor student accounts and school-issued devices such as laptops and tablets around the clock. The primary objective is to ensure the safety of children, particularly in light of mental health challenges and the potential threat of school violence. Machine-learning algorithms are utilized to identify possible signs of issues like bullying, self-harm, or suicide and promptly notify school authorities.
However, these tools raise significant concerns regarding privacy and security. An investigation by The Seattle Times and The Associated Press revealed a troubling incident where reporters unintentionally gained access to nearly 3,500 sensitive, unredacted student documents through a records request. These documents were stored without proper password protection or a firewall, allowing anyone with the link to view them.
Here are key findings from the inquiry:
– Surveillance technologies like Gaggle may not always be secure. Privacy and security risks came to light when reporters sought information from Vancouver Public Schools in Washington about flagged content by the monitoring tool Gaggle. Gaggle, used by approximately 1,500 districts, is among several companies offering surveillance services. The tool had saved screenshots of flagged digital activity, which were inadvertently shared with the reporters without password protection. The disclosed documents contained personal details, including accounts of suicide attempts.
– There is no conclusive independent research demonstrating that surveillance technology enhances safety. The impact of these tools on student well-being remains unclear, with no studies showing a measurable decrease in student suicide rates or violence. Experts emphasize that having privacy to express emotions is crucial for healthy child development. However, supporters of digital monitoring argue that unrestricted self-exploration is not appropriate on school-owned devices.
– LGBTQ+ students are identified as particularly vulnerable to the risks of surveillance software. Advocates caution that these tools can inadvertently expose LGBTQ+ students, as seen in instances where students were potentially outed after expressing their sexual orientation or gender identity. Reports from pilot programs of surveillance technology suggest instances where students felt betrayed or had their trust compromised due to system alerts.
In conclusion, the discussion around AI surveillance in schools underscores the delicate balance between safety measures and safeguarding student privacy and well-being.
The potential consequences of jeopardizing relationships with adults outweigh any benefits. Parents may not be informed that their children are under surveillance, as schools may not clearly disclose the use of monitoring software or hide this information within lengthy technology usage forms. Even if families are aware of the surveillance, schools might not allow them to opt out. Tim Reiland, who tried to persuade his children’s school district in Owasso, Oklahoma, to grant an exemption from Gaggle, expressed concern about the impact of constant government monitoring on young individuals. He questioned the type of adults that society is shaping by enforcing such surveillance practices.___
The Associated Press’ education reporting is made possible through support from various private foundations. AP is entirely responsible for the content produced. For more information on AP’s principles when collaborating with philanthropic organizations, a list of contributors, and the areas covered by funded reporting, visit AP.org.
