In recent developments, some police departments in California, including East Palo Alto, are integrating AI tools to aid in report writing, raising concerns among experts.
During a tense situation in East Palo Alto, Officer Wendy Venegas approached a distressed 14-year-old girl, who was upset after an encounter with her father and boyfriend. As officers arrived to collect information, a familiar protocol was followed: gathering details from all parties involved.
However, this time, Venegas had a new technological partner in crime-fighting: an innovative AI tool called Draft One. East Palo Alto, a working-class city that stands apart from its wealthier Silicon Valley counterparts, is one of several departments in California—along with Campbell, San Mateo, Bishop, and Fresno—testing this AI-powered software developed by Axon, a prominent body camera and taser provider. Axon markets Draft One as a way for officers to create more objective and efficient reports. But as more agencies embrace such technology, experts are voicing concerns about the potential over-reliance on AI within the criminal justice system.
Andrew Ferguson, a professor of criminal law at American University, underscores the significance of police reports. “These documents are crucial in shaping decisions that can dramatically alter lives,” he stated. He pointed out their key role in various legal contexts, from prosecutors’ charging decisions to judges’ bail determinations. “If AI starts to influence that narrative, we face serious concerns regarding its reliability,” he warned.
Rick Smith, the founder of Axon, noted that many police departments are struggling with staffing shortages, a situation exacerbated after high-profile incidents like the murder of George Floyd and the resulting protests. “Departments are still operating about 15-20% below their ideal staffing levels,” he explained, adding that Draft One could free up 20-25% of an officer’s workday that would otherwise be spent on report writing, providing a significant boost in manpower.
East Palo Alto’s Police Chief, Jeff Liu, acknowledged that his department is currently down eight officers from its allocated 36. He sees Draft One as a tool that could help maximize officers’ time on the streets. “If this AI can streamline report writing without sacrificing accuracy, that’s a win for us,” he asserted, mentioning the program’s annual cost of approximately $40,000 for the city.
Interestingly, Liu also admitted to using ChatGPT for crafting social media posts and condolence letters, which contributed to his openness towards the Draft One initiative operating on Microsoft’s secure cloud service.
While Axon is not the sole provider of AI report-writing tools, Draft One has captured significant attention. In nearby Campbell, Captain Ian White reported that officers saved around 50 hours in the first month of utilizing Draft One. In Fort Collins, Colorado, a police department found that AI-generated reports took an average of eight minutes to complete—compared to 23 minutes for those drafted without the software.
However, a recent independent study published in the Journal of Experimental Criminology challenges these time-saving assertions. Researchers from the University of South Carolina conducted a trial in New Hampshire and found no notable difference in report writing times between officers using Draft One and those who were not. Leading the study, Assistant Professor Ian Adams expressed surprise at these findings, noting that further investigation into the lack of time savings is ongoing.
Venegas shared how Draft One has helped her overcome writer’s block after long shifts. The software utilizes body camera audio to generate narratives, allowing her to concentrate on the essential elements of each incident. “When I’m struggling to articulate my thoughts and suddenly see the report capturing them perfectly—that’s a significant relief,” she reflected.
She also tailored her communication during incidents, aware that her verbal clarity would enhance the transcript used by Draft One. Axon product designer Noah Spitzer-Williams noted that the tool encourages officers to add richer context during interactions, potentially fostering better community relations.
Yet, concerns about the implications of real-time narration linger, especially given research from the ACLU indicating that such practices could distort evidence. Spitzer-Williams maintains that he believes Draft One will not exacerbate these issues, citing an Axon study that suggests AI-generated reports typically contain less biased language than those penned by officers.
During a demonstration at the East Palo Alto precinct, Venegas walked through her AI-generated report, acknowledging some limitations, including occasional misidentifications of speakers. She expressed concern about how these minor inaccuracies could affect the justice process; Dr. Matthew Guariglia from the Electronic Frontier Foundation echoed these concerns, emphasizing the potential complications in scrutinizing officer testimony.
White reaffirmed that the Campbell police department has a policy ensuring accountability for reports generated by Draft One, asserting that any discrepancies could be cross-checked against body camera footage.
Rebecca Baum, an assistant district attorney in San Mateo County, conveyed cautious optimism about AI-assisted reports, highlighting the necessity of officers being actively involved in the writing process to ensure comprehensive documentation, especially information that might indicate innocence, which prosecutors are required to disclose.
To mitigate risks, Axon has implemented safeguards within Draft One, requiring officers to thoroughly review and edit reports for accuracy before finalizing them. Venegas demonstrated how the program prompts specific comments in each report paragraph, culminating in a confirmation step stressing accountability.
Concluding her demonstration, Venegas read the final clause, emphasizing the critical nature of officers affirming the accuracy of AI-generated reports. “If needed, I’m willing to testify to the accuracy of this report,” she stated, highlighting the gravity of each document in the ongoing narratives of justice.
This report is a collaborative effort between KQED, Guardian US, and the California Newsroom.
