Values? Camera? Action! An ethnography of an AI camera system used by the Netherlands Police

Abstract

Police departments around the world implement algorithmic systems to enhance various policing tasks. Ensuring such innovations take place responsibly – with public values safeguarded – is essential for public organizations. This paper analyzes how public values are safeguarded in the case of MONOcam, an algorithmic camera system designed and used by the Netherlands police. The system employs artificial intelligence to detect whether car drivers are holding a mobile device. MONOcam can be considered a best practice when it comes to value-sensitive design; many measures were taken to safeguard public values in this algorithmic system. In pursuit of responsible implementation of algorithms, most calls and literature focus on such value-sensitive design, but much less attention is paid to what happens beyond design. Building on 120+ hours of ethnographic observations as well as informal conversations and three semi-structured interviews, this research shows that public values deemed safeguarded in design are renegotiated as the system is implemented and used in practice. This paper thus highlights that algorithmic system design is often based on an ideal world, but it is in the complexities and fuzzy realities of everyday professional routines and socioma-terial reality that these systems are enacted, and public values are renegotiated in the use of ’algorithms’. While value-sensitive design is important, this paper shows that it offers no guarantees for safeguarding public values in practice.