In the prevention of violent extremism (PVE), various so-called soft interventions have been introduced, suggesting that teachers, social workers, and youth workers play key roles in detecting and responding to early signs of radicalization leading to violent extremism. Research has been conducted on how these interventions are being implemented and whether or not they may contribute to the securitization of welfare work. In this case study, eleven youth workers and their three managers were interviewed about their experiences of engaging in PVE work. They all worked in a neighbourhood in Gothenburg, Sweden, which was one of the earliest and most affected areas in Europe for recruitment to what was to become the so-called Islamic State (IS). The study focuses on their recollection of how they were informed about the on-going radicalization to violent extremism at the time, what actions they took, and how they were prepared for conducting PVE work. Some of the youth workers noticed signs of radicalization to violent extremism early in 2013, but they worked on short-term contracts and were not in a position to pass on the information to higher authorities. A better organized Gothenburg city could have started its PVE work two years earlier, rather than in 2015.