The aim of this research is to elucidate the intricate dynamics of the effects of servant leadership on employee behavior, particularly focusing on counterproductive work behavior. Drawing on the context–attitude–behavior framework, this study underscores the mediating role of psychological safety in this relationship. Additionally, it unveils the pivotal moderating role of corporate social responsibility (CSR), emphasizing its interaction with servant leadership in influencing psychological safety. To empirically test our hypotheses, we gathered survey data from 394 South Korean workers with a three-wave time-lagged research design. Findings indicate that in contexts with pronounced CSR, servant leadership significantly elevates psychological safety, mitigating negative employee behaviors. Conversely, in organizations with less CSR engagement, these positive effects are attenuated. The results underscore the integral role of CSR in complementing leadership initiatives, advocating for its holistic incorporation into organizational strategies to foster conducive work environments. This research bridges several gaps in the current literature, highlighting the imperative for organizations to intertwine servant leadership with robust CSR endeavors to curtail detrimental employee behaviors. This paper also proposes potential directions for future research in this crucial area.