Identifying risk factors for sexual abuse in men who work with children and who have already abused a child could lead to more appropriate screening and prevention strategies and is thus of major scientific and societal relevance. A total of 8,649 German men from the community were assessed in an extensive anonymous and confidential online survey. Of those, 37 (0.4%) could be classified as child sexual abusers working with children, 90 (1.0%) as child sexual abusers not working with children, and 816 (9.4%) as men who work with children and who have not abused a child. We assessed the impact of working with children as an individual risk factor for self-reported child sexual abuse and compared personal factors, pedophilic sexual fantasies, deviant sexual behaviors, antisocial behaviors, and hypersexuality among the three groups. Most interestingly, working with children was significantly associated with a self-reported sexual offense against children, however, it explained only three percent of its variance. Child sexual abusers working with children admitted more antisocial and more sexually deviant behaviors than child sexual abusers not working with children and than men working with children who have not abused a child. Our findings support some of the suggestions made by other researchers concerning factors that could be considered in applicants for child-or youth-serving institutions. However, it has to be pointed out that the scientific basis still seems premature.