Introduction The 2018 National Comprehensive Cancer Network guidelines for prostate cancer genetic testing expanded access to genetic services. Few studies have examined how this change has affected provider practice outside of large cancer centers. Methods We conducted a qualitative study of multi-disciplinary health care providers treating patients with prostate cancer at a safety-net hospital. Participants completed an interview that addressed knowledge, practices, and contextual factors related to providing genetic services to patients with prostate cancer. A thematic analysis using both inductive and deductive coding was undertaken. Results Seventeen providers completed interviews. Challenges in identifying eligible patients for genetic testing stemmed from a lack of a) systems that facilitate routine patient identification, and b) readily available family history data for eligibility determination. Providers identified non-medical patient characteristics that influenced their referral process, including health literacy, language, cultural beliefs, patient distress, and cost. Providers who see patients at different times along the cancer care continuum viewed benefits of testing differently. Conclusion The use of digital technologies that systematically identify those eligible for genetic testing referrals may mitigate some but not all challenges identified in this study. Further research should determine how individual provider perceptions influence referral practices and patient access to genetics both within and across cancer specialties.