MicroRNAs (miRs) are small non-coding RNA molecules, which are involved in the development of various malignancies, including prostate cancer (PCa). miR-17-5p is considered the most prominent member of the miR-17-92 cluster, with an essential regulatory function of fundamental cellular processes. In many malignancies, up-regulation of miR-17-5p is associated with worse outcome. In PCa, miR-17-5p has been reported to increase cell proliferation and the risk of metastasis. In this study, prostatectomy specimens from 535 patients were collected. Tissue microarrays were constructed and in situ hybridization was performed, followed by scoring of miR-17-5p expression on different tumor compartments. High expression of miR-17-5p in tumor epithelium was associated with biochemical failure (BF, p < 0.001) and clinical failure (CF, p = 0.019). In multivariate analyses, high miR-17-5p expression in tumor epithelial cells was an independent negative prognostic factor for BF (HR 1.87, 95% CI 1.32–2.67, p < 0.001). In vitro analyses confirmed association between overexpression of miR-17-5p and proliferation, migration and invasion in prostate cancer cell lines (PC3 and DU145). In conclusion, our study suggests that a high cancer cell expression of miR-17-5p was an independent negative prognostic factor in PCa.