Prostate cancer (PCa) is a highly heterogeneous disease and typically presents with multiple distinct cancer foci. Heterogeneity in androgen receptor (AR) expression levels in PCa has been observed for decades, from untreated tumors to castration-resistant prostate cancer (CRPC) to disseminated metastases. Current standard-of-care therapies for metastatic CRPC can only extend life by a few months. Cancer stem cells (CSCs) are defined as a subpopulation of cancer cells that exists in almost all treatment-naive tumors. Additionally, non-CSCs may undergo cellular plasticity to be reprogrammed to prostate cancer stem cells (PCSCs) during spontaneous tumor progression or upon therapeutic treatments. Consequently, PCSCs may become the predominant population in treatment-resistant tumors, and the “root cause” for drug resistance. microRNA-34a (miR-34a) is a bona fide tumor-suppressive miRNA, and its expression is dysregulated in PCa. Importantly, miR-34a functions as a potent CSC suppressor by targeting many molecules essential for CSC survival and functions, which makes it a promising anti-PCSC therapeutic. Here, we conducted a comprehensive literature survey of miR-34a in the context of PCa and especially PCSCs. We provided an updated overview on the mechanisms of miR-34a regulation followed by discussing its tumor suppressive functions in PCa. Finally, based on current advances in miR-34a preclinical studies in PCa, we offered potential delivery strategies for miR-34a-based therapeutics for treating advanced PCa.