Many cancer studies now recognize that disease initiation, progression, and response to treatment are strongly influenced by the microenvironmental niche. Widespread desmoplasia, or fibrosis, is fundamental to pancreatic cancer development, growth, metastasis, and treatment resistance. This fibrotic landscape is largely regulated by cancer-associated fibroblasts (CAFs), which deposit and remodel extracellular matrix (ECM) in the tumor microenvironment (TME). This review will explore the prognostic and functional value of the stromal compartment in predicting outcomes and clinical prognosis in pancreatic ductal adenocarcinoma (PDAC). We will also discuss the major dynamic stromal alterations that occur in the pancreatic TME during tumor development and progression, and how the stromal ECM can influence cancer cell phenotype, metabolism, and immune response from a biochemical and biomechanical viewpoint. Lastly, we will provide an outlook on the latest clinical advances in the field of anti-fibrotic co-targeting in combination with chemotherapy or immunotherapy in PDAC, providing insight into the current challenges in treating this highly aggressive, fibrotic malignancy.