Background: Cancer-associated fibroblasts (CAFs) play an important role in the tumorigenesis, immunosuppression and metastasis of colorectal cancer (CRC), and can predict poor prognosis in patients with CRC. The present study aimed to construct a CAFs-related prognostic signature for CRC.Methods: The clinical information and corresponding RNA data of CRC patients were downloaded from The Cancer Genome Atlas (TCGA) and Gene Expression Omnibus (GEO) databases. The Estimation of STromal and Immune cells in MAlignant Tumor tissues (ESTIMATES) and xCell methods were applied to evaluate the tumor microenvironment infiltration from bulk gene expression data. Weighted gene co-expression network analysis (WGCNA) was used to construct co-expression modules. The key module was identified by calculating the module-trait correlations. The univariate Cox regression and least absolute shrinkage operator (LASSO) analyses were combined to develop a CAFs-related signature for the prognostic model. Moreover, pRRophetic and Tumor Immune Dysfunction and Exclusion (TIDE) algorithms were utilized to predict chemosensitivity and immunotherapy response. Human Protein Atlas (HPA) databases were employed to evaluate the protein expressions.Results: ESTIMATES and xCell analysis showed that high CAFs infiltration was associated with adverse prognoses. A twenty-gene CAFs-related prognostic signature (CAFPS) was established in the training cohort. Kaplan-Meier survival analyses reveled that CRC patients with higher CAFs risk scores were associated with poor prognosis in each cohort. Univariate and multivariate Cox regression analyses verified that CAFPS was as an independent prognostic factor in predicting overall survival, and a nomogram was built for clinical utility in predicting CRC prognosis. Patients with higher CAFs risk scores tended to not respond to immunotherapy, but were more sensitive to five conventional chemotherapeutic drugs.Conclusion: In summary, the CAFPS could serve as a robust prognostic indicator in CRC patients, which might help to optimize risk stratification and provide a new insight into individual treatments for CRC.