At present, tumor metastasis still remains the leading contributor to high recurrence and mortality in cancer patients. There have been no clinically effective therapeutic strategies for treating patients with metastatic cancer. In recent years, a growing body of evidence has shown that the pre-metastatic niche (PMN) plays a crucial role in driving tumor metastasis. Nevertheless, a clear and detailed understanding of the formation of PMN is still lacking given the fact that PMN formation involves in a wealth of complicated communications and underlying mechanisms between primary tumors and metastatic target organs. Despite that the roles of numerous components including tumor exosomes and extracellular vesicles in influencing the evolution of PMN have been well documented, the involvement of cancer-associated fibroblasts (CAFs) in the tumor microenvironment for controlling PMN formation is frequently overlooked. It has been increasingly recognized that fibroblasts trigger the formation of PMN by virtue of modulating exosomes, metabolism and so on. In this review, we mainly summarize the underlying mechanisms of fibroblasts from diverse origins in exerting impacts on PMN evolution, and further highlight the prospective strategies for targeting fibroblasts to prevent PMN formation.