The burden of chronic kidney disease (CKD) is increasing, posing a serious threat to human health. Cardiovascular calcification (CVC) is one of the most common manifestations of CKD, which significantly influences the morbidity and mortality of patients. The manifestation of CVC is an unusual accumulation of mineral substances containing calcium and phosphate. The main component is hydroxyapatite. Many cells are involved in this process, such as smooth muscle cells (SMCs) and endothelial cells. CVC is an osteogenic process initiated by complex mechanisms such as metabolic disorders of calcium and phosphorus minerals, inflammation, extracellular vesicles, autophagy, and micro-RNAs with a variety of signaling pathways like Notch, STAT, and JAK. Although drug therapy and dialysis technology continue to advance, the survival time and quality of life of CVC patients still face challenges. Therefore, early diagnosis and prevention of CKD-related CVC, reducing its mortality rate, and improving patients’ quality of life have become urgent issues in the field of public health. In this review, we try to summarize the state-of-the-art understanding of the progression of CVC and hope that it will help in the prevention and treatment of CVC in CKD.