Plants growing in heavy metal (HM)-contaminated soil have evolved a special detoxification mechanism. The rhizosphere gathers many living substances and their secretions at the center of plant roots, which has a unique ecological remediation effect. It is of great significance to thoroughly understand the ecological process of rhizosphere pollution under heavy metals (HMs) stress and develop biotechnology for joint remediation using plants and their coexisting microbial systems according to the mechanism of rhizosphere stress. Microbes can weaken the toxicity of HM pollutants by transforming the existing forms or reducing the bioavailability in the rhizosphere. Microbes survive in the HM-polluted soils through the production of stress-resistant substances, the participation of proteins, and the expression of heavy metal resistance genes, which strengthens the resistance of plants. Moreover, microbes can improve the nutritional status of plants to improve plant resistance to HMs. Plants, in turn, provide a habitat for microbes to survive and reproduce, which greatly accelerates the process of bioremediation. Briefly, the combined remediation of soil HMs pollution by plants and microbes is a promising, green, and sustainable strategy. Here, we mainly elucidate the joint remediation mechanism of plant–microbe symbiosis and introduce the coping characteristics of plants, microbes, and their symbiotic system, hoping to provide a scientific basis for the remediation of HM-contaminated soil in mining areas and the sustainable development of the ecological environment.