The development of phytoremediation by garden plants is an effective way to deal with the dilemma of municipal sewage sludge disposal. In this study, two ornamental plants were used as phytoremediation plants to rehabilitate heavy-metal-contaminated municipal sewage sludge in field experiments, and the role of exogenous phytohormone IAA was also tested. Ornamental plants Loropetalum chinense var. rubrum (L. rubrum) and Rhododendron pulchrum (R. pulchrum) adapted well to the artificial soil made of municipal sewage sludge, and the concentrations of Cu, Zn, Pb, and Ni were decreased by 7.29, 261, 20.2, and 11.9 mg kg−1, respectively, in the soil planted with L. rubrum, and 7.60, 308, 50.1, and 17.7 mg kg−1, respectively, in the soil planted with R. pulchrum, accounted for 11–37% of the total amounts and reached significant levels (p < 0.05), except Cd. The concentration of Pb in all parts of the two ornamental plants was increased, as well as most heavy metals in L. rubrum root. As a result, three months after transplant, the phyto-extraction amounts in L. rubrum were 397, 10.9, and 1330 μg for Ni, Cd, and Pb, respectively, increased by 233% to 279%. The phyto-extraction amount in R. pulchrum were 1510, 250, and 237 μg for Zn, Pb, and Cu, respectively, increased by 143% to 193%. These results indicated a potential to remediate heavy metals of the two ornamental plants, especially L. rubrum. The results of correlation analysis implied that the interaction of heavy metals in the plant itself played an important role in the uptake of heavy metals. This seemed to explain why applying IAA in the experiment had little effect on plant growth and phytoremediation of heavy metals. This study provided a green and feasible idea for the proper disposal of municipal sewage sludge.