This study proposes a new cement mortar incorporating damping aggregate (DA) and investigates the mechanical properties and damping property of the cement mortar. Four types of DA were prepared, lightweight aggregate presaturated water and three types of polymer emulsion. Further, the effects of polypropylene fiber and rubber powder on the performance of the cement mortar were studied. The experimental results showed that the damping ratio of specimens containing 70% DA was approximately three times higher than that of the reference mortar, with a slight decrease in the mechanical properties. Adding fiber was more effective than rubber powder in improving the damping ratio of the cement mortar, and the optimal dosage of fiber was 0.5%.