The effect of CNTs on the mechanical and damping properties of macro-defect-free (MDF) cements was studied, and polyvinyl alcohol (PVA) fibers were also studied as a contrast. It was found that the compressive strength of MDF cements was not significantly affected by the two types of fibers. The CNTs enhanced the flexural strength of MDF, while PVA fibers made negative contribution. The strengthening mechanism of flexural strength of MDF cements by CNTs can be summarized as fiber bridging, crack deflection and fiber slippage. For the damping properties, the proper contents of CNTs and PVA fibers improved the loss factor significantly. The interface transition zone (ITZ) between the PVA fibers and matrix was large, which was favorable for fiber slippage. The damping property of MDF cements with CNTs was mainly due to the slippage between the inner tubes of the CNTs rather than the slippage between the CNTs and matrix.