The vibration-reducing ability of construction materials is generally described by the damping ratio of the materials. Previously, many studies on the damping ratio of concrete have been done, such as the addition of rubber, polymer, fiber, and recycled aggregates in the concrete. However, the application of these materials in construction is limited due to their drawbacks. This paper investigated the effect of the replacement ratio and the size of the hollow glass microspheres (HGM), cenospheres (CS), and graphite flakes (GF) on the damping ratio of mortar. Furthermore, rubber particles (RP), aluminum powder (AP), and natural fiber (NF) were investigated to find if they have a combination effect with HGM. The half-power bandwidth method was conducted to obtain the damping ratio at 28 days of curing, and the compressive and flexural strength tests were also conducted to study the mechanical properties of mortar that contained HGM, CS, and GF. The results show that increases in the size of HGM and the replacement ratio of sand with HGM lead to an increase in the damping ratio. Moreover, RP and NF do not provide a combination effect with HGM on the damping ratio, whereas the application of AP results in a drastic compressive strength decrease even with an increase in damping ratio when incorporated with HGM. Besides, an increase in the replacement percentage of CS also leads to an improvement in the damping ratio, and a smaller size and higher replacement ratio of GFs can improve the damping ratio compared to other additives. As a result, CS and GF are more effective than HGM. 50% replacement ratio of CS slightly reduced the compressive strength by 6.4 MPa while improving the damping ratio by 15%, and 10% replacement ratio of samller GF can enhance the flexural strength by over 4.55% while increasing the damping ratio by 20.83%.