Manganese slag (MS) is a kind of chemical waste, which may pollute the environment if conventional handling methods (stacking and landfill) are applied. Ultra-high-performance concrete (UHPC)—with considerably high compactness and strength—can be used not only as a special concrete material, but also to solidify the toxic substances in solid waste. This study proposes the addition of MS to UHPC, where the mass ratio of MS varies from 0% to 40% in the total mass of MS and silica fume. The effects of MS on the fluidity, plastic viscosity, and yield shear stress are investigated, and the flexural strength, compressive strength, and dry shrinkage rate of UHPC with MS are measured. X-ray diffraction (XRD) spectrum and energy spectrum analysis (EDS) diagrams are obtained to analyze the performance mechanism of the UHPC. A rheological study confirms that the slump flow increases with the increasing rate of 0–14.3%, while the yield shear stress and plastic viscosity decrease with the rates of 0–29.6% and 0–22.2%, respectively. The initial setting time increases with the mass ratio of MS by 0–14.3%, and MS has a positive effect on the flexural and compressive strengths of UHPC. In the early curing stage (less than 14 days), the increasing rate in the specimens increases with the curing age; meanwhile, when the curing age reaches 14 days or higher, the increasing rate decreases with increasing curing age. The compactness of UHPC is increased by adding MS. Furthermore, MS can increase the elements of Al and decrease crystals of Ca(OH)2 and calcium silicate hydrate in UHPC.