The coal shed is an enclosed space where raw coal is stored and handled. The intensive operation of the machinery inside the coal shed generates a large amount of dust, and the wind speed inside the enclosed space easily leads to a high concentration of dust, which endangers the physical and mental health of the workers. In this paper, we first studied the particle size distribution of dust samples in the coal shed and found that 12.2% of the dust in the air of the coal shed was 10–100 μm, 87.8% was less than 10 μm, and 72.9% was less than 2.5 μm. Fluent was used to simulate the law of dust dispersion in the coal shed under different working conditions, and finally, the simulation results were used to guide the design of the ventilation site and dust-reduction scenario. The experimental and simulation results show that under the same working conditions, the average dust reduction efficiency of the ventilation method in which the north side and south side pump air outside was 9.9%. The ventilation method in which the north side blows inside and the south side pumps outside was 23.7%. The average dust reduction efficiency of the ventilation method in which the north side blows inside and the south side pumps outside + placing the fan in the middle was 59.9%. The research results can provide some reference value for indoor air quality improvement.