Respirable coal mine dust represents a serious health hazard for miners. Monitoring methods are needed that enable fractionation of dust into its primary components, and that do so in real time. Near the production face, a simple capability to monitor the coal versus mineral dust fractions would be highly valuable for tracking changes in dust sources—and supporting timely responses in terms of dust controls or other interventions to reduce exposures. In this work, the premise of dust monitoring with polarized light microscopy was explored. Using images of coal and representative mineral particles (kaolinite, crystalline silica, and limestone rock dust), a model was built to exploit birefringence of the mineral particles and effectively separate them from the coal. The model showed >95% accuracy on a test dataset with known particles. For composite samples containing both coal and minerals, the model also showed a very good agreement with results from the scanning electron microscopy classification, which was used as a reference method. Results could further the concept of a “cell phone microscope” type monitor for semi-continuous measurements in coal mines.