The presence of pyrite poses a significant impediment to the comprehensive utilization of coal gangue, which is a prevalent solid waste in industrial production. However, the current efficacy of jig separation for pyrite in fine-grade coal gangue remains unsatisfactory. To investigate the influence of particle size distribution on the jig separation of pyrite in fine-grade coal gangue, the raw material was crushed to less than 2 mm using a jaw crusher and subsequently sieved to obtain its particle size distribution curve. Upon fitting the curve, it was observed that it tends towards the Rosin-Rammler (RRSB) and Fuller distributions. Leveraging these two-parameter distribution curves, adjustments were made to determine the mass within each particle size range before conducting thorough mixing followed by jig separation. The results indicate that for fine-grade gangue particles smaller than 2 mm, the RRSB distribution with a uniformity coefficient of n = 0.85 exhibits the most effective separation, although it is comparable to the separation achieved using the size distribution of raw ore. On the other hand, employing the Fuller distribution with modulus of distribution q = 1.5 yields superior separation performance. In comparison to the raw ore, the concentrate shows an increase in sulfur (S) and iron (Fe) content by factors of 3.4 and 2.4, respectively. Furthermore, compared to the RRSB distribution, there is an increase in S and Fe content by 1.91% and 2.30%, respectively; the contents of S and Fe in tailings is 0.71% and 2.72%, which can be directly used as raw materials for coating materials. Therefore, for fine-grade coal gangue particles, jigging under the Fuller distribution demonstrates better effectiveness than under the RRSB distribution.