High-order terms in the post-Newtonian (PN) expansions of various quantities for compact binaries exhibit a combinatorial increase in complexity, with an ever-increasing number of terms, including more transcendentals and logarithms of the velocity, higher powers of these transcendentals and logarithms, and larger and larger rational numbers as coefficients. Here we consider the gravitational wave energy flux at infinity from a point particle in a circular orbit around a Schwarzschild black hole, which is known to 22PN [O(v 44 ), where v is the particle's orbital velocity] beyond the lowest-order Newtonian prediction, at which point each order has over 1000 terms. We introduce a factorization that considerably simplifies the spherical harmonic modes of the energy flux (and thus also the amplitudes of the spherical harmonic modes of the gravitational waves); it is likely that much of the complexity this factorization removes is due to wave propagation on the Schwarzschild spacetime (e.g., tail effects). For the modes with azimuthal number ℓ ≥ 7, this factorization reduces the expressions for the modes that enter the 22PN total energy flux to pure integer PN series with rational coefficients, which amounts to a reduction of up to a factor of ∼ 150 in the total number of terms in a given mode (and also in the size of the entire expression for the mode). The reduction in complexity becomes less dramatic for smaller ℓ, due to the structure of the expansion, and one only obtains purely rational coefficients up to some order, though the factorization is still able to remove all the half-integer PN terms. For the 22PN ℓ = 2 modes, this factorization still reduces the total number of terms (and size) by a factor of ∼ 10 and gives purely rational coefficients through 8PN. This factorization also improves the convergence of the series, though we find the exponential resummation introduced for the full energy flux in [Isoyama et al., Phys. Rev. D 87, 024010 (2013)] to be even more effective at improving the convergence of the individual modes, producing improvements of over four orders of magnitude over the original series for some modes. However, the exponential resummation is not as effective at simplifying the series, particularly for the higher-order modes.