The extragalactic dark matter (DM) annihilation signal depends on the product of the clumping factor, hδ 2 i, and the velocity-weighted annihilation cross section, σv. This "clumping factor-σv" degeneracy can be broken by comparing DM annihilation signals from multiple sources. In particular, one can constrain the minimum DM halo mass, M min , which depends on the mass of the DM particles and the kinetic decoupling temperature, by comparing observations of individual DM sources to the diffuse DM annihilation signal. We demonstrate this with careful semianalytic treatments of the DM contribution to the diffuse isotropic gamma-ray background (IGRB) and compare it with two recent hints of DM from the Galactic center, namely, ∼130 GeV DM annihilating dominantly in the χχ → γγ channel and ð10 − 30Þ GeV DM annihilating in the χχ → bb or χχ → τ þ τ − channels. We show that, even in the most conservative analysis, the Fermi IGRB measurement already provides interesting sensitivity. A more detailed analysis of the IGRB, with new Fermi IGRB measurements and modeling of astrophysical backgrounds, may be able to probe values of M min up to ∼1M ⊙ for the 130 GeV candidate and ∼10 −6 M ⊙ for the light DM candidates. Increasing the substructure content of halos by a reasonable amount would further improve these constraints.