How different microscopic mechanisms of ultrafast spin dynamics coexist and interplay is not only relevant for the development of spintronics but also for the thorough description of physical systems out-of-equilibrium. In pure crystalline ferromagnets, one of the main microscopic mechanism of spin relaxation is the electron-phonon (el-ph) driven spin-flip, or Elliott-Yafet, scattering. Unexpectedly, recent experiments with ferro- and ferrimagnetic alloys have shown different dynamics for the different sublattices. These distinct sublattice dynamics are contradictory to the Elliott-Yafet scenario. In order to rationalize this discrepancy, it has been proposed that the intra- and intersublattice exchange interaction energies must be considered in the microscopic demagnetization mechanism, too. Here, using a temperature-dependent x-ray emission spectroscopy (XES) method, we address experimentally the element specific el-ph angular momentum transfer rates, responsible for the spin-flips in the respective (sub)lattices of Fe$$_{20}$$
20
Ni$$_{80}$$
80
, Fe$$_{50}$$
50
Ni$$_{50}$$
50
and pure nickel single crystals. We establish how the deduced rate evolution with the temperature is linked to the exchange coupling constants reported for different alloy stoichiometries and how sublattice exchange energies threshold the related el-ph spin-flip channels. Thus, these results evidence that the Elliott-Yafet spin-flip scattering, thresholded by sublattice exchange energies, is the relevant microscopic process to describe sublattice dynamics in alloys and elemental magnetic systems.