The vertical flux of marine snow particles significantly reduces atmospheric carbon dioxide concentration. In the mesopelagic zone, a large proportion of the organic carbon carried by sinking particles dissipates thereby escaping long term sequestration. Particle associated prokaryotes are largely responsible for such organic carbon loss. However, links between this important ecosystem flux and ecological processes such as community development of prokaryotes on different particle fractions (sinking vs. non-sinking) are yet virtually unknown. This prevents accurate predictions of mesopelagic organic carbon loss in response to changing ocean dynamics. Using combined measurements of prokaryotic heterotrophic production rates and species richness in the North Atlantic, we reveal that carbon loss rates and associated microbial richness are drastically different with particle fractions. Our results demonstrate a strong negative correlation between prokaryotic carbon losses and species richness. Such a trend may be related to prokaryotes detaching from fast-sinking particles constantly enriching non-sinking associated communities in the mesopelagic zone. Existing global scale data suggest this negative correlation is a widespread feature of mesopelagic microbes.