Let X be a smooth projective variety. We construct partial Okounkov bodies associated to Hermitian pseudo-effective line bundles (L, φ) on X. We show that partial Okounkov bodies are universal invariants of the singularity of φ. As an application, we generalize the theorem of Boucksom-Chen and construct Duistermaat-Heckman measures associated to finite energy metrics on the Berkovich analytification of an ample line bundle.