In this Perspective, we present a framework that defines how to understand and control material structure across length scales with inorganic nanoparticles. Three length scales, frequently discussed separately, are unified under the topic of hierarchical organization: atoms arranged into crystalline nanoparticles, ligands arranged on nanoparticle surfaces, and nanoparticles arranged into crystalline superlattices. Through this lens, we outline one potential pathway toward perfect colloidal matter that emphasizes the concept of uniformity. Uniformity is of both practical and functional importance, necessary to increase structural sophistication and realize the promise of nanostructured materials. Thus, we define the nature of nonuniformity at each length scale as a means to guide ongoing research efforts and highlight potential problems in the field.nanomaterial | uniformity | colloidal crystal | dispersity | hierarchy