The seemingly advantageous features of carbon‐based materials, such as large pore volume and lightweight structure, could actually lead to low tap density for the sulfur cathode and excessive electrolyte consumption, potentially significantly decreasing the energy density of lithium–sulfur battery. Recently, non‐carbon‐based materials composed of inorganic matter have emerged as promising candidates for creating dense sulfur cathodes and reducing electrolyte intake. Additionally, inorganic matter exhibits strong interactions with lithium polysulfides, which can address the intrinsic problems of the severe shuttling effect and poor reaction kinetics. In this review, we first discuss the relationship between the tap density of the sulfur cathode and the energy density of lithium–sulfur battery. Subsequently, we systematically summarize recent advances in non‐carbon‐based materials as sulfur hosts. Finally, we propose future research directions and perspectives for sulfur host materials to inspire the realization of practical lithium–sulfur battery with high energy density.