Despite their excellent macroscopic operational parameters, halide perovskites exhibit heterogeneity in materials properties at all lateral and vertical length scales. In this Review, we discuss the nature of heterogeneity in halide perovskites and assess the impact of these non-uniformities on their optoelectronic properties, and how the heterogeneity may even be beneficial for device properties.