One of the most intriguing phenomena under radiation is the self-organization of defects, such as the void superlattices, which have been observed in a list of bcc and fcc metals and alloys when the irradiation conditions fall into certain windows defined by temperature and dose rate. A superlattice features a lattice parameter and a crystal structure. Previously, it has been shown that the superlattice parameter is given by the wavelength of vacancy concentration waves that develop when the uniform concentration field becomes unstable. This instability is driven thermodynamically by vacancy concentration supersaturation and affected by the irradiation condition. However, a theory that predicts the superlattice symmetry, i.e., the selection of superlattice structure, has remained missing decades after the first report of superlattices. By analyzing the nonlinear recombination between vacancies and self-interstitial-atoms (SIAs) in the discrete lattice space, this work establishes the physical connection between symmetry breaking and anisotropic SIA diffusion, allowing for predictions of void ordering during defect self-organization. The results suggest that while the instability is driven thermodynamically by vacancy supersaturation, the symmetry development is kinetically rather than thermodynamically driven. The significance of SIA diffusion anisotropy in affecting superlattice formation under irradiation is also indicated. Various superlattice structures can be predicted based on different SIA diffusion modes, and the predictions are in good agreement with atomistic simulations and previous experimental observations.