Across the animal kingdom, visual systems have evolved to be uniquely suited to the environments and behavioral patterns of different species. The visual acuity and color perception of organisms depend on the distribution of photoreceptor subtypes within the retina. Retinal mosaics can be organized into three broad categories: stochastic/regionalized, regionalized, and ordered. Here, we describe the retinal mosaics of flies, zebrafish, chickens, mice, and humans and the gene regulatory networks controlling proper photoreceptor specification in each. By drawing parallels in eye development between these divergent species, we identify a set of conserved organizing principles and transcriptional networks that govern photoreceptor subtype differentiation.