Four sensory systems (vestibular, lateral line, electroreception, auditory) are unique and project exclusively to the brainstem of vertebrates. All sensory neurons depend on a common set of genes (Eya1, Sox2, Neurog1, Neurod1) that project to a dorsal nucleus and an intermediate nucleus, which differentiate into the vestibular ear, lateral line and electroreception in vertebrates. In tetrapods, a loss of two sensory systems (lateral line, electroreception) leads to the development of a unique ear and auditory system in amniotes. Lmx1a/b, Gdf7, Wnt1/3a, BMP4/7 and Atoh1 define the lateral line, electroreception and auditory nuclei. In contrast, vestibular nuclei depend on Neurog1/2, Ascl1, Ptf1a and Olig3, among others, to develop an independent origin of the vestibular nuclei. A common origin of hair cells depends on Eya1, Sox2 and Atoh1, which generate the mechanosensory cells. Several proteins define the polarity of hair cells in the ear and lateral line. A unique connection of stereocilia requires CDH23 and PCDH15 for connections and TMC1/2 proteins to perceive mechanosensory input. Electroreception has no polarity, and a different system is used to drive electroreceptors. All hair cells function by excitation via ribbons to activate neurons that innervate the distinct target areas. An integrated perspective is presented to understand the gain and loss of different sensory systems.