In experimental animal models of auditory hair cell (HC) loss, insults such as noise or ototoxic drugs often lead to secondary changes or degeneration in non-sensory cells and neural components, including reduced density of spiral ganglion neurons, demyelination of auditory nerve fibers and altered cell numbers and innervation patterns in the cochlear nucleus. However, it is not clear whether loss of HCs alone leads to secondary degeneration in these neural components of the auditory pathway. To elucidate this issue, we investigated changes of central components after cochlear insults specific to HCs using diphtheria toxin receptor (DTR) mice expressing DTR only in HCs and exhibiting complete HC loss when injected with diphtheria toxin (DT). We showed that DT-induced HC ablation has no significant impacts on the survival of auditory neurons, central synaptic terminals, and myelin, despite complete HC loss and profound deafness. In contrast, noise exposure induced significant changes in synapses, myelin and CN organization even without loss of inner HCs. We observed a decrease of neuronal size in the auditory pathway, including peripheral axons, spiral ganglion neurons, and cochlear nucleus neurons, likely due to loss of input from the cochlea. Taken together, selective HC ablation and noise exposure showed different patterns of pathology in the auditory pathway and the presence of HCs is not essential for the maintenance of central synaptic connectivity and myelination.