Injury to the optic nerve, termed, traumatic optic neuropathy (TON) is a known comorbidity of traumatic brain injury (TBI) and is now known to cause chronic and progressive retinal thinning up to 35 years after injury. Although animal models of TBI have described the presence of optic nerve degeneration and research exploring acute mechanisms is underway, few studies in humans or animals have examined chronic TON pathophysiology outside the retina. We used a closed-head weight-drop model of TBI/TON in 6-week-old male C57BL/6 mice. Mice were euthanized 7-, 14-, 30-, 90-, and 150-days post-injury (DPI) to assess histological changes in the visual system of the brain spanning a total of 12 regions. We show chronic elevation of FluoroJade-C, indicative of neurodegeneration, throughout the time course. Intriguingly, FJ-C staining revealed a bimodal distribution of mice indicating the possibility of subpopulations that may be more or less susceptible to injury outcomes. Additionally, we show that microglia and astrocytes react to optic nerve damage in both temporally and regionally different ways. Despite these differences, astrogliosis and microglial changes were alleviated between 14–30 DPI in all regions examined, perhaps indicating a potentially critical period for intervention/recovery that may determine chronic outcomes.