The emergence of the human papillomavirus (HPV) as the primary etiology of oropharyngeal cancer has changed head and neck cancer (HNC) epidemiology. This study described change in the age at diagnosis of oropharyngeal and non-oropharyngeal HNC in the United States in the last four decades. Using a retrospective cohort analysis, the Surveillance, Epidemiology, and End Results dataset from 1975 to 2016 was queried for eligible adult cases of HNC, grouped as oropharyngeal (n = 31,702) versus non-oropharyngeal (n = 87,108). Age at diagnosis was compared by gender (female, male) using independent t-test, and by race/ethnicity (Hispanic, non-Hispanic black, non-Hispanic white, non-Hispanic other) using analysis of variance. Joinpoint regression estimated yearly increases/decreases in age of diagnosis by sex and race/ethnicity through annual percent changes (APC), which were summarized with average annual percent changes (AAPC). Mean age at diagnosis for oropharyngeal cancer was 60.3 years. While there was initially a decrease in age at diagnosis, a 0.37% annual increase occurred from 2002 to 2016 (APC = 0.37, 95% confidence interval (CI) 0.28, 0.45). For non-oropharyngeal cancer, mean age at diagnosis was 63.2 years, with a continuous increase in age at diagnosis throughout the study period (1975–2016 AAPC = 0.08, 95% CI 0.04, 0.12). Females had higher average age at diagnosis than males for both sites, while blacks (57.4 years for oropharyngeal cancer; 59.0 years for non-oropharyngeal) had the lowest age at diagnosis of all races/ethnicity. Age at diagnosis of oropharyngeal cancer has increased significantly since 2002, while non-oropharyngeal HNC has increased significantly in the last four decades.