During the early stages of the COVID-19 pandemic, there was a spike in the reporting of hate crimes (Human Rights Watch, 2020). However, the extent to which the pandemic affected prejudice across a general population—not merely among those disposed to hate crimes—remains unclear. Also unclear is the extent to which prejudice was restricted to specific minority groups associated with the virus, or whether prejudice spilled over to other minority groups. To address these questions, we use panel data collected from participants in a large national longitudinal (panel) study of New Zealanders before and during the early COVID-19 pandemic and systematically quantified social warmth ratings across a broad range of minority-groups (The New Zealand Attitudes and Values Study, N = 30,327, years 2018–2020). We discover reduced warmth toward Chinese, Asians (broadly defined), immigrants, Muslims, refugees, Indians, and the mentally ill. In absolute terms, warmth towards Chinese decreased the most (0.11 SD). Notably, changes in warmth were not detected toward NZ Europeans, Māori, Pacific Islanders, the overweight, or the elderly. Overall, these findings suggest that in New Zealand, pandemic prejudice may spread beyond minority groups associated with the virus to other groups perceived as non-prototypical of national identity.