How does exposure to refugees influence political behavior? We present evidence from Hungary, a country with widespread anti-immigration attitudes, that short term exposure during the 2015 refugee crisis predicts anti-refugee voting and sentiment. We code exposure to refugees at the settlement level using news reports from state media, an independent online news site, and an online social media aggregator. Settlements through which refugees traveled showed significantly higher anti-refugee voting in a national referendum on resettlement in 2016. The effect, estimated between 1.7% and 3.6%, decreases sharply with distance from points of exposure. Using a difference-in-differences model, we find that the far-right opposition party Jobbik gained, while the governing right-wing Fidesz party lost votes in these settlements in subsequent parliamentary elections, suggesting incumbents are punished by voters in these settlements skeptical of immigration regardless of their policy position. Survey data supports this finding of a competition among right-wing parties, as individuals in exposed settlements are more fearful of immigrants and support more restrictive policies, though only if they identify as right-wing partisans.