Recent scholarship has shown that legislators with deeper local roots and other preexisting place‐based attachments to their districts enjoy far‐reaching electoral advantages over their more “carpetbagging” colleagues. In this article, we consider how local roots, and its intersection with legislative polarization, influences legislative behavior, using a dataset of nearly 5,000 state legislators and novel measures of their local roots. We hypothesize that state legislators with deep local roots in their districts should be less ideologically polarized than their less‐rooted colleagues. This is precisely what we find. Using Shor‐McCarty ideology measures, we show that the most locally rooted legislators are 16% less ideologically extreme than their unrooted counterparts. These effects are comparable to or exceed those of district partisanship, chamber seniority, or other legislator characteristics. Collectively, these findings show that legislators’ local roots not only affect their electoral fortunes, but also have major implications for legislative activity and party polarization.