Studies on the framing of the refugee crisis have focused on media and political discourses, revealing contrasting views and an increasing politicization of immigration. However, the framing-of-asylum discourse in relation to the reception and settlement of asylum seekers in local communities has so far received less attention, especially when conflictual dynamics emerge. This article investigates the ways in which experts at different levels make sense of how the refugee crisis has unfolded in local communities in Italy. Insofar as asylum governance has become a contentious issue, it looks at conflictual situations. The research challenges the binary between humanitarian and fear frames by suggesting the prevalence of a managerialist frame focusing on a problematic implementation of asylum policies. Taking into consideration the opinions of local experts, it also reveals a shift from a fear frame to an inconvenience frame, which denies xenophobic discourses on invasion or social/public disorder in local communities, but finds other reasons to deny acceptance. The article also adds to the study of the horizontal dynamics between public and private actors, which are central, especially at the local level, and introduces refugees as subjects who actively participate in the “battleground” of asylum governance. Therefore, claims about a negotiated order between different tiers of governance within the multilevel governance approach are challenged.