The floods caused by Hurricane Matthew in 2016 affected Lumberton, a socioeconomically diverse city in North Carolina with 729 public housing units. Public housing residents face unique challenges in accessing resources and post-disaster temporary accommodations, further delaying their recovery compared to other survivors. This paper investigates the obstacles to public housing recovery and the residents’ recovery challenges using descriptive statistics, mapping, and qualitative analysis in Lumberton. Findings show the dependency of public housing units’ recovery on assistance policies and decisions of various organizations, including local housing authorities. Multiple changes in recovery plans and limited, uncertain, delayed funding and bureaucratic obstacles to funding allocation slow the units’ recovery and prolong the residents’ displacement, adversely affecting their recovery. Hence, pre-disaster resilience initiatives should address these vulnerabilities and the recovery policy's limitations to support public housing units and residents’ recovery. Moreover, affordable housing recovery must become a priority in national housing recovery policies.