Disparities in dietary behaviors have been directly linked to the food environment, including access to retail food outlets. The Coronavirus Disease of 2019 (COVID-19) pandemic has led to major changes in the distribution, sale, purchase, preparation, and consumption of food in the United States (US). This paper reflects on those changes and provides recommendations for research to understand the impact of the pandemic on the retail food environment (RFE) and consumer behavior. Using the Retail Food Environment and Customer Interaction Model, we describe the impact of COVID-19 in four key areas: (1) community, state, tribal, and federal policy; (2) retail actors, business models, and sources; (3) customer experiences; and (4) dietary intake. We discuss how previously existing vulnerabilities and inequalities based on race, ethnicity, class, and geographic location were worsened by the pandemic. We recommend approaches for building a more just and equitable RFE, including understanding the impacts of changing shopping behaviors and adaptations to federal nutrition assistance as well as how small food business can be made more sustainable. By better understanding the RFE adaptations that have characterized the COVID-19 pandemic, we hope to gain greater insight into how our food system can become more resilient in the future.