The Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) has caused the Coronavirus Disease 2019 (COVID-19) worldwide pandemic in 2020. In response, most countries in the world implemented lockdowns, restricting their population's movements, work, education, gatherings, and general activities in attempt to “flatten the curve” of COVID-19 cases. The public health goal of lockdowns was to save the population from COVID-19 cases and deaths, and to prevent overwhelming health care systems with COVID-19 patients. In this narrative review I explain why I changed my mind about supporting lockdowns. The initial modeling predictions induced fear and crowd-effects (i.e., groupthink). Over time, important information emerged relevant to the modeling, including the lower infection fatality rate (median 0.23%), clarification of high-risk groups (specifically, those 70 years of age and older), lower herd immunity thresholds (likely 20–40% population immunity), and the difficult exit strategies. In addition, information emerged on significant collateral damage due to the response to the pandemic, adversely affecting many millions of people with poverty, food insecurity, loneliness, unemployment, school closures, and interrupted healthcare. Raw numbers of COVID-19 cases and deaths were difficult to interpret, and may be tempered by information placing the number of COVID-19 deaths in proper context and perspective relative to background rates. Considering this information, a cost-benefit analysis of the response to COVID-19 finds that lockdowns are far more harmful to public health (at least 5–10 times so in terms of wellbeing years) than COVID-19 can be. Controversies and objections about the main points made are considered and addressed. Progress in the response to COVID-19 depends on considering the trade-offs discussed here that determine the wellbeing of populations. I close with some suggestions for moving forward, including focused protection of those truly at high risk, opening of schools, and building back better with a economy.