Although its international airports served as the country's main entry points for SARS-CoV-2, the factors driving the uneven geographic spread of COVID-19 cases and deaths in Brazil remain largely unknown. Here we show that four major factors likely accounted for the entire dynamics of COVID-19 in Brazil. Mathematical modeling revealed that, initially, the "super-spreading" city of São Paulo accounted for roughly 80% of the case spread in the entire country. During the first 3 months of the epidemic, by adding only 16 other spreading cities, we accounted for 98-99% of the cases reported in Brazil at the time. Moreover, 26 of the major Brazilian federal highways accounted for about 30% of SARS-CoV-2's case spread. As cases accumulated rapidly in the Brazilian countryside, the distribution of COVID-19 deaths began to correlate with a third parameter: the geographic distribution of the country's hospital intensive care unit (ICU) beds, which is highly skewed towards state capitals where the epidemic began. That meant that severely ill patients living in the countryside had to be transported to state capitals to access ICU beds where they often died, creating a "boomerang effect" that contributed to the skew of the geographic distribution of COVID-19 deaths. Finally, we discovered that the geographic distribution of dengue fever, amounting to more than 3.5 million cases from January 2019 to July 2020, was highly complementary to that of COVID-19. This was confirmed by the identification of significant negative correlations between COVID-19's incidence, infection growth rate, and mortality to the percentage of people with antibody (IgM) levels for dengue fever in each of the country's states. No such correlations were observed when IgM data for chikungunya virus, which is transmitted by the same mosquito vector as dengue, was used. Thus, states in which a large fraction of the population had contracted dengue fever in 2019-2020 reported lower COVID-19 cases and deaths, and took longer to reach exponential community transmission, due to slower SARS-CoV-2 infection growth rates. This inverse correlation between COVID-19 and dengue fever was further observed in a sample of countries around Asia and Latin America, as well as in islands in the Pacific and Indian Oceans. This striking finding raises the intriguing possibility of an immunological cross-reactivity between DENV serotypes and SARS-CoV-2. If proven correct, this hypothesis could mean that dengue infection or immunization with an efficacious and safe dengue vaccine could produce some level of immunological protection for SARS-CoV-2, before a vaccine for SARS-CoV-2 becomes available.