Background: It is difficult to quantify the impact of the COVID-19 pandemic on mental health as many community surveys have limited quality, rely on screening tests to measure mental health conditions and distress, and often use convenience samples. Moreover, robust surveys come mainly from high-income countries. Aim: To measure the prevalence of depressive disorders with onset during the pandemic in a community of a Lower-Middle-income country (LMIC)-Tunisia. Methods: Clinical semi-structured face-to-face interviews were carried out during the pandemic (September–December 2021) by medical doctors among a representative sample of the general population in the governorate of La Manouba, Tunisia. Psychiatric diagnoses were established according to DSM-IV. Results: The prevalence of Major Depressive Disorder (MDD) started or recurred after the pandemic was 5.66%. The factors associated with MDD were loss of job and considerably diminished income due to the pandemic (OR = 2.1, 95% CI [1.5, 2.9]) and the perception of having the family’s financial situation below the Tunisian average (OR = 2.3, 95% CI [1.7, 3.2]). Female sex, marital status as separated/divorced, and having a COVID-19 infection were associated with MDD only in the overall sample and urban areas, but not in rural areas. Age and having loved ones who passed away due to COVID-19 were not associated with MDD. Conclusion: In Tunisia, the pandemic seems to have increased the risk of depression in people experiencing a precarious financial situation, also due to the pre-existing economic crisis. Specific local level factors, such as not establishing a rigid lockdown for an extended period, may have protected young people and allowed for better mourning in families suffering the loss of a loved one.