Seroprevalence studies of COVID-19 are used to assess the degree of undetected transmission in the community and different groups such as health care workers (HCWs) are deemed vulnerable due to their workplace hazards. The present study estimated the seroprevalence and quantified the titer of anti-SARS-CoV-2 antibody (IgG) and its association with different factors. This cross-sectional study observed HCWs, in indoor and outdoor patients (non-COVID-19) and garment workers in the Chattogram metropolitan area (CMA, N = 748) from six hospitals and two garment factories. Qualitative and quantitative ELISA were used to identify and quantify antibodies (IgG) in the serum samples. Descriptive, univariable, and multivariable statistical analysis were performed. Overall seroprevalence and among HCWs, in indoor and outdoor patients, and garment workers were 66.99% (95% CI: 63.40–70.40%), 68.99% (95% CI: 63.8–73.7%), 81.37% (95% CI: 74.7–86.7%), and 50.56% (95% CI: 43.5–57.5%), respectively. Seroprevalence and mean titer was 44.47% (95% CI: 38.6–50.4%) and 53.71 DU/mL in the non-vaccinated population, respectively, while it was higher in the population who received a first dose (61.66%, 95% CI: 54.8–68.0%, 159.08 DU/mL) and both doses (100%, 95% CI: 98.4–100%, 255.46 DU/mL). This study emphasizes the role of vaccine in antibody production; the second dose of vaccine significantly increased the seroprevalence and titer and both were low in natural infection.