The Coronavirus Disease 2019 (COVID-19), caused by the novel SARS-CoV-2, continues to spread globally with significantly high morbidity and mortality rates. Immunological surrogate markers, in particular antigen-specific responses, are of unquestionable value for clinical management of patients with COVID-19. Here, we investigated the kinetics of IgM, IgG against the spike (S) and nucleoproteins (N) proteins and their neutralizing capabilities in hospitalized patients with RT-PCR confirmed COVID-19 infection. Our data show that SARS-CoV-2 specific IgG, IgM and neutralizing antibodies (nAbs) were readily detectable in almost all COVID-19 patients with various clinical presentations. Notably, anti-S and -N IgG, peaked 20-40 day after disease onset, and were still detectable for at least up to 70 days, with nAbs observed during the same time period. Moreover, nAbs titers were strongly correlated with IgG antibodies. Significantly higher levels of nAbs as well as anti-S1 and N IgG and IgM antibodies were found in patients with more severe clinical presentations, patients requiring admission to intensive care units (ICU) or those with fatal outcomes. Interestingly, lower levels of antibodies, particularly anti-N IgG and IgM in the first 15 days after symptoms onset, were found in survivors and those with mild clinical presentations. Collectively, these findings provide new insights into the characteristics and kinetics of antibody responses in COVID-19 patients with different disease severity.