SARS-CoV-2 causes a wide spectrum of clinical manifestations and significant mortality. Studies investigating underlying immune characteristics are needed to understand disease pathogenesis and inform vaccine design. In this study, we examined immune cell subsets in hospitalized and non-hospitalized individuals. In hospitalized patients, many adaptive and innate immune cells were decreased in frequency compared to healthy and convalescent individuals, with the exception of B lymphocytes which increased. Our findings show increased frequencies of T-cell activation markers (CD69, Ox40, HLA-DR and CD154) in hospitalized patients, with other T-cell activation/exhaustion markers (CD25, PD-L1 and TIGIT) remaining elevated in hospitalized and non-hospitalized individuals. B cells had a similar pattern of activation/exhaustion, with increased frequency of CD69 and CD95 during hospitalization, followed by an increase in PD1 frequencies in non-hospitalized individuals. Interestingly, many of these changes were found to increase over time in non-hospitalized longitudinal samples, suggesting a prolonged period of immune dysregulation following SARS-CoV-2 infection. Changes in T-cell activation/exhaustion in non-hospitalized patients were found to positively correlate with age. Severely infected individuals had increased expression of activation and exhaustion markers. These data suggest a prolonged period of immune dysregulation following SARS-CoV-2 infection highlighting the need for additional studies investigating immune dysregulation in convalescent individuals.