Knowledge is limited as to how prior SARS-CoV-2 infection influences cellular and humoral immunity after booster-vaccination with bivalent BA.4/5-adapted mRNA-vaccines, and whether vaccine-induced immunity may indicate subsequent infection. In this observational study, individuals with prior infection (n = 64) showed higher vaccine-induced anti-spike IgG-antibodies and neutralizing titers, but the relative increase was significantly higher in non-infected individuals (n = 63). In general, both groups showed higher neutralizing activity towards the parental strain than towards Omicron-subvariants BA.1, BA.2 and BA.5. In contrast, CD4 or CD8 T cell levels towards spike from the parental strain and the Omicron-subvariants, and cytokine expression profiles were similar irrespective of prior infection. Breakthrough infections occurred more frequently among previously non-infected individuals, who had significantly lower vaccine-induced spike-specific neutralizing activity and CD4 T cell levels. In summary, we show that immunogenicity after BA.4/5-bivalent vaccination differs between individuals with and without prior infection. Moreover, our results may help to improve prediction of breakthrough infections.