The presence of the anti-SARS-CoV-2-RBD antibody (anti-RBD) prevents severe COVID-19. We aimed to determine the accuracy of a point-of-care anti-RBD testing implemented in persons living with HIV (PLWH), systemic lupus erythematosus (SLE), and chronic kidney disease (CKD). We enrolled 182 non-comorbid subjects and 335 comorbid subjects (PLWH, SLE, CKD) to test the anti-RBD assay compared to the surrogate viral neutralization test (sVNT) as the reference test. We performed linear correlation analysis between anti-RBD and sVNT, along with an ROC analysis to ascertain the anti-RBD cutoff at 30%, 60%, and 90% inhibition of sVNT, to calculate accuracy. The correlations between anti-RBD and sVNT among all groups were excellent, with R = 0.7903, R = 0.7843, and R = 0.8153 among the non-comorbid, SLE, and CKD groups, respectively, and with significantly higher correlation among the PLWH group (R = 0.8877; p-value = 0.0072) compared to the non-comorbid group. The accuracy of the anti-RBD test among the PLWH and CKD groups was similar to that among the non-comorbid group but showed lower sensitivity in the SLE group (p = 0.000014). The specificity of the test remained high in all groups. In conclusion, the anti-RBD test had excellent correlation with the sVNT. The persistently high specificity in all groups suggests that this test can be reliably utilized to detect the presence of low neutralization capacity, prompting additional vaccination.