The aim of this study was to compare the diagnostic accuracy of nasal sampling using a novel anterior nasal swab (ANS) (Rhinoswab) versus combined oro-nasopharyngeal (OP/NP) sampling in COVID-19 suspected patients. This prospective observational study was performed from 11 November to 2 December 2021 (part 1), and from 16 January to 22 February 2022 (part 2). Adult patients who attended the emergency room with suspected COVID-19 were asked to participate. One ANS and one OP/NP sample were consecutively collected, and both were analyzed via reverse transcription polymerase chain reaction (RT-PCR). The result of the OP/NP sample was considered to be the reference standard. A total of 412 patients were included, of whom 171 (41.5%) had a positive RT-PCR of the OP/NP swab, whereas 139 (33.7%) were positive on the ANS sample. The overall diagnostic accuracy for ANS sampling in terms of sensitivity, specificity, positive predictive value, and negative predictive value was 80.7% (95% CI 73.8–86.2), 99.6% (95% CI 97.3–100), 99.3% (95% CI 95.5–100), and 87.9% (95% CI 83.3–91.4), respectively. In conclusion, ANS sampling with the Rhinoswab identified 80.7% of all presented COVID-19 patients in an emergency department. Future studies should investigate if nasal Rhinoswab self-sampling is suitable for reliable diagnosis of COVID-19 in an outpatient setting.