Background: Effective triage and early detection are very important for the control and treatment of coronavirus disease 2019. For this purpose, reverse transcription polymerase chain reaction and chest computed tomography are used in emergency departments. Objective: The aim of the study was to examine the diagnostic performance of computed tomography and to compare the inter-observer agreement among radiologists and between clinicians, in a coronavirus disease 2019 pneumonia high-prevalence area. Methods: After exclusions, 534 patients were retrospectively included in this study. Reverse transcription polymerase chain reaction was considered as gold standard for diagnosis. All computed tomography images were independently reviewed by two radiologists who were blinded to reverse transcription polymerase chain reaction results and other clinical information. Each computed tomography scan was scored in four categories as typical, intermediate, atypical, and negative, regarding coronavirus disease 2019 pneumonia according to Radiological Society of North America guideline. As for the evaluation of the diagnostic performance, typical and intermediate appearances were accepted as positive for coronavirus disease 2019. In addition, the computed tomography scans were scored by two clinicians as coronavirus disease 2019 positive and negative. Results: The study group included 534 patients after the exclusion criteria. As a result of the repeated reverse transcription polymerase chain reaction tests, 396 (74%) patients were diagnosed with coronavirus disease 2019, 138 (26%) patients had a negative result and were evaluated as a control group. When the reverse transcription polymerase chain reaction results were referenced as the gold standard; the accuracy rates of radiologists and clinicians (R1, R2, C1, and C2) in the diagnosis of coronavirus disease 2019 were 78%, 79%, 73%, and 71%, their sensitivity rates were 83%, 83%, 74%, and 75%, and the negative predictive values were 57%, 58%, 49%, and 46%, respectively. Inter-observer agreements among the reviewers ranged from good to excellent. Conclusions: Radiological Society of North America guideline related to coronavirus disease 2019 has excellent inter-observer agreement among chest radiologists. In this study, radiologists and clinicians have presented similar and good diagnostic performances in the evaluation of coronavirus disease 2019–suspected patients with chest computed tomography in high-epidemic area.