Background and objectives Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has been the cause of a worldwide outbreak of respiratory illness, which has been declared as coronavirus disease 2019 (COVID-19) pandemic by the World Health Organization (WHO). The outbreak has posed a huge challenge to countries around the world and has resulted in a global lockdown. The pandemic has especially overburdened the healthcare sector, resulting in a shortage of personnel and equipment. Along with many other manifestations, it has resulted in stress and anxiety for the physicians as well. Furthermore, many healthcare workers have been reluctant in treating COVID-19 patients. This study aimed to explore the concerns of physicians in the context of the COVID-19 pandemic and to evaluate the reasons for their reluctance to treat the patients. Methodology This descriptive cross-sectional study included 235 physicians from seven hospitals of Pakistan who were actively working amid the COVID-19 pandemic. Data were collected from March 1, 2020, to May 30, 2020, using a structured online questionnaire. Participants were approached via non-probability convenient sampling. Two hundred and eight respondents were included in the data analysis. SPSS Statistics version 23.0 (IBM Corp., Armonk, NY) was used for data entry and analysis.