Background: A pandemic poses a significant challenge to the healthcare staff and infrastructure. We studied the prevalence of anxiety and depressive symptoms among armed forces doctors in India during the COVID-19 pandemic and the factors that contribute to these symptoms. Methods: The study was conducted from March 30, 2020, to April 2, 2020, using a self-administered questionnaire questionnaire using the hospital anxiety and depression scale (HADS), which was sent through Google Forms. Responses were received from 769 respondents. Data were analyzed for demographic details and HADS scores using the chi-square test and backward logistic regression. Results: Anxiety and depressive symptoms were seen in 35.2% and 28.2% of the doctors, respectively. In doctors with anxiety symptoms, significant associations were observed with age (20–35 years, 39.4%, P = 0.01), gender (females, 44.6%, P < 0.001), duration of service (0–10 years, 38%, P = 0.03), and clinical versus non-clinical specialties (non-clinical, 41.3%, P < 0.001) as opposed to marital status, education level, and current department of work. In doctors with depressive symptoms, significant associations were observed with age (P = 0.04), clinical versus non-clinical specialties (P < 0.001), duration of service (0–10 years, 30.1%, P = 0.03), and doctoral degree (P = 0.04) as opposed to gender, marital status, education level, and current working department. Conclusion: The study revealed a high prevalence of anxiety and depressive symptoms among armed forces doctors. The main contributing factors are female gender, young age group, non-clinical specialties, and having a doctoral degree.