A highly transmittable and pathogenic viral infection, COVID-19, has dramatically changed the world with a tragically large number of human lives being lost. The epidemic has created psychological resilience and unbearable psychological pressure among patients and health professionals. The objective of this study is to analyze investor psychology and stock market behavior during COVID-19. The psychological behavior of investors, whether positive or negative, toward the stock market can change the picture of the economy. This research explores Shanghai, Nikkei 225, and Dow Jones stock markets from January 20, 2020, to April 27, 2020, by employing principal component analysis. The results showed that investor psychology was negatively related to three selected stock markets under psychological resilience and pandemic pressure. The negative emotions and pessimism urge investors to cease financial investment in the stock market, and consequently, the stock market returns decreased. In a deadly pandemic, the masses were more concerned about their lives and livelihood and less about wealth and leisure. This research contributes to the literature gap of investors’ psychological behavior during a pandemic outbreak. The study suggests that policy-makers should design a plan to fight against COVID-19. The government should manage the health sector’s budget to overcome future crises.