The skin is constantly exposed to a variety of environmental threats. Therefore, the influence of environmental factors on skin damage has always been a matter of concern. This study aimed to investigate the cytotoxic effects of different environmental factors, including cooking oil fumes (COFs), haze (PM2.5), and cigarette smoke (CS), on epidermal HaCaT cells and dermal fibroblast (FB) cells. Cell viability, intracellular reactive oxygen species (ROS) generation, inflammatory cytokine levels, and collagen mRNA expression were used as toxicity endpoints. Additionally, the effects of ozone (O3) on cell viability and release of inflammatory cytokines in 3D epidermal cells were also examined. The results showed that the organic extracts of CS, COFs, and PM2.5 significantly inhibited the viability of HaCaT and FB cells at higher exposure concentrations. These extracts also increased intracellular ROS levels in FB cells. Furthermore, they significantly promoted the release of inflammatory cytokines, such as IL-1α and TNF-α, in HaCaT cells and down-regulated the mRNA expression of collagen I, III, IV, and VII in FB cells. Comparatively, SC organic extracts exhibited stronger cytotoxicity to skin cells compared to PM2.5 and COFs. Additionally, O3 at all test concentrations significantly inhibited the viability of 3D epidermal cells in a concentration-dependent manner and markedly increased the levels of TNF-α and IL-1α in 3D epidermal cells. These findings emphasize the potential cytotoxicity of COFs, PM2.5, CS, and O3 to skin cells, which may lead to skin damage; therefore, we should pay attention to these environmental factors and take appropriate measures to protect the skin from their harmful effects.