Various occupational and environmental substances alter the cellular and molecular function of the human lymphoid system. For example, silicosis patients who have been chronically exposed to silica particles often complicate with autoimmune diseases such as rheumatoid arthritis and systemic sclerosis. From our investigations, silica particles affect CD4+ responder T cells and regulatory T cells (Tregs), which results in the disruption of autoimmunity. Asbestos fibers are a type of mineral silicate, and patients exposed to asbestos fibers revealed cancers such as mesothelioma and lung cancer. In these cases, asbestos fibers may reduce antitumor immunity. Our results investigating the effect of asbestos on cytotoxic T lymphocyte, natural killer (NK) cells, CD4+ cells, and Tregs revealed a reduction in antitumor immunity. To date, the effects of silica and asbestos on Th17 cells and antigen-presenting cells such as dendritic cells and macrophages remain unclear. Based on these findings, it will be possible to generate earlier detection methods to identify the occurrence of immune alterations in silicosis as well as the appearance of a decreased antitumor immunity in asbestos-exposed populations. Additionally, research efforts should also be directed at discovering and identifying physiological substances from foods, plants, and other sources that can restore the immune status in people exposed to particulate and fibrous substances.