The Late Miocene global cooling (LMGC; approximately 7.9–5.8 Ma) was associated with remarkable changes in monsoon dynamics, biogenic bloom in the global oceans, and the rise of modern ecosystems at the expense of old biota. However, the possible linkage between the environmental changes and ecosystem shifts during the LMGC is still debated. In this paper, we show the high-resolution changes in the fluxes of selected radiolarian species, suggesting a drastic reorganization in the paleoceanography and ecosystem in the Japan Sea during the LMGC. The endemic radiolarian Cycladophora nakasekoi dominated the Japan Sea until 7.4 Ma when the Japan Sea sediment changed from dark radiolarian-rich sediment to organic-poor diatom ooze. Changes in the fluxes of C. nakasekoi and Tricolocapsa papillosa, the latter related to changes in the Pacific central water (PCW), show 100, 200, and ~ 500 ka cycles with their high flux mostly within the darker sediment intervals during the low-eccentricity period until 7.4 Ma, suggesting that orbitally paced PCW inflow might have been the major nutrient source into the Japan Sea. At about 7.4 Ma, these species decreased at the expense of increased Larcopyle weddellium, a radiolarian related to the North Pacific intermediate water (NPIW), and Cycladophora sphaeris, a subarctic radiolarian species, implying a decrease in PCW inflow and an increase in the inflow of NPIW and subarctic shallow water. Such a change would have been related to the LMGC-induced weakening in the Pacific Meridional overturning circulation and the southward shift of the subarctic front due to intensified East Asian winter monsoon. Such a drastic reorganization in the hydrography in the Japan Sea probably caused changes in nutrient provenance from the PCW to the NPIW and resulted in faunal turnover, marked by the disappearance of the old regional and endemic faunal components, such as C. nakasekoi.