To reconstruct the detailed location of proto‐Japan around northeastern Gondwana during the early Palaeozoic, this article presents detrital zircon U–Pb age spectra for lower Palaeozoic metamorphic complexes and Silurian–Devonian strata from the western margin of the South Kitakami belt in northeast Japan. Psammitic and siliceous schists have youngest age peaks ranging from the Ordovician (479–458 Ma) to early Silurian (ca. 439 Ma). Sandstones have youngest age peaks varying from the early Silurian (ca. 435 Ma) to Late Devonian (370–360 Ma). The U–Pb age spectra exhibit major peaks at 510–500, 480–470, and 450–440 Ma. Excluding the Upper Devonian sandstones, significant age peaks occur at 650–550 and 1300–900 Ma. These data can be interpreted as a Pacific Gondwana signature, indicating a tectonic association with the Terra Australis Orogen that developed along the northeastern Gondwanan margin and Paleo‐Pacific Ocean, extending from eastern Australia (i.e., the Thomson, Lachlan, and Delamerian orogens) to Antarctica (i.e., the Ross Orogen). In northeast Asia, the Pacific Gondwana detrital zircons and 480–470 Ma zircons occur in the Bainaimiao arc belt along the northern margin of the North China Craton and in the Jiangyu continental arc in the Jilin area. The magmatic arcs of proto‐Japan and these regions were part of the Terra Australis Orogen during the Ordovician–early Silurian. A decrease in the proportion of Pacific Gondwana detrital zircons in Upper Devonian strata may be due to multistage trench retreat, such as that recognized in the Tasmanides in eastern Australia, which corresponds to the northern Terra Australis Orogen.