The tectonic evolution of the Qinling Orogenic Belt in the Late Paleozoic has long been controversial, especially due to the limitation of the Mianlue Ocean subduction time. Basin formation and sedimentary development in the southern North China Block are closely related to the tectonic evolution of the Qinling Orogenic Belt, which is an effective entry point to study basin–mountain interaction. We present new detrital zircon U–Pb data from the Shihezi Formation in the Luonan area in the southern margin of the North China Block. The results show that the bottom sample has two major peaks at 288 Ma and 448 Ma, with weak peaks at 908, 1912 Ma and 2420 Ma. The top sample has one major peak at 297 Ma, with weak peaks at 1933 Ma and 2522 Ma. Combined with the published paleocurrent data and lithofacies paleogeography, the sediments of the bottom sample were sourced from the North Qinling Belt, Inner Mongolia Palaeo-Uplift and the basement of the North China Block. The top sample originated mainly from the Inner Mongolia Palaeo-Uplift and the basement of the North China Block. Comparing the obtained zircon U-Pb ages with the published relevant data in the North China Block, it is found that the provenance area shifted from the Qinling Orogenic Belt to the Inner Mongolia Paleo-Uplift in the Late Carboniferous–Permian, and the Qinling Orogenic Belt could hardly provide provenance for the southern North China Block in the Middle Permian. The uplift of the Qinling Orogenic Belt in the Late Carboniferous may be the continuation of Caledonian orogeny in the Early Paleozoic, whereas the uplift of the Inner Mongolia Palaeo-Uplift is related to the tectonic evolution of the Central Asian Orogenic Belt during the Late Paleozoic. This tectonic transformation occurred when the Qinling Orogenic Belt no longer supplied sediments to the southern North China Block in the Middle Permian, and the Mianlue Ocean subduction did not occur until at least the Late Permian.