The Truong Son orogenic belt (TSOB) is one of the most important orogenic belts in the Indochina block. There are numerous mafic to felsic intrusions in the Early Paleozoic caused by the Tethyan orogeny. However, the tectono-magmatic evolution of the TSOB in the Early Paleozoic is still unclear. In this paper, zircon U-Pb dating, whole-rock geochemistry, and the Sr-Nd isotopic data of the Early Paleozoic magmatic rocks have been systematically investigated to explore the petrogenesis and tectonic significance of these rocks in the TSOB. Based on our new results integrated with previous geological data, four major tectono-magmatic episodes are identified. (1) The Middle Cambrian (~507 Ma) is the early stage of northward subduction of the Tamky-Phuoc Son Ocean. (2) The Early Ordovician to Middle Ordovician (483–461 Ma) is the main subduction stage of the Tamky-Phuoc Son Ocean. The intrusive rock associations imply the closure of the Tamky-Phuoc Son Ocean. (3) The Late Ordovician to Early Silurian (461–438 Ma) is the collision stage of the Kontum massif and Truong Son terrane. (4) The Early Silurian to Late Silurian (438–410 Ma) is the late stage of collision accompanied by slab roll-back.