The origin of ultramafic rocks, especially those in suture zones, has been a focus because they are not only important mantle sources of magma, but also provide substantial information on metamorphism and melt/fluid–peridotite interaction. Ultramafic rocks in Hujialin, in the central part of the Sulu orogen, include peridotite and pyroxenite. Although many papers on their origin and tectonic evolution have been published in the past few decades, these questions are still highly debated. Here, we present mineralogy, mineral composition, and bulk-rocks of these ultramafic rocks to evaluate their origin and tectonic evolution. The garnet clinopyroxenite is low in heavy rare-earth elements (HREE, 5.97–10.6 ppm) and has convex spoon-shaped chondrite-normalized REE patterns, suggesting the garnet formed later, and its precursor is clinopyroxenite. It is high in incompatible elements (i.e., Cs, Rb, Ba) and shows negative to positive U, Nb, and Ta anomalies, without pronounced positive Sr or Eu anomalies. Clinopyroxene in garnet clinopyroxenite contains high MgO (Mg# 0.90–0.97). The mineral chemistry and bulk-rock compositions are similar to those of reactive clinopyroxenite, suggesting that it originally formed via peridotite–melt interaction, and that such silicic and calcic melt might derive from the subducted Yangtze continent (YZC). Dunite contains olivine with high Fo (93.0–94.1), low NiO (0.11–0.29 wt.%) and MnO (≤0.1 wt.%), chromite with high Cr# (0.75–0.96), TiO2 (up to 0.88 wt.%), and Na2O (0.01–0.10 wt.%). It has negatively sloped chondrite-normalized REE patterns. Mineral chemistry and bulk rocks suggest dunite likely represent residual ancient lithosperic mantle peridotite beneath the North China Craton (NCC) that was overprinted by aqueous fluids. The lack of prograde and retrograde metamorphic minerals in dunite and irregular shaped mineral inclusions in chromite suggest dunite did not subduct to deep levels. Dunite mingled with garnet clinopyroxenite during exhumation of the latter at shallow depths. These ultramafic rocks, especially hydrated peridotite, may be important sources of Au for the Jiaodong gold province in the NCC.