In order to understand the risk of heavy metals in sediments of the rivers flowing into Nansi Lake, 36 surface sediments were sampled from six rivers and seven heavy metals (Cr, Cu, Ni, Zn, As, Pb, and Cd) were determined. Potential ecological risk index (RI) of the six rivers showed significant differences: Xinxue River, Jiehe River, and Guangfu River were at medium potential risk, whereas the risk of Chengguo River was the lowest. Jiehe River, Xuesha River, and Jiangji River were meeting the medium potential risk at river mouths. Geo-accumulation index (I ) of the seven heavy metals revealed that the contamination of Cu and Cd was more serious than most other metals in the studied areas, whereas Cr in most sites of our study was not polluted. Moreover, correlation cluster analysis demonstrated that the contamination of Cu, Ni, and Zn in six rivers was mainly caused by local emissions, whereas that of As, Pb, and Cd might come from the external inputs in different forms. Consequently, the contamination of Cu and Cd and the potential risk in Xinxue River, Jiehe River, and Guangfu River as well as the local emissions should be given more attention to safeguard the water quality of Nansi Lake and the East Route Project of South to North Water Transfer.