Mining and smelting activities engender soil contamination by metals severely. A field survey was conducted to investigate the present situation and health risk of heavy metals (Cd, Pb, Zn, Cu, Cr, As, and Hg) in soils and vegetables in the surrounding area of an 80-year-old zinc smelter in northeastern China. Soil pH, organic matter (SOM), and cation exchange capacity (CEC) were determined, and their relations with heavy metal contents in edible parts of vegetables were analyzed. Results showed that the smelting had led to the significant contamination of the local soils by Cd and Zn, with average concentrations of 3.88 and 403.89 mg kg, respectively. Concentrations of Cd and Zn in greenhouse soils were much lower than those in open farmland soils. Cd concentrations in vegetable edible parts exceeded the permissible limits severely, while other metal concentrations were much lower than the corresponding standards. Leaf and root vegetables had higher concentrations and bioaccumulation factors (BCFs) of Cd than fruit vegetables. Hazard quotient and hazard index showed that cadmium is imposing a health risk to local residents via vegetable consumption. Cd uptake of some vegetables can be predicted by empirical models with the following parameters: soil pH, SOM, CEC, Zn concentrations, and Cd concentrations. Vegetables such as cabbage, Chinese cabbage, tomato, cucumber, and green bean were screened out as being suitable to grow in the studied area.