To clarify the risk posed to groundwater in oil shale in situ mining areas, we examine five leached pollutants: Fe, Mn, Cr, sulfate, and ammonia nitrogen. Potential groundwater contents of these five pollutants were evaluated using an improved Nemero comprehensive index method and a health risk assessment method. The results show that, compared with the Class III groundwater quality standard (GB/T 14848-2017) used in the People’s Republic of China, average values of Fe, Mn, and sulfate in leaching solution from Fuyu oil shale exceed the standard, while Cr and ammonia nitrogen do not exceed the standard, and the leaching solution is within Class V groundwater quality. The average values of Fe and Mn in the leaching solution from Fushun oil shale exceed the Class III standard, while Cr, sulfate, and ammonia nitrogen values from this oil shale do not exceed the standard, and the leaching solution is Class IV in terms of groundwater quality. The weighting value used in the Nemero assessment method for the heavy metal Cr is the largest as its potential to cause harm to groundwater quality is the largest. The weight value for sulfate is the smallest as the harm degree is the smallest. The chemical carcinogen Cr has the greatest potential impact on human health. The health risk caused by the chemical non-carcinogen Mn is greater than that caused by Fe and ammonia nitrogen. When high pyrolysis temperatures are used, Mn will be released into groundwater in large quantities. Therefore, supervision and control should be strengthened. The results presented here can provide a reference for the comprehensive evaluation of groundwater risks caused by in situ oil shale mining.