Electrochemical sensors play a significant role in detecting chemical ions, molecules, and pathogens in water and other applications. These sensors are sensitive, portable, fast, inexpensive, and suitable for online and in-situ measurements compared to other methods. They can provide the detection for any compound that can undergo certain transformations within a potential window. It enables applications in multiple ion detection, mainly since these sensors are primarily non-specific. In this paper, we provide a survey of electrochemical sensors for the detection of water contaminants, i.e., pesticides, nitrate, nitrite, phosphorus, water hardeners, disinfectant, and other emergent contaminants (phenol, estrogen, gallic acid etc.). We focus on the influence of surface modification of the working electrodes by carbon nanomaterials, metallic nanostructures, imprinted polymers and evaluate the corresponding sensing performance. Especially for pesticides, which are challenging and need special care, we highlight biosensors, such as enzymatic sensors, immunobiosensor, aptasensors, and biomimetic sensors. We discuss the sensors’ overall performance, especially concerning real-sample performance and the capability for actual field application.