A novel paper-based potentiometric platform for the simple and fast monitoring of water hardness is presented. First, potentiometric ion-selective electrodes for calcium and magnesium printed on a paper substrate were built and optimized. These sensors, which display near-Nernstian sensitivity, were used for the determination of the concentration of these cations and the calculation of the water hardness. Second, the incorporation of a solid-state reference electrode allowed building an integrated paper-based potentiometric cell for the determination of the hardness of artificial and real samples (mineral waters). The validation of the results shows good ability to predict hardness in the conventional scale. Truly decentralized measurements were demonstrated by integration of a miniaturized instrument and dedicated software in a portable device. The measurements were able to be performed in just under two minutes, including a two-point calibration. Since the method is simple to use and cost-effective, it can be implemented in domestic and industrial settings.