The smart management of water resources is an increasingly important topic in today's society. In this context, the paradigm of Smart Water Grids (SWGs) aims at a constant monitoring through a network of smart nodes deployed over the water distribution infrastructure. In such a way, a continuous assessment of water quality and state of health of the pipeline infrastructure can be achieved, allowing an early detection of leaks and water contamination. Acoustic wave-based technology has arisen as a viable communication technique among the nodes of the network. Such technology can be suitable to replace traditional wireless networks in SWGs, as the acoustic channel is intrinsically embedded in the water supply network. However, the fluid-filled pipe is one of the most challenging media to be employed for data communication. This paper aims at reviewing those works dealing with acoustic-based communication networks in real large-scale urban water supply networks. An overview on the characteristics, trends and design challenges of existing works is provided as a guideline for future research.