Water is vital for mammals. Yet, as ephemeral sources can be difficult to find, it raises the question, how do mammals locate water? Elephants (Loxodonta africana) are water-dependent herbivores that possess exceptional olfactory capabilities, and it has been suggested that they may locate water via smell. However, there is no evidence to support this claim. To explore this, we performed two olfactory choice experiments with semi-tame elephants. In the first, we tested whether elephants could locate water using olfactory cues alone. For this, we used water from two natural dams and a drinking trough utilised by the elephants. Distilled water acted as a control. In the second, we explored whether elephants could detect three key volatile organic compounds (VOCs) commonly associated with water (geosmin, 2-methylisoborneol, and dimethyl sulphide). We found that the elephants could locate water olfactorily, but not the distilled water. Moreover, they were also able to detect the three VOCs associated with water. However, these VOCs were not in the odour profiles of the water sources in our experiments. This suggests that the elephants were either able to detect the unique odour profiles of the different water sources or used other VOCs that they associate with water. Ultimately, our findings indicate that elephants can locate water olfactorily at small spatial scales, but the extent to which they, and other mammals, can detect water over larger scales (e.g. km) remains unclear.