A nationwide survey of inorganic components of tap water all over Japan was conducted from 2019 to 2024. In this survey, 1564 tap water samples were collected, and an additional 194 tap water samples were collected from 33 other countries. The water samples were analyzed for 27 dissolved inorganic components, with a primary focus on the distribution of major and trace components, including Ca, Mg, K, Na, Cl−, NO3−, SO42−, total-hardness, Al, Fe, Cu, Mn, and Zn. The Japanese tap water hardness was 50.5 ± 30.2 (± 1σ SD) mg/L, classified as soft water according to the World Health Organization (WHO) classification. The average content of each major component in Japanese tap water tended to be lower than those in other countries. Furthermore, Piper trilinear diagrams were used to categorize Japanese tap water types. The dominating water types were the Ca–HCO3 and mixed types, which had a nationwide distribution. Japanese tap water generally complied with Japanese and WHO drinking water criteria, with only 1% (17/1564 sites) of the samples exceeding water quality standards. Observations of water quality changes for 2 years at three household faucets revealed that fluctuations in major components and trace metals (Al, Fe, Cu, Mn, and Zn) varied in different patterns. This suggests that the behavior of trace metal elements is influenced by local infrastructure, such as supply pipes, distinct from the variability in source water quality.