The Interstellar Medium (ISM) comprises gases at different temperatures and densities, including ionized, atomic, molecular species, and dust particles [1]. The neutral ISM is dominated by neutral hydrogen [2] and has ionization fractions up to 8% [3]. The concentration of chemical elements heavier than helium (metallicity) spans orders of magnitudes in Galactic stars [4], because they formed at different times. Instead, the gas in the Solar vicinity is assumed to be well mixed and have Solar metallicity in traditional chemical evolution models [5]. The ISM chemical abundances can be accurately measured with UV absorption-line spectroscopy. However, the effects of dust depletion [6,7,8,9], which removes part of the metals from the observable gaseous phase and incorporates it into solid grains, have prevented, until recently, a deeper investigation of the ISM metallicity. Here we report the dust-corrected metallicity of the neutral ISM measured towards 25 stars in our Galaxy. We find large variations in metallicity over a factor of 10 (with an average 55 ± 7% Solar and standard deviation 0.28 dex) and including many regions of low metallicity, down to ∼ 17% Solar and possibly below. Pristine gas falling onto the disk in the form of high-velocity clouds can cause the observed chemical inhomogeneities on scales of tens of pc. Our results suggest that this low-metallicity accreting gas does not efficiently mix into the ISM, which may help us understand metallicity deviations in nearby coeval stars.