Permeability barrier function is measured with instruments that assess transepidermal water loss (TEWL), either with closed- or open-loop systems. Yet, the validity of TEWL as a measure of barrier status has been questioned recently. Hence, we tested the validity of this measure by comparing TEWL across a wide range of perturbations, with a variety of methods, and in a variety of models. TEWL rates with two closed-chamber systems (VapoMeter and H4300) and one closed-loop system (MEECO) under different experimental in vivo conditions were compared with data from four open-loop instruments, i.e. TM 210, TM 300, DermaLab and EP 1. The instruments were compared in vivo both in humans and hairless mice skin subjected to different degrees of acute barrier disruption. The values obtained with bioengineering systems were correlated with absolute water loss rates, determined gravimetrically. Measurements with both closed and open systems correlated not only with each other, but each method detected different degrees of barrier dysfunction. Although all instruments differentiated among gradations in TEWL in the mid-range of barrier disruption in vivo, differences in very low and very high levels of disruption were less accurately measured with the H4300 and DermaLab systems. Nevertheless, a high Pearson correlation coefficient (r) was calculated for data from all instruments vs. gravimetrically assessed TEWL. Together, these results verify the utility of TEWL as a measure of permeability barrier status. Moreover, all tested instruments are reliable tools for the assessment of variations in permeability barrier function.