P‐glycoprotein (P‐gp) is an efflux pump implicated in pharmacokinetics and drug–drug interactions. The identification of its substrates is consequently an important issue, notably for drugs under development. For such a purpose, various in silico methods have been developed, but their relevance remains to be fully established. The present study was designed to get insight about this point, through determining the performance values of six freely accessible Web‐tools (ADMETlab, AdmetSAR2.0, PgpRules, pkCSM, SwissADME and vNN‐ADMET), computationally predicting P‐gp‐mediated transport. Using an external test set of 231 marketed drugs, approved over the 2010–2020 period by the US Food and Drug Administration and fully in vitro characterized for their P‐gp substrate status, various performance parameters (including sensitivity, specificity, accuracy, Matthews correlation coefficient and area under the receiver operating characteristics curve) were determined. They were found to rather poorly meet criteria commonly required for acceptable prediction, whatever the Web‐tools were used alone or in combination. Predictions of being P‐gp substrate or non‐substrate by these online in silico methods may therefore be considered with caution.