Two-sample MR is an increasingly popular method for strengthening causal inference in epidemiological studies. For the effect estimates to be meaningful, the studies used to estimate the variant-exposure and variant-outcome associations must come from comparable populations. A recent systematic review of two-sample MR studies found that, if assessed at all, MR studies assessed this assumption by checking that the genetic association studies had similar demographics. However, it is unclear if this is sufficient because less easily accessible factors, such as the prevalence of smoking for a lung cancer MR study, may also be important. Our letter therefore proposes an easy to implement falsification test which to the best of our knowledge is the first quantitative method for assessing this assumption. Since recent theoretical developments in causal inference suggest that a casual effect estimate can generalise from one study to another if there is exchangeability of effect modifiers, we suggest testing the homogeneity of variant-phenotype associations for a phenotype which has been measured in both genetic association studies as a method of exploring the ‘same-population’ test. We additionally developed a simple R package to facilitate the implementation of this test.