Landscape genetics aims to assess the effect of the landscape on intraspecific genetic structure. To quantify interdeme landscape structure, landscape genetics primarily uses landscape resistance surfaces (RSs) and least-cost paths or straight-line transects. However, both approaches have drawbacks. Parameterization of RSs is a subjective process, and least-cost paths represent a single migration route. A transect-based approach might oversimplify migration patterns by assuming rectilinear migration. To overcome these limitations, we combined these two methods in a new landscape genetic approach: least-cost transect analysis (LCTA). Habitat-matrix RSs were used to create least-cost paths, which were subsequently buffered to form transects in which the abundance of several landscape elements was quantified. To maintain objectivity, this analysis was repeated so that each landscape element was in turn regarded as migration habitat. The relationship between explanatory variables and genetic distances was then assessed following a mixed modelling approach to account for the nonindependence of values in distance matrices. Subsequently, the best fitting model was selected using the statistic. We applied LCTA and the mixed modelling approach to an empirical genetic dataset on the endangered damselfly, Coenagrion mercuriale. We compared the results to those obtained from traditional least-cost, effective and resistance distance analysis. We showed that LCTA is an objective approach that identifies both the most probable migration habitat and landscape elements that either inhibit or facilitate gene flow. Although we believe the statistical approach to be an improvement for the analysis of distance matrices in landscape genetics, more stringent testing is needed.

In landscape genetics, isolation-by-distance (IBD) is regarded as a baseline pattern that is obtained without additional effects of landscape elements on gene flow. However, the configuration of suitable habitat patches determines deme topology, which in turn should affect rates of gene flow. IBD patterns can be characterized either by monotonically increasing pairwise genetic differentiation (for example, F ST ) with increasing interdeme geographic distance (case-I pattern) or by monotonically increasing pairwise genetic differentiation up to a certain geographical distance beyond which no correlation is detectable anymore (case-IV pattern). We investigated if landscape configuration influenced the rate at which a case-IV pattern changed to a case-I pattern. We also determined at what interdeme distance the highest correlation was measured between genetic differentiation and geographic distance and whether this distance corresponded to the maximum migration distance. We set up a population genetic simulation study and assessed the development of IBD patterns for several habitat configurations and maximum migration distances. We show that the rate and likelihood of the transition of case-IV to case-I F ST -distance relationships was strongly influenced by habitat configuration and maximum migration distance. We also found that the maximum correlation between genetic differentiation and geographic distance was not related to the maximum migration distance and was measured across all deme pairs in a case-I pattern and, for a case-IV pattern, at the distance where the F ST -distance curve flattens out. We argue that in landscape genetics, separate analyses should be performed to either assess IBD or the landscape effects on gene flow.

Most landscape genetic studies assess the impact of landscape elements on species' dispersal and gene flow. Many of these studies perform their analysis on all possible population pairs in a study area and do not explicitly consider the effects of spatial scale and population network topology on their results. Here, we examined the effects of spatial scale and population network topology on the outcome of a landscape genetic analysis. Additionally, we tested whether the relevant spatial scale of landscape genetic analysis could be defined by population network topology or by isolation-by-distance (IBD) patterns. A data set of the wetland grasshopper Stethophyma grossum, collected in a fragmented agricultural landscape, was used to analyse population network topology, IBD patterns and dispersal habitats, using least-cost transect analysis. Landscape genetic analyses neglecting spatial scale and population network topology resulted in models with low fits, with which a most likely dispersal habitat could not be identified. In contrast, analyses considering spatial scale and population network topology resulted in high model fits by restricting landscape genetic analysis to smaller scales (0-3 km) and neighbouring populations, as represented by a Gabriel graph. These models also successfully identified a likely dispersal habitat of S. grossum. The above results suggest that spatial scale and potentially population network topology should be more explicitly considered in future landscape genetic analyses.