Lower Bounds for Non-Elitist Evolutionary Algorithms via Negative Multiplicative Drift

Abstract

A decent number of lower bounds for non-elitist population-based evolutionary algorithms has been shown by now. Most of them are technically demanding due to the (hard to avoid) use of negative drift theorems — general results which translate an expected movement away from the target into a high hitting time. We propose a simple negative drift theorem for multiplicative drift scenarios and show that it can simplify existing analyses. We discuss in more detail Lehre's (PPSN 2010) negative drift in populations method, one of the most general tools to prove lower bounds on the runtime of non-elitist mutation-based evolutionary algorithms for discrete search spaces. Together with other arguments, we obtain an alternative and simpler proof of this result, which also strengthens and simplifies this method. In particular, now only three of the five technical conditions of the previous result have to be verified. The lower bounds we obtain are explicit instead of only asymptotic. This allows to compute concrete lower bounds for concrete algorithms, but also enables us to show that super-polynomial runtimes appear already when the reproduction rate is only a [Formula: see text] factor below the threshold. For the special case of algorithms using standard bit mutation with a random mutation rate (called uniform mixing in the language of hyper-heuristics), we prove the result stated by Dang and Lehre (PPSN 2016) and extend it to mutation rates other than [Formula: see text], which includes the heavytailed mutation operator proposed by Doerr, Le, Makhmara, and Nguyen (GECCO 2017). We finally use our method and a novel domination argument to show an exponential lower bound for the runtime of the mutation-only simple genetic algorithm on ONEMAX for arbitrary population size.

Two-Dimensional Drift Analysis: Optimizing Two Functions Simultaneously Can Be Hard

“…, which is the left hand side of (7). Finally, we note for later reference that by an analogous computation, ( 8) and ( 9) also hold with U and Ũ reversed, so for all vectors v,…”

“…To highlight just one result, the (μ + 1)-EA with standard mutation rate 1/n fails on some monotone functions if the population size μ is too large (but still constant in n) [26]. Other algorithm-specific failure modes include (i) non-elitist selection strategies with too small offspring reproductive rate (e.g., comma strategies with small offspring population size) [1,5,7,11,17,30]; (ii) elitist algorithms (and also some non-elitist strategies) in certain landscapes with deceptive local optima [3,4];…”

“…We use that ẽ2 = Ũ U −1 e 2 = e 2 − (I − Ũ U −1 )e 2 and that f is linear with f (e 2 ) = 0. Since we want to achieve a bound in terms of η 1 = f (x), we also use that by (7) we have | η2 | ≤ η ≤ (1 + ε) η , and we can continue…”

Analysing Equilibrium States for Population Diversity

“…This condition was described in [57] as negative multiplicative drift with an additive disturbance (in [57] only lower hitting time bounds were given, while we will prove upper bounds). An equilibrium state with zero drift is attained for…”