We review and test twelve different approaches to the detection of finite-time coherent material structures in two-dimensional, temporally aperiodic flows. We consider both mathematical methods and diagnostic scalar fields, comparing their performance on three benchmark examples: the quasiperiodically forced Bickley jet, a two-dimensional turbulence simulation, and an observational wind velocity field from Jupiter's atmosphere. A close inspection of the results reveals that the various methods often produce very different predictions for coherent structures, once they are evaluated beyond heuristic visual assessment. As we find by passive advection of the coherent set candidates, false positives and negatives can be produced even by some of the mathematically justified methods due to the ineffectiveness of their underlying coherence principles in certain flow configurations. We summarize the inferred strengths and weaknesses of each method, and make general recommendations for minimal self-consistency requirements that any Lagrangian coherence detection technique should satisfy.Keywords: Lagrangian coherent structures; nonlinear dynamical systems; vortex dynamics Coherent Lagrangian (material) structures are ubiquitous in unsteady fluid flows, often observable indirectly from tracer patterns they create, for example, in the atmosphere and the ocean. Despite these observations, a direct identification of these structures from the flow velocity field (without reliance on seeding passive tracers) has remained a challenge. Several heuristic and mathematical detection methods have been developed over the years, each promising to extract materially coherent domains from arbitrary unsteady velocity fields over a finite time interval of interest. Here we review a number of these methods and compare their performance systematically on three benchmark velocity data sets. Based on this comparison, we discuss the strengths and weaknesses of each method, and recommend minimal self-consistency requirements that Lagrangian coherence detection tools should satisfy.