Abstract. Metaheuristics have become popular for solving complex optimisation problems where classical techniques are either infeasible or perform poorly. Despite many success stories, it is well known that metaheuristics sometimes fail and that researchers and practitioners frequently resort to trial and error to find an appropriate algorithm or setting to solve a given problem. Within the framework of the general algorithm selection problem, this chapter addresses the feasibility of predicting algorithm performance on unknown real-valued problems based on fitness landscape features. Normalized metrics are proposed for quantifying algorithm performance on known problems to generate suitable training data. Performance metrics are tested using a standard particle swarm optimisation algorithm and are investigated alongside three existing fitness landscape measures. This preliminary investigation highlights the need for a shift in focus away from predicting general problem hardness towards characterising problems where each fitness landscape technique has value as a part-predictor of algorithm performance.