2014
DOI: 10.1016/j.cor.2013.11.015
|View full text |Cite
|
Sign up to set email alerts
|

Towards objective measures of algorithm performance across instance space

Abstract: Abstracthis p per t kles the di0 ult ut import nt t sk of o je tive lgorithm perE form n e ssessment for optimiz tionF ther th n reporting ver ge performE n e of lgorithms ross set of hosen inst n esD whi h m y i s on lusionsD we propose methodology to en le the strengths nd we knesses of di'erent optimiz tion lgorithms to e omp red ross ro der inst n e sp eF he results reported in re ent Computers and Operations Research p per omE p ring the perform n e of gr ph oloring heuristi s re revisited with this new m… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1

Citation Types

0
140
1

Year Published

2015
2015
2020
2020

Publication Types

Select...
6
2
1

Relationship

0
9

Authors

Journals

citations
Cited by 165 publications
(141 citation statements)
references
References 41 publications
0
140
1
Order By: Relevance
“…Analyzing statistical feature of classical combinatorial optimization problems and their relation to problem difficulty has gained an increasing attention in recent years [52]. Classical algorithms for the TSP and their success depending on features of the given input have been studied in [34,41,51] and similar analysis can be carried out for the knapsack problem.…”
Section: Multi-component Problemsmentioning
confidence: 99%
“…Analyzing statistical feature of classical combinatorial optimization problems and their relation to problem difficulty has gained an increasing attention in recent years [52]. Classical algorithms for the TSP and their success depending on features of the given input have been studied in [34,41,51] and similar analysis can be carried out for the knapsack problem.…”
Section: Multi-component Problemsmentioning
confidence: 99%
“…There are four basic elements in the framework: (i) the problem space P represents the set of problem instances; (ii) the feature space F includes instance characteristics; (iii) the algorithm space A is the portfolio of available algorithms; and (iv) the performance space Y is the mapping of each algorithm to the performance metrics. Accordingly, the ASP can be stated as follows [87]: given a problem instance x 2 P with feature vector f .x/ 2 F , the ASP searches the selection mapping S.f .x// into algorithm space A such that the selected algorithm˛2 A maximizes the performance mapping y.˛; x/ 2 Y . Thus, for instance, [88] develops a methodology to predict the performance of metaheuristics and acquire insights into the relation between search space characteristics of an instance and algorithm performance.…”
Section: Global Hybridizationsmentioning
confidence: 99%
“…Several network architectures are assessed. In [87], the authors construct a methodology to compare the strengths and weaknesses of a set of optimization algorithms. First, the instance space is generated.…”
Section: Global Hybridizationsmentioning
confidence: 99%
“…Since Hooker's article, little has progressed in solving the difficulties that he focused on. However, in recent years, Professor SmithMiles (Smith-Miles et al, 2014;Smith-Miles and Bowly, 2015) has been developing very promising methods and techniques for data generation and analysis of the results of computational experiments.…”
mentioning
confidence: 99%