2019
DOI: 10.1016/j.ipl.2018.11.003
|View full text |Cite
|
Sign up to set email alerts
|

On the statistical evaluation of algorithmic's computational experimentation with infeasible solutions

Abstract: The experimental evaluation of algorithms results in a large set of data which generally do not follow a normal distribution or are not heteroscedastic. Besides, some of its entries may be missing, due to the inability of an algorithm to find a feasible solution until a time limit is met. Those characteristics restrict the statistical evaluation of computational experiments. This work proposes a bi-objective lexicographical ranking scheme to evaluate datasets with such characteristics. The output ranking can b… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
6
0

Year Published

2019
2019
2023
2023

Publication Types

Select...
6

Relationship

2
4

Authors

Journals

citations
Cited by 6 publications
(6 citation statements)
references
References 14 publications
0
6
0
Order By: Relevance
“…A series of statistical analyses were performed to investigate if there exists an algorithm that outperforms the others in predicting the consumer responses. To do so, we ranked the data presented in Table 3 using the ranking methodology proposed by Carvalho (2019). For every fruit and each consumer response, the results of the algorithms were ranked lexicographically, whereas the R 2 value had greater importance than the RMSE value.…”
Section: Resultsmentioning
confidence: 99%
See 1 more Smart Citation
“…A series of statistical analyses were performed to investigate if there exists an algorithm that outperforms the others in predicting the consumer responses. To do so, we ranked the data presented in Table 3 using the ranking methodology proposed by Carvalho (2019). For every fruit and each consumer response, the results of the algorithms were ranked lexicographically, whereas the R 2 value had greater importance than the RMSE value.…”
Section: Resultsmentioning
confidence: 99%
“…A series of statistical analyses were performed to investigate if there exists an algorithm that outperforms the others in predicting the consumer responses. To do so, we ranked the data presented in Table 3 using the ranking methodology proposed by Carvalho (2019).…”
Section: Regression Modelsmentioning
confidence: 99%
“…SBA was first proposed for the Minmax regret Weighted Set Covering problem under Interval Uncertainties [18,19] and later extended to M-BIP [38] and other minmax regret optimization problems under interval uncertainties [10,39,40]. It consists in investigating a set Q = {q 1 , q 2 , .…”
Section: The Scenario-based Algorithmmentioning
confidence: 99%
“…In the second step, Friedman's test (Friedman, 1937) is used to verify whether there is a statistical significant difference between at least two of the evaluated heuristics. The ranking used by Friedman's test is computed using the biobjective lexicographical ranking scheme of Carvalho (2019). The null hypothesis of Friedman's test is that AMU, SBA, VND, and FO-HD have the same average relative optimality gap.…”
Section: Comparison With the Best Heuristics In The Literaturementioning
confidence: 99%