Paradox-free analysis for comparing the performance of optimization algorithms

Citation Author(s):
Yun
Li
University of Electronic Science and Technology of China
Submitted by:
YUN LI
Last updated:
Mon, 08/15/2022 - 13:45
DOI:
10.21227/z7gb-np68
Data Format:
License:
0
0 ratings - Please login to submit your rating.

Abstract 

<p>Numerical comparison serves as a major tool in evaluating the performance of optimization algorithms, especially nondeterministic algorithms, but existing methods may suffer from a ‘cycle ranking’ paradox and/or a ‘survival of the nonfittest paradox. This paper searches for paradox-free data analysis methods for numerical comparison. It is discovered that a class of sufficient conditions exist for designing paradox-free analysis. Rigorous modeling and deduction are applied to a class of profile methods employing a filter. It is thus further discovered and proven that algorithm-independent filter conditions can prevent cycle ranking and survival of non-fittest paradoxes from occurring. By adopting an algorithm-independent filter, popular profile methods such as the ‘modified data profile method’, ‘the accuracy profile method’, and ‘the operational characteristics zones method’ can be paradox free in comparing or bench-marking the performance of optimization algorithms.</p>

Instructions: 

The date set is the same as "TEVC-00089-2022.R1_dataset_supplement.rar" in paper

Funding Agency: 
NSFC, GDNSF MoST China