On the integrity of performance comparison for evolutionary multi-objective optimisation algorithms

Authors: Wilson, K., Rostami, S.

Journal: Advances in Intelligent Systems and Computing

Publication Date: 01/01/2019

Volume: 840

Pages: 3-15

ISSN: 2194-5357

DOI: 10.1007/978-3-319-97982-3_1

Abstract:

This paper proposes the notion that the experimental results and performance analyses of newly developed algorithms in the field of multi-objective optimisation may not offer sufficient integrity for hypothesis testing. The reason for this is that many implementations exist of the same optimisation algorithms, and these may vary in behaviour due to the interpretation of the developer. This is demonstrated through the comparison of three implementations of the popular Non-dominated Sorting Genetic Algorithm II (NSGA-II) from well-regarded frameworks using the hypervolume indicator. The results show that of the thirty considered comparison cases, only four indicate that there was no significant difference between the performance of either implementation.

https://eprints.bournemouth.ac.uk/31060/

Source: Scopus