• Home
  • Search
  • Data-Driven Preference-Based Deep Statistical Ranking for Comparing Multi-objective Optimization Algorithms
  • Cite Icon22
  • https://doi.org/10.1007/978-3-319-91641-5_12Copy DOI Icon

Data-Driven Preference-Based Deep Statistical Ranking for Comparing Multi-objective Optimization Algorithms

  • Jan 1, 2018
  • Tome Eftimov +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To find the strengths and weaknesses of a new multi-objective optimization algorithm, we need to compare its performance with the performances of the state-of-the-art algorithms. Such a comparison involves a selection of a performance metric, a set of benchmark problems, and a statistical test to ensure that the results are statistical significant. There are also studies in which instead of using one performance metric, a comparison is made using a set of performance metrics. All these studies assume that all involved performance metrics are equal. In this paper, we introduce a data-driven preference-based approach that is a combination of multiple criteria decision analysis with deep statistical rankings. The approach ranks the algorithms for each benchmark problem using the preference (the influence) of each performance metric that is estimated using its entropy. Experimental results show that this approach achieved similar rankings to a previously proposed method, which is based on the idea of the majority vote, where all performance metrics are assumed equal. However, as it will be shown, this approach can give different rankings because it is based not only on the idea of counting wins, but also includes information about the influence of each performance metric.

Similar Papers
  • Conference Article
  • Citations14

Stopping criteria in evolutionary algorithms for multi-objective performance optimization of integrated inductors

  • Jul 01, 2010
  • Francisco V Fernandez +3
  • Conference Article
  • Citations2

Monitoring LSST system performance during construction

  • Jul 10, 2018
  • Bo Xin +7
  • Research Article
  • Citations83

Improving building operation by tracking performance metrics throughout the building lifecycle (BLC)

  • Jul 31, 2004
  • Energy and Buildings
  • D.T.J O’Sullivan +3
  • Research Article
  • Citations19

Guided Genetic Algorithm and its Application to Radio Link Frequency Assignment Problems

  • Jan 01, 2001
  • Constraints
  • T L Lau +1
  • Research Article
  • Citations134

Multi-objective evolutionary algorithms based on the summation of normalized objectives and diversified selection

  • May 17, 2010
  • Information Sciences
  • B.Y Qu +1
  • Research Article
  • Citations89

Benchmark problems for numerical implementations of phase field models

  • Oct 01, 2016
  • Computational Materials Science
  • A.M Jokisaari +4
  • Research Article
  • Citations76

Understanding the problem space in single-objective numerical optimization using exploratory landscape analysis

  • Feb 06, 2020
  • Applied Soft Computing
  • Urban Škvorc +2
  • Conference Article
  • Citations18

Artificial Neural Network Model for Design Optimization of 2-stage Op-amp

  • Jul 01, 2020
  • Harsha M.V +1
  • Conference Article

A study on navigation performance evaluation of educational robots

  • Oct 01, 2013
  • Wonpil Yu +3
  • Research Article
  • Citations14

Decomposition Based Quantum Inspired Salp Swarm Algorithm for Multiobjective Optimization

  • Jan 01, 2022
  • IEEE Access
  • Sanjai Pathak +3
  • Conference Article
  • Citations6

Multi-rule multi-objective Ant Colony Optimization for straight and U-type assembly line balancing problem

  • Aug 01, 2009
  • Christopher L.E Khaw +1
  • Conference Article
  • Citations6

A complementarity analysis of the COCO benchmark problems and artificially generated problems

  • Jul 07, 2021
  • Urban Škvorc +2
  • Research Article
  • Citations4

A reconsideration on the resolution of phase stability analysis using stochastic global optimization methods: Proposal of a reliable set of benchmark problems

  • Jul 25, 2021
  • Fluid Phase Equilibria
  • R.M Fonseca-Pérez +3
  • Conference Article
  • Citations1

A model for classification of outsourcing related organizational risks in a pharmaceutical supply chain

  • Oct 01, 2016
  • Aida Elamrani +2
  • Research Article
  • Citations85

Multiobjective multi-verse optimization algorithm to solve combined economic, heat and power emission dispatch problems

  • Feb 28, 2020
  • Applied Soft Computing
  • Arunachalam Sundaram
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.