Evolutionary Large-Scale Multiobjective Optimization via Autoencoder-Based Problem Transformation

Many real-world multi-objective optimization problems have hundreds or even thousands of decision variables, which contrast with the current practice of multi-objective metaheuristics whose performance is typically assessed using benchmark problems with a relatively low number of decision variables (normally, no more than 30). In this paper, we propose a cooperative coevolution framework that is capable of optimizing large scale (in decision variable space) multi-objective optimization problems. We adopt a benchmark that is scalable in the number of decision variables (the ZDT test suite) and compare our proposed algorithm with respect to two state-of-the-art multi-objective evolutionary algorithms (GDE3 and NSGA-II) when using a large number of decision variables (from 200 up to 5000). The results clearly indicate that our proposed approach is effective as well as efficient for solving large scale multi-objective optimization problems.

A fast sampling based evolutionary algorithm for million-dimensional multiobjective optimization

Recently, the large-scale optimization problems have become a common research topic in the field of evolutionary computation. It is hard to find optimal solutions when solving large-scale multi-objective optimization problems (LSMOPs), due to the ineffectiveness of existing operators. In the other word, the search ability of most existing MOEAs on solving LSMOPs is still weak. To address this issue, an efficient competitive swarm optimizer with a strong exploration ability, denoted as E-CSO, is presented in this paper, which designs a novel three-particle-based particle updating strategy to improve the search efficiency. The experimental results validate the high efficiency and effectiveness of our proposed approach when solving various LSMOPs.

The competitive swarm optimizer (CSO) classifies swarm particles into loser and winner particles and then uses the winner particles to efficiently guide the search of the loser particles. This approach has very promising performance in solving large-scale multiobjective optimization problems (LMOPs). However, most studies of CSOs ignore the evolution of the winner particles, although their quality is very important for the final optimization performance. Aiming to fill this research gap, this article proposes a new neural net-enhanced CSO for solving LMOPs, called NN-CSO, which not only guides the loser particles via the original CSO strategy, but also applies our trained neural network (NN) model to evolve winner particles. First, the swarm particles are classified into winner and loser particles by the pairwise competition. Then, the loser particles and winner particles are, respectively, treated as the input and desired output to train the NN model, which tries to learn promising evolutionary dynamics by driving the loser particles toward the winners. Finally, when model training is complete, the winner particles are evolved by the well-trained NN model, while the loser particles are still guided by the winner particles to maintain the search pattern of CSOs. To evaluate the performance of our designed NN-CSO, several LMOPs with up to ten objectives and 1000 decision variables are adopted, and the experimental results show that our designed NN model can significantly improve the performance of CSOs and shows some advantages over several state-of-the-art large-scale multiobjective evolutionary algorithms as well as over model-based evolutionary algorithms.

Due to the curse of dimensionality, two main issues remain challenging for applying evolutionary algorithms (EAs) to large-scale multiobjective optimization. The first issue is how to improve the efficiency of EAs for reducing computation cost. The second one is how to improve the diversity maintenance of EAs to avoid local optima. Nevertheless, these two issues are somehow conflicting with each other, and thus it is crucial to strike a balance between them in practice. Thereby, we propose an iterated problem reformulation based EA for large-scale multiobjective optimization, where the problem reformulation based method and the decomposition based method are used iteratively to address the aforementioned issues. The proposed method is compared with several state-of-the-art EAs on a variety of large-scale multiobjective optimization problems. Experimental results demonstrate the effectiveness of our proposed iterated method in large-scale multiobjective optimization.

Multi-objective optimization problems with large-scale decision variables, known as LSMOPs, are characterized by their large-scale search space and multiple conflicting objectives to be optimized. They have been involved in many emergent real-world applications, such as feature and instance selection, data clustering, adversarial attack, vehicle routing problem, and others. In this work, we propose a new teaching-learning-based optimization algorithm to effectively tackle large-scale multi-objective optimization problems. The proposed approach ensures both the diversity of solutions, requested for high dimensionality of LSMOPs, and the balance between the exploitation and exploration during the optimization process. The experimental studies conducted on 54 instances of a large-scale multi-objective optimization problems test suite and the comparisons against well-known and state-of-the-art algorithms have shown the superiority of the proposed algorithm in terms of Pareto front approximation and computation time by using limited evaluation budget.

Many engineering optimization problems are typically multi-objective in their natures and multidisciplinary with a large number of decision variables. Furthermore, Pareto dominance loses its effectiveness in such situations. Thus, developing a robust optimization algorithm undoubtedly becomes a true challenge. This paper proposes a multi-objective orthogonal opposition-based crow search algorithm (M2O-CSA) for solving large-scale multi-objective optimization problems (LSMOPs). In the M2O-CSA, a multi-orthogonal opposition strategy is employed to mitigate the conflicts among the convergence and distribution of solutions. First, two individuals are randomly chosen to undergo the crossover stage and then orthogonal array is presented to obtain nine individuals. Then individuals are used in the opposition stage to improve the diversity of solutions. The effectiveness of the proposed M2O-CSA is investigated by implementing it on different dimensions of multi-objective optimization problems (MOPs). The Pareto front solutions of these MOPs have various characteristics such as convex, non-convex and discrete. It is also applied to solve multi-objective design applications with distinctive features such as four bar truss (FBT) design, welded beam (WB) deign, disk brake (DB) design, and speed reduced (SR) design, where they involve different characteristics. In this context, a new decision making tool based on multi-objective optimization on the basis of ratio analysis (MOORA) technique is employed to help the designer for extracting the operating point as the best compromise or satisfactory solution to execute the candidate engineering design. Simulation results affirm that the proposed M2O-CSA works efficiently and effectively.

In this paper, we propose a framework to accelerate the computational efficiency of evolutionary algorithms on large-scale multiobjective optimization. The main idea is to track the Pareto optimal set (PS) directly via problem reformulation. To begin with, the algorithm obtains a set of reference directions in the decision space and associates them with a set of weight variables for locating the PS. Afterwards, the original large-scale multiobjective optimization problem is reformulated into a low-dimensional single-objective optimization problem. In the reformulated problem, the decision space is reconstructed by the weight variables and the objective space is reduced by an indicator function. Thanks to the low dimensionality of the weight variables and reduced objective space, a set of quasi-optimal solutions can be obtained efficiently. Finally, a multiobjective evolutionary algorithm is used to spread the quasi-optimal solutions over the approximate Pareto optimal front evenly. Experiments have been conducted on a variety of large-scale multiobjective problems with up to 5000 decision variables. Four different types of representative algorithms are embedded into the proposed framework and compared with their original versions, respectively. Furthermore, the proposed framework has been compared with two state-of-the-art algorithms for large-scale multiobjective optimization. The experimental results have demonstrated the significant improvement benefited from the framework in terms of its performance and computational efficiency in large-scale multiobjective optimization.

Competitive swarm optimizer (CSO) based on multidirectional search plays a crucial role in addressing large-scale multiobjective optimization problems (LSMOPs). However, relying solely on uniform or cluster partitioning of the objective space for sampling, along with two search directions constructed with upper and lower boundaries of global variables, sometimes lacks consideration of regional information. This results in an inefficient search and hinders the global convergence of the algorithm. To solve these problems, this study proposes a large-scale multiobjective competitive swarm optimizer algorithm based on regional multidirectional search (AMSLMOEA). Firstly, an adaptive objective space partitioning method based on the evolutionary state of the population is designed to enhance the adaptability of partitioning. Secondly, an individual multidirectional search strategy is introduced. Considering the algorithm’s computational complexity, the strategy selects the optimal individual within each subregion and constructs four-directional search vectors based on the lower limit of the global decision variables and the upper limit of the individual decision variables within the subregion. To validate the effectiveness of AMSLMOEA, the performance is tested on four benchmark function sets. The results demonstrate that AMSLMOEA outperforms the vast majority of the compared algorithms in terms of the IGD and HV metrics.

Large-scale multi-objective optimization problems are prevalent in practical applications. Consequently, researchers have proposed numerous large-scale multi-objective evolutionary algorithms (LMOEAs) to address these problems. Among them, neural network (NN)-based LMOEAs have garnered significant attention owing to their superior search efficiency. Regrettably, existing NN-based LMOEAs are limited by a single source of training data and pre-fixed network topology, resulting in insufficient generalization and weak adaptability. We propose a heterogeneous operator mechanism and stochastic configuration network-enhanced LMOEA (HMSCN-LMOEA) to overcome these issues. Specifically, a heterogeneous operator mechanism is introduced to address the limited data sources in NN model training, thereby effectively enhancing the quality of the training set. A stochastic configuration network (SCN) model with dynamic structural adaptability is designed to replace the NN model with a pre-fixed network topology, thereby enhancing the algorithm’s adaptability. Finally, to evaluate the algorithm’s performance, four large-scale multi-objective optimization problems—UF, WFG, LSMOP, and ZCAT—are adopted. Experimental results based on IGD, IGD+, Spacing, and HV metrics demonstrate the significant advantages and competitiveness of HMSCN-LMOEA over state-of-the-art LMOEAs. Furthermore, HMSCN-LMOEA is employed to solve the cloud task scheduling problem across different task scales, and the experimental results show that it achieves the top rank in 75% of the evaluated scenarios, further demonstrating its promising potential.

Multi-objective evolutionary algorithms (MOEAs) of the state of the art are created with the only purpose of dealing with the number of objective functions in a multi-objective optimization problem (MOP) and treat the decision variables of a MOP as a whole. However, when dealing with MOPs with a large number of decision variables (more than 100) their efficacy decreases as the number of decision variables of the MOP increases. On the other hand, problem decomposition, in terms of decision variables, has been found to be extremely efficient and effective for solving large scale optimization problems. Nevertheless, most of the currently available approaches for large scale optimization rely on models based on cooperative coevolution or linkage learning methods that use multiple subpopulations or preliminary analysis, respectively, which is computationally expensive (in terms of function evaluations) when used within MOEAs. In this work, we study the effect of what we call operational decomposition, which is a novel framework based on coevolutionary concepts to apply MOEAs’s crossover operator without adding any extra cost. We investigate the improvements that NSGA-III can achieve when combined with our proposed coevolutionary operators. This new scheme is capable of improving efficiency of a MOEA when dealing with large scale MOPs having from 200 up to 1200 decision variables.

This paper presents a random-based dynamic grouping strategy (RDG) for cooperative coevolution to deal with large scale multi-objective optimization problems (MOPs) by decomposing the whole dimension into several groups of variables with an equal size. First, a decomposer pool containing different group sizes is designed. Then, a group size is dynamically selected with probability in the evolution process. The probability of each group size in the pool is computed based on the historical performance measured by C-metric, a common metric in multi-objective optimization. Under the selected group size, random grouping is executed to decompose the whole dimension into groups. Through this, both the group size and the group components are dynamic. Finally, combining RDG with a traditional and famous multi-objective evolutionary algorithm (MOEA) named MOEA/D, we develop MOEA/D-RDG to cope with large scale MOPs. The efficacy of the proposed MOEA/D-RDG is verified on two sets of MOPs (UF1-UF10 and WFG1-WFG9) through comparing with two MOEA/D variants.

A large-scale continuous optimization benchmark suite with versatile coupled heterogeneous modules

This article is about a comparison of different measures for determining the robustness or reliability of electric machine designs in the presence of inevitable tolerances. The selected criteria shall be suitable for concurrent evaluation in the course of solving state-of-the-art large scale multi-objective optimization problems. In the past, besides particularly customized criteria, mainly gradient based measures, worst case information, or standard deviation based quantities were considered. In this work, the quantile measure is introduced for electric machine design optimization and compared with the existing solutions. The evaluation of a design's robustness is typically examined based on finite element simulations. As for most measures a significant number of parameter combinations and thus computations are required, a surrogate model assisted approach is presented to minimize computational effort and runtime. A test problem is defined and analyzed to illustrate the differences of selected robustness measures. Results reveal the importance of considering robustness in the optimization process. Moreover, a careful choice of appropriate measures has to be taken. Selected designs are compared and conclusions and an outlook on future activities are presented.

In large-scale multiobjective optimization, too many decision variables hinder the convergence search of evolutionary algorithms. Reducing the search range of the decision space will significantly alleviate this puzzle. With this in mind, this paper proposes a fuzzy decision variables framework for large-scale multiobjective optimization. The framework divides the entire evolutionary process into two main stages: fuzzy evolution and precise evolution. In fuzzy evolution, we blur the decision variables of the original solution to reduce the search range of the evolutionary algorithm in the decision space so that the evolutionary population can quickly converge. The degree of fuzzification gradually decreases with the evolutionary process. Once the population approximately converges, the framework will turn to precise evolution. In precise evolution, the actual decision variables of the solution are directly optimized to increase the diversity of the population so as to be closer to the true Pareto optimal front. Finally, this paper embeds some representative algorithms into the proposed framework and verifies the framework’s effectiveness through comparative experiments on various large-scale multiobjective problems with 500 to 5000 decision variables. Experimental results show that in large-scale multiobjective optimization, the framework proposed in this paper can significantly improve the performance and computational efficiency of multiobjective optimization algorithms.