Adaptive Multi-optimiser Cooperative Co-evolution for Large-Scale Optimisation

Multi-objective evolutionary algorithms (MOEAs) of the state of the art are created with the only purpose of dealing with the number of objective functions in a multi-objective optimization problem (MOP) and treat the decision variables of a MOP as a whole. However, when dealing with MOPs with a large number of decision variables (more than 100) their efficacy decreases as the number of decision variables of the MOP increases. On the other hand, problem decomposition, in terms of decision variables, has been found to be extremely efficient and effective for solving large scale optimization problems. Nevertheless, most of the currently available approaches for large scale optimization rely on models based on cooperative coevolution or linkage learning methods that use multiple subpopulations or preliminary analysis, respectively, which is computationally expensive (in terms of function evaluations) when used within MOEAs. In this work, we study the effect of what we call operational decomposition, which is a novel framework based on coevolutionary concepts to apply MOEAs’s crossover operator without adding any extra cost. We investigate the improvements that NSGA-III can achieve when combined with our proposed coevolutionary operators. This new scheme is capable of improving efficiency of a MOEA when dealing with large scale MOPs having from 200 up to 1200 decision variables.

The solution of large-scale optimization problems is the key to many decision-making processes in practice. However, it is a challenging research topic when considered both the quality of solutions and the required computational time. One of the popular approaches for these problems is to divide the problems into a number of smaller sub-problems, that are then solved separately with an exchange of some information using the cooperative co-evolution (CC) concept. However, the characteristics of sub-components could be different, and their contributions to the overall performance can also be different while solving the problem. In the CC approach, it usually applies one optimizer and allocates equal computational budget to all sub-components. In this article, a new algorithm is proposed with the use of multiple optimizers, along with a need-based allocation of computational budget for the sub-components. In the proposed algorithm, a group of optimizers cooperate in an effective way to evolve the sub-components, depending on heuristic fuzzy rules. The performance of our proposed algorithm was evaluated by solving a number of large-scale global optimization benchmark functions. The empirical results show that the proposed algorithm outperforms equal allocation CC, a single selection characteristic, a single candidate optimizer and state-of-the-art algorithms.

Many real-world multi-objective optimization problems have hundreds or even thousands of decision variables, which contrast with the current practice of multi-objective metaheuristics whose performance is typically assessed using benchmark problems with a relatively low number of decision variables (normally, no more than 30). In this paper, we propose a cooperative coevolution framework that is capable of optimizing large scale (in decision variable space) multi-objective optimization problems. We adopt a benchmark that is scalable in the number of decision variables (the ZDT test suite) and compare our proposed algorithm with respect to two state-of-the-art multi-objective evolutionary algorithms (GDE3 and NSGA-II) when using a large number of decision variables (from 200 up to 5000). The results clearly indicate that our proposed approach is effective as well as efficient for solving large scale multi-objective optimization problems.

Cooperative Coevolution (CC) framework has become a powerful approach to solve large-scale global optimization problems effectively. Although a number of significant modifications of CC algorithms have been introduced in recent years, the theoretical studies of population initialization strategies in the CC framework are quite limited so far. The population initialization strategies can help a population-based algorithm to start with better candidate solutions for achieving better results. In this paper, we propose a CC algorithm with population initialization strategies based on the center region to improve its performance. Three population initialization strategies, namely, center-based normal distribution sampling, central golden region, and hybrid random-center normal distribution sampling are utilized in the CC framework. These population initialization strategies attempt to generate points around center-point with different schemes. The performance of the proposed algorithm is evaluated on CEC-2013 LSGO benchmark functions. Simulation results confirm that the proposed algorithm obtains a promising performance on the majority of the nonseparable high dimension benchmark functions.

This paper presents the Constructive Cooperative Coevolutionary (mathrm {C}^3) algorithm, applied to continuous large-scale global optimisation problems. The novelty of mathrm {C}^3 is that it utilises a multi-start architecture and incorporates the Cooperative Coevolutionary algorithm. The considered optimisation problem is decomposed into subproblems. An embedded optimisation algorithm optimises the subproblems separately while exchanging information to co-adapt the solutions for the subproblems. Further, mathrm {C}^3 includes a novel constructive heuristic that generates different feasible solutions for the entire problem and thereby expedites the search. In this work, two different versions of mathrm {C}^3 are evaluated on high-dimensional benchmark problems, including the CEC’2013 test suite for large-scale global optimisation. mathrm {C}^3 is compared with several state-of-the-art algorithms, which shows that mathrm {C}^3 is among the most competitive algorithms. mathrm {C}^3 outperforms the other algorithms for most partially separable functions and overlapping functions. This shows that mathrm {C}^3 is an effective algorithm for large-scale global optimisation. This paper demonstrates the enhanced performance by using constructive heuristics for generating initial feasible solutions for Cooperative Coevolutionary algorithms in a multi-start framework.

A fast sampling based evolutionary algorithm for million-dimensional multiobjective optimization

Many engineering optimization problems are typically multi-objective in their natures and multidisciplinary with a large number of decision variables. Furthermore, Pareto dominance loses its effectiveness in such situations. Thus, developing a robust optimization algorithm undoubtedly becomes a true challenge. This paper proposes a multi-objective orthogonal opposition-based crow search algorithm (M2O-CSA) for solving large-scale multi-objective optimization problems (LSMOPs). In the M2O-CSA, a multi-orthogonal opposition strategy is employed to mitigate the conflicts among the convergence and distribution of solutions. First, two individuals are randomly chosen to undergo the crossover stage and then orthogonal array is presented to obtain nine individuals. Then individuals are used in the opposition stage to improve the diversity of solutions. The effectiveness of the proposed M2O-CSA is investigated by implementing it on different dimensions of multi-objective optimization problems (MOPs). The Pareto front solutions of these MOPs have various characteristics such as convex, non-convex and discrete. It is also applied to solve multi-objective design applications with distinctive features such as four bar truss (FBT) design, welded beam (WB) deign, disk brake (DB) design, and speed reduced (SR) design, where they involve different characteristics. In this context, a new decision making tool based on multi-objective optimization on the basis of ratio analysis (MOORA) technique is employed to help the designer for extracting the operating point as the best compromise or satisfactory solution to execute the candidate engineering design. Simulation results affirm that the proposed M2O-CSA works efficiently and effectively.

The scalability performance of the traditional evolutionary algorithms (EAs) deteriorates rapidly as the dimensionality of the optimization problems increases. Therefore, cooperative coevolutionary (CC) framework is proposed to overcome the defect. Different from existing CC algorithms, a novel self-adaptive based cooperative coevolutionary (SaCC) algorithm is presented in this paper. The SaCC employs three algorithms which with self-adaptive mechanism as sub-algorithms. The focus of this paper is on investigating two different cooperative coevolutionary manners. In the first manner, SaCC executes its sub-algorithms in parallel during evolve process and the corresponding algorithm is termed as SaCC-M1. In the second manner, SaCC executes its sub-algorithms in serial and the corresponding algorithm is termed as SaCC-M2. 26 test functions with 1000 dimensionalities are employed to verify the validity of SaCC-M1 and SaCC-M2. Experiment results demonstrate that SaCC-M2 outperforms its sub-algorithms and SaCC-M1. Besides, the results indicate that serial manner is another simple yet efficient manner for CC algorithms to solve large-scale global optimization problems.

Cooperative coevolution (CC) algorithms based on variable decomposition methods are efficient in solving large-scale optimization problems (LSOPs). However, many decomposition methods, such as the differential grouping (DG) method and its variants, are based on the theorem of function additively separable, which may not work well on problems that are not additively separable and will result in a bottleneck for CC to solve various LSOPs. This deficiency motivates us to study how the decomposition method can decompose more kinds of separable functions, such as the multiplicatively separable function, to improve the general problem-solving ability of CC on LSOPs. With this concern, this article makes the first attempt to decompose multiplicatively separable functions and proposes a novel method called dual DG (DDG) for better LSOP decomposition and optimization. The novelty and advantage of DDG are that it can be suitable for not only additively separable functions but also multiplicatively separable functions, which can considerably expand the application scope of CC. In this article, we will first define the multiplicatively separable function, and then mathematically show its relationship to the additively separable function and how they can be transformed into each other. Based on this, the DDG can use two kinds of differences to detect the separable structure of both additively and multiplicatively separable functions. In addition, the time complexity of DDG is analyzed and a DDG-based CC algorithm framework is developed for solving LSOPs. To verify the superiority of DDG, experiments and comparisons with some state-of-the-art and champion algorithms are conducted not only on 30 LSOPs based on the test suite of the IEEE CEC large-scale global optimization competition, but also on a case study of the parameter optimization for a neural network-based application.

Solving constrained large-scale global optimization problems poses a challenging task. In these problems with constraints, when the number of variables is measured in the thousands, when the constraints are presented in the form of a black box, and neither the size nor the configuration of the feasible region is known, it is very difficult to find at least one feasible solution. In general, such a problem of finding a feasible region is known as a constraint satisfaction problem. In this paper, we have extended a well-known benchmark set based on constrained optimization problems up to 1000 variables. We have evaluated the CC-SHADE performance, to tackle constraints in large-scale search space. CC-SHADE merges the power of cooperative coevolution and self-adaptive differential evolution. Our extensive experimental evaluations on a range of benchmark problems demonstrate the strong dependence of the performance of CC-SHADE on the number of individuals and the subcomponent number. The numerical results emphasize the importance of using a cooperative coevolution framework for evolutionary-based approaches compared to conventional methods. All numerical experiments are proven by the Wilcoxon test.

Biogeography-based optimization (BBO), a recent proposed metaheuristic algorithm, has been successfully applied to many optimization problems due to its simplicity and efficiency. However, BBO is sensitive to the curse of dimensionality; its performance degrades rapidly as the dimensionality of the search space increases. In this paper, a selective migration operator is proposed to scale up the performance of BBO and we name it selective BBO (SBBO). The differential migration operator is selected heuristically to explore the global area as far as possible whist the normal distributed migration operator is chosen to exploit the local area. By the means of heuristic selection, an appropriate migration operator can be used to search the global optimum efficiently. Moreover, the strategy of cooperative coevolution (CC) is adopted to solve large-scale global optimization problems (LSOPs). To deal with subgroup imbalance contribution to the whole solution in the context of CC, a more efficient computing resource allocation is proposed. Extensive experiments are conducted on the CEC 2010 benchmark suite for large-scale global optimization, and the results show the effectiveness and efficiency of SBBO compared with BBO variants and other representative algorithms for LSOPs. Also, the results confirm that the proposed computing resource allocation is vital to the large-scale optimization within the limited computation budget.

A decomposition framework based on memorized binary search for large-scale optimization problems

Today, because of the exponential growth of the volume of data in big data applications, large-scale optimization problems (i.e., optimization problems with a large number of decision variables) have become ubiquitous in the real world [219, 220]. In this chapter, building on the algorithms and observations presented for solving both continuous and combinatorial optimization problems, we further present a novel multi-space evolutionary search framework based on EMT for solving large-scale single-objective optimization problem.

Large-scale high-dimensional many-objective optimization problems (LaMaOPs) are prevalent in fields such as autonomous driving, cloud resource scheduling, and smart grids. LaMaOPs involve a large number of decision variables and multiple conflicting objectives that need to be optimized simultaneously. The challenges posed by the curse of dimensionality due to the vast number of decision variables, and the conflict between convergence and diversity caused by the numerous objective variables, make traditional optimization methods inadequate. To address these issues, this paper proposes a two-population cooperative evolutionary algorithm based on large-scale decision variable analysis (DVA-TPCEA). This algorithm integrates quantitative analysis methods for decision variables to deeply examine their impact on each objective and introduces a contribution-based objective detection method. Additionally, a dual-population cooperative evolution mechanism is employed, with targeted optimization strategies designed for convergence and diversity populations, achieving synergistic and complementary optimization between the two populations. To validate the algorithm’s effectiveness in practical applications, a large-scale container resource scheduling strategy based on the DVA-TPCEA algorithm is also proposed. The experimental results indicate that the proposed algorithm demonstrates significant advantages in both general datasets DTLZ, WFG, and LSMOP, and practical models.

This paper attempts to address the problem of large scale optimization and high dimensional optimization using principal component analysis (PCA) strategy with differential evolution (DE) based on Cooperative Co-evolution (CC) framework. Decomposition problem is a major obstacle for large-scale optimization problems. The aim of this paper is to propose effective dimension decomposition method of PCA strategy for capturing the main information among dimensions. PCA strategy can measures most of the contribution information of dimension and uses it for identifying main dimension to guide them to group the most promising subcomponents in CC framework. Then each subcomponents can be solved using an evolutionary optimizer to find the optimum values. The experimental results show that this new technique is more effective than some existing grouping methods.