Two-Stage Multi-Tasking Transform Framework for Large-Scale Many-objective Optimization Problems

Recently, the large-scale optimization problems have become a common research topic in the field of evolutionary computation. It is hard to find optimal solutions when solving large-scale multi-objective optimization problems (LSMOPs), due to the ineffectiveness of existing operators. In the other word, the search ability of most existing MOEAs on solving LSMOPs is still weak. To address this issue, an efficient competitive swarm optimizer with a strong exploration ability, denoted as E-CSO, is presented in this paper, which designs a novel three-particle-based particle updating strategy to improve the search efficiency. The experimental results validate the high efficiency and effectiveness of our proposed approach when solving various LSMOPs.

In this paper, we propose a framework to accelerate the computational efficiency of evolutionary algorithms on large-scale multiobjective optimization. The main idea is to track the Pareto optimal set (PS) directly via problem reformulation. To begin with, the algorithm obtains a set of reference directions in the decision space and associates them with a set of weight variables for locating the PS. Afterwards, the original large-scale multiobjective optimization problem is reformulated into a low-dimensional single-objective optimization problem. In the reformulated problem, the decision space is reconstructed by the weight variables and the objective space is reduced by an indicator function. Thanks to the low dimensionality of the weight variables and reduced objective space, a set of quasi-optimal solutions can be obtained efficiently. Finally, a multiobjective evolutionary algorithm is used to spread the quasi-optimal solutions over the approximate Pareto optimal front evenly. Experiments have been conducted on a variety of large-scale multiobjective problems with up to 5000 decision variables. Four different types of representative algorithms are embedded into the proposed framework and compared with their original versions, respectively. Furthermore, the proposed framework has been compared with two state-of-the-art algorithms for large-scale multiobjective optimization. The experimental results have demonstrated the significant improvement benefited from the framework in terms of its performance and computational efficiency in large-scale multiobjective optimization.

Multi-objective optimization problems with large-scale decision variables, known as LSMOPs, are characterized by their large-scale search space and multiple conflicting objectives to be optimized. They have been involved in many emergent real-world applications, such as feature and instance selection, data clustering, adversarial attack, vehicle routing problem, and others. In this work, we propose a new teaching-learning-based optimization algorithm to effectively tackle large-scale multi-objective optimization problems. The proposed approach ensures both the diversity of solutions, requested for high dimensionality of LSMOPs, and the balance between the exploitation and exploration during the optimization process. The experimental studies conducted on 54 instances of a large-scale multi-objective optimization problems test suite and the comparisons against well-known and state-of-the-art algorithms have shown the superiority of the proposed algorithm in terms of Pareto front approximation and computation time by using limited evaluation budget.

Directed quick search guided evolutionary framework for large-scale multi-objective optimization problems

Although there are many studies on large-scale unconstrained optimization (e.g., with 100 to 1000 variables) and small-scale constrained optimization (e.g., with 10 to 30 variables) using nature-inspired algorithms (e.g., evolutionary algorithms and swarm intelligence algorithms), no publicly available nature-inspired algorithm is developed for large-scale constrained optimization. In this paper, we combine a cooperative coevolutionary particle swarm optimization (CCPSO) algorithm with the e constrained method to solve large-scale real-valued constrained optimization problems. The eCCPSO framework is proposed, and three different algorithms based on the framework, i.e., eCCPSOd, eCCPSOw and eCCPSOw2, are developed. The proposed algorithms compare favorably to the state-of-the-art constrained optimization algorithm eDEag on large-scale problems. The experimental results further suggest that eCCPSOw2 with adaptive improvement detection technique is highly competitive compared with the other algorithms considered in this work for solving large-scale real-valued constrained optimization problems.

For large-scale multi-objective optimization, it is particularly challenging for evolutionary algorithms to converge to the Pareto Front. Most existing multi-objective evolutionary algorithms (MOEAs) handle convergence and diversity in a mutually dependent manner during the evolution process. In this case, the performance degradation of one solution may lead to the deterioration of the performance of the other solution. This paper proposes a two-stage multi-objective optimization algorithm based on decision variable clustering (LSMOEA-VT) to solve large-scale optimization problems. In LSMOEA-VT, decision variables are divided into two categories and use dimensionality reduction methods to optimize the variables that affect evolutionary convergence. Following this, we performed an interdependence analysis to break down the convergence variables into multiple subcomponents that are more tractable. Furthermore, a non-dominated dynamic weight aggregation method is used to enhance the diversity of the population. To evaluate the performance of our proposed algorithm, we performed extensive comparative experiments against four optimization algorithms across a diverse set of benchmark problems, including eight multi-objective optimization problems and nine large-scale optimization problems. The experimental results show that our proposed algorithm performs well on some test functions and has certain competitiveness.

Large-scale machine system optimization problems usually resist solution because large-scale machine systems often have a hierarchical general structure that produces numerous local optirna during hierarchical optimization. Genetic algorithms having hierarchical genotypes can be directly applied to the optimization of such problems, however the appearance of local optima during hierarchical optimization procedures often foils effective searching. To enable the global optimization of such problems, skillful analysis of the component relationships comprising the hierarchical problem allows the hierarchical structure to be divided into more tractable units. Divided optimization problems can then be optimized via multiple crenetic algorithm processes, and global large-scale optimization problems can be represented as hierarchical sets of genetic algorithm processes. The exchange of local searching information between these genetic algorithm processes enables global searching and parallel processing, both of which enhance the efficiency and quality of searching for optimum solutions to large-scale optimization problems.

We propose singular value decomposition (SVD) algorithms for very large-scale matrices based on a low-rank tensor decomposition technique called the tensor train (TT) format. By using the proposed algorithms, we can compute several dominant singular values and corresponding singular vectors of large-scale structured matrices given in a low-rank TT format. We propose a large-scale trace optimization problem, and in the proposed methods, the large-scale optimization problem is reduced to sequential small-scale optimization problems. We show that the computational complexity of the proposed algorithms scales logarithmically with the matrix size if the TT-ranks are bounded. Numerical simulations based on very large-scale Hilbert matrix demonstrate the effectiveness of the proposed methods.

An enhanced competitive swarm optimizer with strongly robust sparse operator for large-scale sparse multi-objective optimization problem

Meta-heuristic algorithms are widely viewed as feasible techniques to solve continuous large-scale numerical optimization problems. Grey wolf optimizer (GWO) is a relatively new stochastic algorithm with only a few parameters to adjust that can be easily used for global optimization. This paper presents an efficient and robust GWO (ERGWO) variant to solve large-scale numerical optimization problems. Inspired by particle swarm optimization, a nonlinearly adjustment strategy for parameter control is designed to balance exploration and exploitation. Additionally, a modified position-updating equation is presented to improve convergence speed. The performance of ERGWO is verified on 18 benchmark large-scale numerical optimization problems with dimensions ranging from 30 to 10,000, 30 benchmarks from CEC 2014, 30 functions in CEC 2017, respectively. Numerical experiments are performed to compare ERGWO to the basic GWO algorithm, other GWO variants, and other well-known meta-heuristic search techniques. Simulations demonstrate that the proposed ERGWO algorithm can find high quality solutions with low computational cost and very fast convergence.

Surrogate-assisted evolutionary algorithms provide an effective means for complex and computationally expensive optimization problems. However, due to the scarcity of training samples, the prediction accuracy of frequently-used regression surrogate models can hardly be guaranteed as the difficulty of the problem increases, resulting in performance degradation of the whole algorithm. Since real-world problems rarely exist in isolation, it is expected to alleviate the above issue by properly exploiting the knowledge shared across different problems. In this context, this study proposes a novel evolutionary multitasking optimization algorithm assisted by a classifier rather than a regression model for expensive multitasking problems, where the accuracy of the classifier is boosted by knowledge transfer. To be specific, a support vector classifier (SVC) is first developed and integrated into a classic evolutionary algorithm, i.e., covariance matrix adaptation evolution strategy (CMA-ES). With a low computational cost, it helps CMA-ES to prescreen parent solutions from the current population. Following that, a knowledge transfer strategy is designed to enrich the training samples for each task-oriented classifier by sharing high-quality solutions among different tasks, where a PCA-based subspace alignment technique is employed. Extensive experiments indicate that the SVC-assisted CMA-ES gains significant superiority over general CMA-ES in terms of both robustness and scalability, and the knowledge transfer strategy further helps it earn a competitive edge over some state-of-the-art algorithms on expensive multitasking optimization problems.

Today, because of the exponential growth of the volume of data in big data applications, large-scale optimization problems (i.e., optimization problems with a large number of decision variables) have become ubiquitous in the real world [219, 220]. In this chapter, building on the algorithms and observations presented for solving both continuous and combinatorial optimization problems, we further present a novel multi-space evolutionary search framework based on EMT for solving large-scale single-objective optimization problem.

Cooperative coevolution (CC) algorithms based on variable decomposition methods are efficient in solving large-scale optimization problems (LSOPs). However, many decomposition methods, such as the differential grouping (DG) method and its variants, are based on the theorem of function additively separable, which may not work well on problems that are not additively separable and will result in a bottleneck for CC to solve various LSOPs. This deficiency motivates us to study how the decomposition method can decompose more kinds of separable functions, such as the multiplicatively separable function, to improve the general problem-solving ability of CC on LSOPs. With this concern, this article makes the first attempt to decompose multiplicatively separable functions and proposes a novel method called dual DG (DDG) for better LSOP decomposition and optimization. The novelty and advantage of DDG are that it can be suitable for not only additively separable functions but also multiplicatively separable functions, which can considerably expand the application scope of CC. In this article, we will first define the multiplicatively separable function, and then mathematically show its relationship to the additively separable function and how they can be transformed into each other. Based on this, the DDG can use two kinds of differences to detect the separable structure of both additively and multiplicatively separable functions. In addition, the time complexity of DDG is analyzed and a DDG-based CC algorithm framework is developed for solving LSOPs. To verify the superiority of DDG, experiments and comparisons with some state-of-the-art and champion algorithms are conducted not only on 30 LSOPs based on the test suite of the IEEE CEC large-scale global optimization competition, but also on a case study of the parameter optimization for a neural network-based application.

A fast sampling based evolutionary algorithm for million-dimensional multiobjective optimization

A novel approach using transient chaotic neural network (TCNN) and self-organizing feature map (SOFM) process to solve large-scale combinatorial optimization problems has been proposed. With the clustering function of self-organizing feature map, the computational cost of a large-scale combinatorial optimization problem solved by TCNN is reduced. Numerical simulation of TSP shows that the proposed method is effective to solve large-scale optimization problems.