An enhanced competitive swarm optimizer with strongly robust sparse operator for large-scale sparse multi-objective optimization problem

A Cluster-Based Competitive Particle Swarm Optimizer with a Sparse Truncation Operator for Multi-Objective Optimization

In real-world applications, there exist a lot of multiobjective optimization problems whose Pareto-optimal solutions are sparse, that is, most variables of these solutions are 0. Generally, many sparse multiobjective optimization problems (SMOPs) contain a large number of variables, which pose grand challenges for evolutionary algorithms to find the optimal solutions efficiently. To address the curse of dimensionality, this article proposes an evolutionary algorithm for solving large-scale SMOPs, which aims to mine the sparse distribution of the Pareto-optimal solutions and, thus, considerably reduces the search space. More specifically, the proposed algorithm suggests an evolutionary pattern mining approach to detect the maximum and minimum candidate sets of the nonzero variables in the Pareto-optimal solutions, and uses them to limit the dimensions in generating offspring solutions. For further performance enhancement, a binary crossover operator and a binary mutation operator are designed to ensure the sparsity of solutions. According to the results on eight benchmark problems and four real-world problems, the proposed algorithm is superior over existing evolutionary algorithms in solving large-scale SMOPs.

In this paper, we propose a framework to accelerate the computational efficiency of evolutionary algorithms on large-scale multiobjective optimization. The main idea is to track the Pareto optimal set (PS) directly via problem reformulation. To begin with, the algorithm obtains a set of reference directions in the decision space and associates them with a set of weight variables for locating the PS. Afterwards, the original large-scale multiobjective optimization problem is reformulated into a low-dimensional single-objective optimization problem. In the reformulated problem, the decision space is reconstructed by the weight variables and the objective space is reduced by an indicator function. Thanks to the low dimensionality of the weight variables and reduced objective space, a set of quasi-optimal solutions can be obtained efficiently. Finally, a multiobjective evolutionary algorithm is used to spread the quasi-optimal solutions over the approximate Pareto optimal front evenly. Experiments have been conducted on a variety of large-scale multiobjective problems with up to 5000 decision variables. Four different types of representative algorithms are embedded into the proposed framework and compared with their original versions, respectively. Furthermore, the proposed framework has been compared with two state-of-the-art algorithms for large-scale multiobjective optimization. The experimental results have demonstrated the significant improvement benefited from the framework in terms of its performance and computational efficiency in large-scale multiobjective optimization.

Directed quick search guided evolutionary framework for large-scale multi-objective optimization problems

This work proposes a new moment-SOS hierarchy, called CS-TSSOS , for solving large-scale sparse polynomial optimization problems. Its novelty is to exploit simultaneously correlative sparsity and term sparsity by combining advantages of two existing frameworks for sparse polynomial optimization. The former is due to Waki et al. [ 40 ] while the latter was initially proposed by Wang et al. [ 42 ] and later exploited in the TSSOS hierarchy [ 46 , 47 ]. In doing so we obtain CS-TSSOS—a two-level hierarchy of semidefinite programming relaxations with (i) the crucial property to involve blocks of SDP matrices and (ii) the guarantee of convergence to the global optimum under certain conditions. We demonstrate its efficiency and scalability on several large-scale instances of the celebrated Max-Cut problem and the important industrial optimal power flow problem, involving up to six thousand variables and tens of thousands of constraints.

A fast sampling based evolutionary algorithm for million-dimensional multiobjective optimization

Today, because of the exponential growth of the volume of data in big data applications, large-scale optimization problems (i.e., optimization problems with a large number of decision variables) have become ubiquitous in the real world [219, 220]. In this chapter, building on the algorithms and observations presented for solving both continuous and combinatorial optimization problems, we further present a novel multi-space evolutionary search framework based on EMT for solving large-scale single-objective optimization problem.

Recently, the large-scale optimization problems have become a common research topic in the field of evolutionary computation. It is hard to find optimal solutions when solving large-scale multi-objective optimization problems (LSMOPs), due to the ineffectiveness of existing operators. In the other word, the search ability of most existing MOEAs on solving LSMOPs is still weak. To address this issue, an efficient competitive swarm optimizer with a strong exploration ability, denoted as E-CSO, is presented in this paper, which designs a novel three-particle-based particle updating strategy to improve the search efficiency. The experimental results validate the high efficiency and effectiveness of our proposed approach when solving various LSMOPs.

Real-world optimization applications in complex systems always contain multiple factors to be optimized, which can be formulated as multi-objective optimization problems. Many classical evolutionary algorithms are good at solving these problems, such as MOEA/D, NSGA-III and KnEA. However, when the numbers of decision variables and objectives increase, the computation costs of those mentioned algorithms will be very high. To reduce such high computation cost, we proposed a two-stage framework to address the large-scale many-objective optimization problems. Combining with a multi-tasking optimization strategy and a bi-directional search strategy in the first stage, it reformulates the multi-objective problem into a multi-tasking problem in the decision space to enhance the convergence. To improve the diversity, in the second stage, the proposed algorithm applies multi-tasking optimization to a number of sub-problems based on reference points in the objective space. In this paper, to prove the effectiveness of the proposed algorithm, we test the algorithm on the DTLZ problems and compare it with classical algorithms, and it performs the best in most cases and shows disadvantage on both convergence and diversity.

Dynamic matrix-based evolutionary algorithm for large-scale sparse multiobjective optimization problems

For large-scale multi-objective optimization, it is particularly challenging for evolutionary algorithms to converge to the Pareto Front. Most existing multi-objective evolutionary algorithms (MOEAs) handle convergence and diversity in a mutually dependent manner during the evolution process. In this case, the performance degradation of one solution may lead to the deterioration of the performance of the other solution. This paper proposes a two-stage multi-objective optimization algorithm based on decision variable clustering (LSMOEA-VT) to solve large-scale optimization problems. In LSMOEA-VT, decision variables are divided into two categories and use dimensionality reduction methods to optimize the variables that affect evolutionary convergence. Following this, we performed an interdependence analysis to break down the convergence variables into multiple subcomponents that are more tractable. Furthermore, a non-dominated dynamic weight aggregation method is used to enhance the diversity of the population. To evaluate the performance of our proposed algorithm, we performed extensive comparative experiments against four optimization algorithms across a diverse set of benchmark problems, including eight multi-objective optimization problems and nine large-scale optimization problems. The experimental results show that our proposed algorithm performs well on some test functions and has certain competitiveness.

In large-scale multiobjective optimization, too many decision variables hinder the convergence search of evolutionary algorithms. Reducing the search range of the decision space will significantly alleviate this puzzle. With this in mind, this paper proposes a fuzzy decision variables framework for large-scale multiobjective optimization. The framework divides the entire evolutionary process into two main stages: fuzzy evolution and precise evolution. In fuzzy evolution, we blur the decision variables of the original solution to reduce the search range of the evolutionary algorithm in the decision space so that the evolutionary population can quickly converge. The degree of fuzzification gradually decreases with the evolutionary process. Once the population approximately converges, the framework will turn to precise evolution. In precise evolution, the actual decision variables of the solution are directly optimized to increase the diversity of the population so as to be closer to the true Pareto optimal front. Finally, this paper embeds some representative algorithms into the proposed framework and verifies the framework’s effectiveness through comparative experiments on various large-scale multiobjective problems with 500 to 5000 decision variables. Experimental results show that in large-scale multiobjective optimization, the framework proposed in this paper can significantly improve the performance and computational efficiency of multiobjective optimization algorithms.

A multi-modal multi-objective optimization problem is a special kind of multi-objective optimization problem with multiple Pareto subsets. In this paper, we propose an efficient multi-modal multi-objective optimization algorithm based on the widely used MOEA/D algorithm. In our proposed algorithm, each weight vector has its own sub-population. With a clearing mechanism and a greedy removal strategy, our proposed algorithm can effectively preserve equivalent Pareto optimal solutions (i.e., different Pareto optimal solutions with same objective values). Experimental results show that our proposed algorithm can effectively preserve the diversity of solutions in the decision space when handling large-scale multi-modal multi-objective optimization problems.

Although there are many studies on large-scale unconstrained optimization (e.g., with 100 to 1000 variables) and small-scale constrained optimization (e.g., with 10 to 30 variables) using nature-inspired algorithms (e.g., evolutionary algorithms and swarm intelligence algorithms), no publicly available nature-inspired algorithm is developed for large-scale constrained optimization. In this paper, we combine a cooperative coevolutionary particle swarm optimization (CCPSO) algorithm with the e constrained method to solve large-scale real-valued constrained optimization problems. The eCCPSO framework is proposed, and three different algorithms based on the framework, i.e., eCCPSOd, eCCPSOw and eCCPSOw2, are developed. The proposed algorithms compare favorably to the state-of-the-art constrained optimization algorithm eDEag on large-scale problems. The experimental results further suggest that eCCPSOw2 with adaptive improvement detection technique is highly competitive compared with the other algorithms considered in this work for solving large-scale real-valued constrained optimization problems.

Large-scale machine system optimization problems usually resist solution because large-scale machine systems often have a hierarchical general structure that produces numerous local optirna during hierarchical optimization. Genetic algorithms having hierarchical genotypes can be directly applied to the optimization of such problems, however the appearance of local optima during hierarchical optimization procedures often foils effective searching. To enable the global optimization of such problems, skillful analysis of the component relationships comprising the hierarchical problem allows the hierarchical structure to be divided into more tractable units. Divided optimization problems can then be optimized via multiple crenetic algorithm processes, and global large-scale optimization problems can be represented as hierarchical sets of genetic algorithm processes. The exchange of local searching information between these genetic algorithm processes enables global searching and parallel processing, both of which enhance the efficiency and quality of searching for optimum solutions to large-scale optimization problems.