A random forest‐regression‐based inverse‐modeling evolutionary algorithm using uniform reference points

Pareto-based multi-objective evolutionary algorithms experience grand challenges in solving many-objective optimization problems due to their inability to maintain both convergence and diversity in a high-dimensional objective space. Exiting approaches usually modify the selection criteria to overcome this issue. Different from them, we propose a novel meta-objective (MeO) approach that transforms the many-objective optimization problems in which the new optimization problems become easier to solve by the Pareto-based algorithms. MeO converts a given many-objective optimization problem into a new one, which has the same Pareto optimal solutions and the number of objectives with the original one. Each meta-objective in the new problem consists of two components which measure the convergence and diversity performances of a solution, respectively. Since MeO only converts the problem formulation, it can be readily incorporated within any multi-objective evolutionary algorithms, including those non-Pareto-based ones. Particularly, it can boost the Pareto-based algorithms' ability to solve many-objective optimization problems. Due to separately evaluating the convergence and diversity performances of a solution, the traditional density-based selection criteria, for example, crowding distance, will no longer mistake a solution with poor convergence performance for a solution with low density value. By penalizing a solution in term of its convergence performance in the meta-objective space, the Pareto dominance becomes much more effective for a many-objective optimization problem. Comparative study validates the competitive performance of the proposed meta-objective approach in solving many-objective optimization problems.

In many objective optimization problems (MaOPs), more than three distinct objectives are optimized. The challenging part in MaOPs is to get the Pareto approximation (PA) with high diversity and good convergence. In Literature, in order to solve the issue of diversity and convergence in MaOPs, many approaches are proposed using different multi objective evolutionary algorithms (MOEAs). Moreover, to get better results, the researchers use the sets of reference points to differentiate the solutions and to model the search process, it further evaluates and selects the non-dominating solutions by using the reference set of solutions. Furthermore, this technique is used in some of the swarm-based evolutionary algorithms. In this paper, we have used some effective adaptations of bat algorithm with the previous mentioned approach to effectively handle the many objective problems. Moreover, we have called this algorithm as many objective bat algorithm (MaOBAT). This algorithm is a biologically inspired algorithm, which uses echolocation power of micro bats. Each bat represents a complete solution, which can be evaluated based on the problem specific fitness function and then based on the dominance relationship, non-dominated solutions are selected. In proposed MaOBAT, dominance rank is used as dominance relationship (dominance rank of a solution means by how many other solutions a solution dominated). In our proposed strategy, dynamically allocated set of reference points are used, allowing the algorithm to have good convergence and high diversity pareto fronts (PF). The experimental results show that the proposed algorithm has significant advantages over several state-of-the-art algorithms in terms of the quality of the solution.

An adaptive clustering-based evolutionary algorithm for many-objective optimization problems

A reference direction and entropy based evolutionary algorithm for many-objective optimization

An information entropy-driven evolutionary algorithm based on reinforcement learning for many-objective optimization

As an essential component in multi- and many-objective optimization, decision-making process either selects a subset of solutions from the whole Pareto front or guides the search toward a small part of the Pareto front during the evolutionary process. In recent years, for many-objective optimization problems (MaOPs), a number of evolutionary algorithms have been developed to search for Pareto optimal solutions. However, there is a lack of research works focusing on designing decision-making approaches. In order to overcome this deficiency, we propose a novel knee-based decision-making method to search for several solutions of interest (SOIs) from a large number of solutions on the Pareto front, each of which contains the best convergence performance at least within its neighborhood and can be identified as a global or local knee solution. The optimization performance achieved by all SOIs approximates the performance of the whole Pareto front as much as possible. Furthermore, in order to relieve the difficulties in the decision-making process on MaOPs, a new visualization approach is developed based on this proposed decision-making approach. It provides information about the shape and location of the Pareto front, the possible bulge, as well as the convergence degree and distribution of solutions. The experimental results on several benchmark functions demonstrate the superiority of the proposed design in the selection of SOIs and visualization of high-dimensional objective space.

The Pareto optimal solutions to a multi-objective optimization problem often distribute very regularly in both the decision space and the objective space. Most existing evolutionary algorithms do not explicitly take advantage of such a regularity. This paper proposed a model-based evolutionary algorithm (M-MOEA) for bi-objective optimization problems. Inspired by the ideas from estimation of distribution algorithms, M-MOEA uses a probability model to capture the regularity of the distribution of the Pareto optimal solutions. The local principal component analysis (local PCA) and the least-squares method are employed for building the model. New solutions are sampled from the model thus built. At alternate generations, M-MOEA uses crossover and mutation to produce new solutions. The selection in M-MOEA is the same as in non-dominated sorting genetic algorithm-II (NSGA-II). Therefore, MOEA can be regarded as a combination of EDA and NSGA-II. The preliminary experimental results show that M-MOEA performs better than NSGA-II.

Although the learning‐based surrogate model could achieve fast prediction, the model uncertainty in data and predictions remains a significant challenge. To alleviate the uncertainty problems for the surrogate model, a learning‐based uncertainty analysis method for improving the stability of the inverse model of RF devices is proposed. The inherent uncertainty in the inverse model is analyzed by leveraging ensemble adversarial learning, enabling the prediction of confidence intervals for the inverse surrogate model output without changing the original neural network structure. Subsequently, the differential evolution (DE) algorithm is employed to optimize the geometric parameters of the inverse model output within the predicted interval. To validate feasibility and effectiveness of the method, RF hairpin filter is used for the design example via the neural networks. RF filters with multiple center frequencies and bandwidths are simulated, fabricated and measured. Both simulated and measured results demonstrate a notable enhancement, with a 37.22% predicted accuracy improvement in the degree of fitting between the optimized response and the label of the input network, compared to the circuit response (S‐parameter) pre‐optimization. The proposed method exhibits much better performance in terms of the predicted accuracy and computational time compared to direct optimization without inverse model. The learning‐based method could also be applicable to the other RF devices, affirming the practical applicability and robustness of the approach.

Evolutionary algorithms and elliptical copulas applied to continuous optimization problems

Pareto dominance is an important concept and is usually used in multiobjective evolutionary algorithms (MOEAs) to determine the nondominated solutions. However, for many-objective problems, using Pareto dominance to rank the solutions even in the early generation, most obtained solutions are often the nondominated solutions, which results in a little selection pressure of MOEAs toward the optimal solutions. In this paper, a new ranking method is proposed for many-objective optimization problems to verify a relatively smaller number of representative nondominated solutions with a uniform and wide distribution and improve the selection pressure of MOEAs. After that, a many-objective differential evolution with the new ranking method (MODER) for handling many-objective optimization problems is designed. At last, the experiments are conducted and the proposed algorithm is compared with several well-known algorithms. The experimental results show that the proposed algorithm can guide the search to converge to the true PF and maintain the diversity of solutions for many-objective problems.

The Pareto front (Pareto set) of a continuous optimization problem with m objectives is a (m-1) dimensional piecewise continuous manifold in the objective space (the decision space) under some mild conditions. Based on this regularity property in the objective space, we have recently developed several multiobjective estimation of distribution algorithms (EDAs). However, this property has not been utilized in the decision space. Using the regularity property in both the objective and decision space, this paper proposes a simple EDA for multiobjective optimization. Since the location information has not efficiently used in EDAs, a combination of EDA and differential evolution (DE) is suggested for improving the algorithmic performance. The hybrid method and the pure EDA method proposed in this paper, and a DE based method are compared on several test instances. Experimental results have shown that the algorithm with the proposed strategy is very promising.

In recent years, many-objective optimization problems (i.e. more than three objectives) have attracted the interests of many researchers. The main difficulties of many-objective optimization problems lie in high computational cost, stagnation in search process, etc. It is almost impossible to design an algorithm effective for all problems. However, for some problems, especially for problems with redundant objectives, it is possible to design effective algorithms by removing the redundant objectives and keeping the non-redundant objectives so that the original problem becomes the one with much fewer objectives. To do so, first, a multi-objective evolutionary algorithm-based decomposition is adopted to generate a smaller number of representative non-dominated solutions widely distributed on the Pareto front. Then the conflicting objective pairs are identified through these non-dominated solutions, and the redundant objectives are determined by these pairs and then removed. Based on these, a fast non-redundant objectives generation algorithm is proposed in this paper. Finally, the experiments are conducted on a set of benchmark test problems and the results indicate the effectiveness and efficiency of the proposed algorithm.

Recently, evolutionary algorithms that can efficiently solve decomposable binary optimization problems have been developed. They are so-called model-based evolutionary algorithms, which build a model for generating solution candidates by applying a machine learning technique to a population. Their central procedure is linkage detection that reveals a problem structure, that is, how the entire problem consists of sub-problems. However, the model-based evolutionary algorithms have been shown to be ineffective for problems that do not have relevant structures or those whose structures are hard to identify. Therefore, evolutionary algorithms that can solve both types of problems quickly, reliably, and accurately are required. The objective of the paper is to investigate whether the evolutionary algorithm evolving developmental timings (EDT) that we previously proposed can be the desired one. The EDT makes some variables values more quickly converge than the remains for any problems, and then, decides values of the remains to obtain a higher fitness value under the fixation of the variables values. In addition, factors to decide which variable values converge more quickly, that is, developmental timings are evolution targets. Simulation results reveal that the EDT has worse performance than the linkage tree genetic algorithm (LTGA), which is one of the state-of-the-art model-based evolutionary algorithms, for decomposable problems and also that the difference in the performance between them becomes smaller for problems with overlaps among linkages and also that the EDT has better performance than the LTGA for problems whose structures are hard to identify. Those results suggest that an appropriate search strategy is different between decomposable problems and those hard to decompose.

Estimation of distribution algorithms (EDAs) are a successful branch of evolutionary algorithms (EAs) that evolve a probabilistic model instead of a population. Analogous to genetic drift in EAs, EDAs also encounter the phenomenon that the random sampling in the model update can move the sampling frequencies to boundary values not justified by the fitness. This can result in a considerable performance loss. This work gives the first tight quantification of this effect for three EDAs and one ant colony optimizer, namely for the univariate marginal distribution algorithm, the compact genetic algorithm, population-based incremental learning, and the max-min ant system with iteration-best update. Our results allow to choose the parameters of these algorithms in such a way that within a desired runtime, no sampling frequency approaches the boundary values without a clear indication from the objective function. This paper for the Hot-off-the-Press track at GECCO 2020 summarizes the work Sharp Bounds for Genetic Drift in Estimation of Distribution Algorithms by B. Doerr and W. Zheng, which has been accepted for publication in the IEEE Transactions on Evolutionary Computation [5].

Decomposition-based evolutionary algorithm with dual adjustments for many-objective optimization problems