Differential Evolution Based on Fitness Euclidean-Distance Ratio for Multimodal Optimization

In artificial intelligence, evolutionary algorithms (EAs) have shown to be effective and robust in solving difficult optimization problems. EAs are generic populationbased metaheuristic optimization algorithms. The mechanisms used in EAs are inspired by biological evolution: reproduction, mutation, recombination, and selection. The development of EAs can be classified into two categories: single objective and multi-objective optimization. In this thesis, both single objective and multi-objective evolutionary algorithms have been studied. For single objective optimization, various niching techniques are integrated with differential evolution (DE) and particle swarm optimization (PSO) for multi-modal optimization. Multi-modal optimization deals with optimization tasks that involve finding all or most of the global/local peaks in one single run. EAs in their original forms are usually designed for locating one single global solution. To promote and maintain formation of multiple stable subpopulations within a single population, we introduced a neighborhood mutation technique to enhance DE with ability of handling multi-modal problems. We also proposed a locally informed PSO to tackle multi-modal optimization. Beside these, several existing niching techniques from the literature were modified and improved by us.

Multimodal multiobjective optimization problems (MMOPs) have attracted wide attention in recent years. This kind of problem is very challenging since they need to locate different Pareto-optimal solution sets (PSs) that correspond to the same Pareto front. To resolve it, this article proposes a novel multimodal multiobjective differential evolution (DE) algorithm with species conservation, which develops a new way of locating different PSs. Specifically, the proposed algorithm adopts species conservation to determine different PSs in known areas, while it uses a variant of DE as the basic optimizer to explore new areas. There are three operators in species conservation: 1) species division; 2) seed determination; and 3) seed conservation. Species division mainly partitions the joint population of parents and children into various species in the decision space for retaining different PSs. Seed determination selects superior solutions from each species as seeds that need to be kept in the next generation. Seed conservation is to ensure that all species seeds are retained in the new generation by substituting no promising solutions with them, thereby guarantee not missing some known areas that may contain different PSs. Besides, the DE variant is utilized to produce diverse solutions to find new areas in the decision space where PSs may exist. The comparative experiments with ten state-of-the-art algorithms have been performed on the CEC 2019 MMOPs test set and two real-world problems. The experimental results have verified that the proposed algorithm has a competitive performance for MMOPs.

This article proposes a two-stage hybrid multimodal optimizer based on invasive weed optimization (IWO) and differential evolution (DE) algorithms for locating and preserving multiple optima of a real-parameter functional landscape in a single run. Both IWO and DE have been modified from their original forms to meet the demands of the multimodal problems used in this work. A p-best crossover operation is introduced in the subregional DEs to improve their exploitative behaviour. The performance of the proposed algorithm is compared with a number of state-of-the-art multimodal optimization algorithms over a benchmark suite comprising 21 basic multimodal problems and seven composite multimodal problems. Experimental results suggest that the proposed technique is able to provide better and more consistent performance over the existing well-known multimodal algorithms for the majority of test problems without incurring any serious computational burden.

Multimodal optimization is one of the most challenging tasks for optimization. It requires an algorithm to effectively locate multiple global and local optima, not just single optimum as in a single objective global optimization problem. To address this objective, this paper first investigates a cluster-based differential evolution (DE) for multimodal optimization problems. The clustering partition is used to divide the whole population into subpopulations so that different subpopulations can locate different optima. Furthermore, the self-adaptive parameter control is employed to enhance the search ability of DE. In this paper, the proposed multipopulation strategy and the self-adaptive parameter control technique are applied to two versions of DE, crowding DE (CDE) and species-based DE (SDE), which yield self-CCDE and self-CSDE, respectively. The new algorithms are tested on two different sets of benchmark functions and are compared with several state-of-the-art designs. The experiment results demonstrate the effectiveness and efficiency of the proposed multipopulation strategy and the self-adaptive parameter control technique. The proposed algorithms consistently rank top among all the competing state-of-the-art algorithms.

Differential evolution (DE) is undoubtedly one of the most powerful stochastic searching optimization algorithms. However, solving a specific problem using DE crucially depends on appropriately choosing of trial vector generation strategies and their associated control parameters. At the same time, multimodal optimization refers to locating not only one optimum but a set of optimal solutions. Niching is a useful technique to solve multi-modal optimization problems. Discovering multiple niches is the key capability of niching algorithms. In this paper, we propose a Strategy Adaptive Memetci Crowding DE (SAMCDE), which incorporate Crowding DE (CDE) with strategies and control parameter self-adaptation technique as well as fine search technique to handle multi-modal optimization problems. The algorithm is tested on 10 benchmark multi-modal functions and compared with the original CDE as well as several popular multimodal optimization algorithms in literature. As shown by the experimental results, the proposed algorithm is able to generate superior performance on the tested functions.

Differential evolution (DE) is a powerful evolutionary algorithm for global optimization problems. Generally, appropriate mutation strategies and proper equilibrium between global exploration and local exploitation are significant to the performance of DE. From this consideration, in this paper, we present a novel DE variant, abbreviated to DMIE-DE, to further enhance the optimization capacity of DE by developing a dual mutations collaboration mechanism with elites guiding and inferiors eliminating techniques. More specifically, an explorative mutation strategy DE/current-to-embest with an elite individual serving as part of the difference vector and an exploitative mutation strategy DE/ebest-to-rand with selecting an elite individual as the base vector are employed simultaneously to achieve the balance between local and global performance of the whole population instead of only one mutation strategy in classical DE algorithm. The control parameters F and CR for above mutation strategies are updated adaptively to supplement the optimization ability of DMIE-DE based on a rational probability distribution model and the successful experience from the previous iterations. Moreover, an inferior solutions eliminating technique is embedded to enhance the convergence speed and compensate cost of the fitness evaluation times during the evaluation process. To evaluate the performance of DMIE-DE, experiments are conducted by comparing with five state-of-the-art DE variants on solving 29 test functions in CEC2017 benchmark set. The experimental results indicate that the performance of DMIE-DE is significantly better than, or at least comparable to the considered DE variants.

Differential Evolution (DE) is a very simple but powerful Evolutionary Algorithm (EA) for real-world applications. There are two aspects affecting the overall optimization performance significantly, one is parameter control scheme and the other is trial vector generation strategy. As all the control parameters are employed in generating trial vectors, from this perspective of view, the trial vector generation strategy dominates the overall optimization performance. Therefore, trial vector generation strategies are often designed first, and then the corresponding parameter control schemes are well-tuned thereafter. Both of them constitute the main body of a new DE variant. Here in the paper, a novel DE variant with a new designed trial vector generation strategy as well as novel parameter control scheme is proposed to tackle freight trains scheduling problem. By incorporating both a time-stamp mechanism of the external archive and a novel parameter control scheme, the new algorithm can secure better optimization performance not only on man-made benchmarks but also on real-world applications. Both the man-made benchmarks from Congress on Evolutionary Computation (CEC) test suite and the real-world freight train scheduling problem are employed in the validation of the new DE variant. The experiment results show that it is competitive with other state-of-the-art DE techniques for these optimization problems.

Differential evolution (DE), as a class of biologically inspired and meta-heuristic techniques, has attained increasing popularity in solving many real world optimization problems. However, DE is not always successful. It can easily get stuck in a local optimum or an undesired stagnation condition. This paper proposes a new DE algorithm Differential Evolution with Alopex-Based Local Search (DEALS), for enhancing DE performance. Alopex uses local correlations between changes in individual parameters and changes in function values to estimate the gradient of the landscape. It also contains the idea of simulated annealing that uses temperature to control the probability of move directions during the search process. The results from experiments demonstrate that the use of Alopex as local search in DE brings substantial performance improvement over the standard DE algorithm. The proposed DEALS algorithm has also been shown to be strongly competitive (best rank) against several other DE variants with local search.

Differential Evolution with exponential crossover can be also competitive on numerical optimization

We compared two floating-point-encoded evolutionary algorithms (EA) – differential evolution (DE) and the generalized generation gap (G3) – using a set of problems with different characteristics. G3 is reported to offer superior performance with unimodal functions, which are, however, often solved more efficiently using derivative-based optimization for example and it is interesting to know, how these algorithms perform in multimodal global optimization problems. Our results suggest that G3 converges fast but is prone to converge prematurely rather than finding the global optimum in high-dimensional multimodal problems. DE, in contrast, appears to handle multimodal problems better but cannot match convergence speed of G3 in unimodal problems.

Multimodal optimization is one of the most challenging issues in the field of optimization, which requires to detect and locate multiple global and local optima. Differential evolution (DE) is a well-known and powerful optimization algorithm with fast convergence capability. In this paper, we proposed a method to accurately solve high dimensional multimodal problems based on DE. Parallel sub-populations that are created using roaming algorithm, are randomly assigned with several chaotically improved strategies. Furthermore, a novel Hill-Valley method is proposed for detecting whether two points are in same species or not. Finally, our proposed approach is compared with well-known state-of-the-art niching algorithms and results show that our approach outperforms all of them.

Novel benchmark functions for continuous multimodal optimization with comparative results

Differential evolution with orthogonal array‐based initialization and a novel selection strategy

In recent years, many new variants of Differential Evolution (DE) have been proposed for real number function optimization, and most of these variants employ binomial recombination as their crossover operators. By contrast, another classical crossover operator, exponential recombination, received less attention. This paper examines the explorative ability of exponential recombination in handling high-dimensional multimodal problems. Based on the analysis, a new variant of DE with a hybrid crossover operation is proposed. DE/best/1, a greedy mutation strategy rarely used in tackling multimodal problems, is utilized in our algorithm to help combine the two basic recombination operators. Empirical results demonstrate that the proposed algorithm is powerful in solving high-dimensional multimodal problems.

Differential evolution (DE) algorithm is a global optimization algorithm over continuous search space. DE also has been applied in many fields, such as artificial neural networks, chemical engineering, mechanical design, robotics, signal processing, biological information, and economics. At the same time, as a powerful evolutionary algorithm for solving global numerical optimization problems, the DE algorithm has drawn more and more attention. However, how to make a proper balance between the global and local search is a burning question and to limit the optimization performance of DE. In this paper, an improved algorithm η_CODE with a new η_Cauchy operator is proposed to enhance the global and local search ability of a well-known DE variant JADE. In order to guarantee the effective performance of the proposed operator, all the fitness values are ranked through a ranking scheme based on increasing order before a new η_Cauchy operator is conducted. The pNP individuals that have better fitness are selected and carried out Cauchy disturbance operation considering the complexity of the algorithm. The Dynamic parameter mechanism is utilized to select pNP individuals that number is also adjusted dynamically in each generation. The scale factor F and crossover probability CR are obtained with Lehmer mean without using determined parameter c in JADE, which aims to balance the exploration and exploitation of the algorithm during the running time. A total of sixty benchmark functions from CEC2014 and CEC2017 on real parameter optimization are employed to prove the validity of η_CODE for solving complex high-dimensional problems. The experiments indicate that η_CODE is better than or at least comparable with several state-of-the-art DE variants, including JADE, SinDE, TSDE, AGDE, and EFADE in the global numerical optimization problems. In order to further analyze the performance of η_CODE, we also select extra two high-powered modified algorithms called EBLSHADE and LSHADESPACMA based on LSHADE to discuss advantages and disadvantages of the proposed algorithm.