Clustering based on differential evolution algorithm with weighted validity function

The Differential Evolution (DE) algorithm, under the family of Evolutionary Algorithms (EAs), is one of the powerful algorithms used for solving continuous parameter optimization challenges. The simplistic nature and robustness of the classical DE algorithm have drawn researchers' attention towards its progressive enhancement. This work reports on an investigation of the behavioral changes of the classical DE algorithm, evoked when its mutation and crossover components are fine tuned for enhancement of DE's performance. The scope of this study covers the implementation of a mutation level enhancement and a crossover level enhancement, followed by their integration. The mutation and the crossover components are augmented by incorporation of Centroid DE and Superior-Superior & Superior-Inferior DE logics, respectively. The algorithms appraised in this inquiry were classical DE, Centroid based DE(cDE), Superior-Superior based DE (ssDE), Superior-Inferior DE (siDE), Centroid Superior-Superior DE (cssDE) and Centroid Superior-Inferior DE (csiDE). These algorithms were evaluated by comparison of the values of their mean objective function (MOV), and their speed, at solving the global optimization problems in a simple benchmarking function suite with 4 functions of different categories. The study concludes that the DE algorithm shows enhancement performance with modified mutation and crossover components. However, with a trend for inconsistency for varying values of its control parameters and benchmarking problems.

Social learning differential evolution

A new mutation concept is proposed to generalize local selection based Differential Evolution algorithm to work in general multi-modal problems. Three variations of the proposed method are compared with classic Differential Evolution algorithm using a set of five well known test functions and their variants. The general idea of the new mutation operation is to divide the mutation into two parts: the local and global mutation. The global mutation works as a migration operator allowing the algorithm perform global search efficiently, while the local mutation improves the efficiency of local search.The results show that the concept of global mutation is able to generalize the good performance of local selection based Differential Evolution from convex uni-modal functions to general non-convex and multi-modal problems. Among the tested functions, the new method was able to outperform the classic Differential Evolution in all butone. A limited analysis of the effects of control parameters to the performance of the algorithm is also done.

Differential evolution (DE) algorithm is a global optimization algorithm over continuous search space. DE also has been applied in many fields, such as artificial neural networks, chemical engineering, mechanical design, robotics, signal processing, biological information, and economics. At the same time, as a powerful evolutionary algorithm for solving global numerical optimization problems, the DE algorithm has drawn more and more attention. However, how to make a proper balance between the global and local search is a burning question and to limit the optimization performance of DE. In this paper, an improved algorithm η_CODE with a new η_Cauchy operator is proposed to enhance the global and local search ability of a well-known DE variant JADE. In order to guarantee the effective performance of the proposed operator, all the fitness values are ranked through a ranking scheme based on increasing order before a new η_Cauchy operator is conducted. The pNP individuals that have better fitness are selected and carried out Cauchy disturbance operation considering the complexity of the algorithm. The Dynamic parameter mechanism is utilized to select pNP individuals that number is also adjusted dynamically in each generation. The scale factor F and crossover probability CR are obtained with Lehmer mean without using determined parameter c in JADE, which aims to balance the exploration and exploitation of the algorithm during the running time. A total of sixty benchmark functions from CEC2014 and CEC2017 on real parameter optimization are employed to prove the validity of η_CODE for solving complex high-dimensional problems. The experiments indicate that η_CODE is better than or at least comparable with several state-of-the-art DE variants, including JADE, SinDE, TSDE, AGDE, and EFADE in the global numerical optimization problems. In order to further analyze the performance of η_CODE, we also select extra two high-powered modified algorithms called EBLSHADE and LSHADESPACMA based on LSHADE to discuss advantages and disadvantages of the proposed algorithm.

In this paper we present an empirical , comparative performance, analysis of fourteen variants of Differential Evolution (DE) and Multiple Trial Vectors Differential Evolution algorithms to solve unconstrained global optimization problems. The aim is (1) to compare Multiple Trial Vectors DE, which allows each parent vector in the population to generate more than one trial vector, against the classical DE and (2) to identify the competitive variants which perform reasonably well on problems with different features. The DE and Multiple Trial Vectors DE variants are benchmarked on 6 test functions grouped by features --- unimodal separable, unimodal nonseparable, multimodal separable and multimodal non-separable. The analysis identifies the competitive variants and shows that Multiple Trial Vectors DE compares well with the classical DE.

In recent years, Differential Evolution (DE) algorithm that is one of the most important delegate of the evolutionary algorithms have been successfully used for solving different optimization problems with its both serial and parallel variants. In this study, the performance of DE algorithm powered with cooperative emigrant creation strategy was investigated over the different types of numerical problems and obtained results were compared with the results of the serial DE and parallel DE algorithm supported with conventional emigrant creation strategy. Experimental studies showed that the convergence speed of the parallel DE algorithm is significantly improved with the cooperative emigrant creation strategy and the proposed parallel DE algorithm produces better results compared to the serial DE algorithm and parallel DE algorithm with the conventional emigrant creation strategy.

Application of a Derivative-Free Method with Projection Skill to Solve an Optimization Problem

In this work, a method to control the parameters of Differential Evolution (DE) algorithm is proposed. Here the control parameters of DE are co-evolved by Particle Swarm Optimization (PSO) algorithm. The classical DE algorithm has two main control parameters: Scale Factor (F) and Cross-over Rate (CR). These are selected on trial-and-error basis for solving optimization problems. Several optimization problems lead to optimal or sub-optimal solution by proper selection of control parameters of the DE algorithm. In this proposed method, PSO algorithm is used to tune the scale factor and cross-over rate in DE algorithm. Basically PSO algorithm is used as a meta-optimizer for DE algorithm. The proposed method is termed as mPSO-DE in this paper. The mPSO-DE algorithm is applied on 12 benchmark unconstrained optimization problems. The obtained results are compared with that of classical DE algorithm. From the experimental studies, it has been found that the proposed mPSO-DE algorithm performed better than DE algorithm.

Differential evolution is a simple yet efficient heuristic originally designed for global optimization over continuous spaces that has been used in many research areas. The question how to improve its performance is still popular and during the years, many successful methods dealing with optimal setting or hybridization of the control parameters were proposed. In this paper, we propose a novel approach based on modeling of the differential evolution dynamics by complex networks. In each generation, the individuals are mapped to the nodes and the relationships between them are modeled by the edges of the graph. Thanks to this simple visualization, the interconnection between the differential evolution convergence speed and the weighted clustering coefficients has been revealed. As a consequence, we have focused on the parents selection in the mutation step where the individuals are not selected randomly as usual but on the basis of their weighted clustering coefficients. Our enhancement has been incorporated in the classical differential evolution, self-adaptive differential evolution (jDE) and differential evolution with composite trial vector generation strategies and control parameters. Finally, a set of well-known benchmark functions (including 21 functions) has been used to test and evaluate the performance of the proposed enhancement of the differential evolution. The experimental results and statistical analysis indicate that the enhanced algorithms perform better or at least comparable to their original versions and the analysis of the differential evolution dynamics with the aim of the complex network might be an effective tool to improve the differential evolution convergence in the future.

Regulation-based formulas and improved Differential Evolution(DE) algorithm is used to optimize PID parameters. In order to improve the global search ability and the convergence rate of the common DE algorithm, self-adaptive method is introduced to obtain DE parameters. On the other hand, initial population quality of DE algorithm has important influence on convergence of the algorithm. So the regulation-based formulas are used to guide the production of initial population, which is good to improve the convergence rate and realize obtaining of PID parameters completely adaptive without any personal experience. The simulation is developed on steam temperature system of cycle fluidized bed boiler with serious parameter uncertainties and many disturbance and long-time delay. The results show that the improved DE algorithm has higher optimal speed, small amount of calculation and effective optimization of parameters. The proposed method has better control quality and system robustness.

Q-Learning-based parameter control in differential evolution for structural optimization

A self-competitive mutation strategy for Differential Evolution algorithms with applications to Proportional–Integral–Derivative controllers and Automatic Voltage Regulator systems

An efficient variant of differential evolution (DE) algorithm, namely subpopulated differential evolution (subDE), is proposed for solving null synthesis problems of time-modulated circular antenna arrays by controlling time intervals and phases. The capabilities of subDE algorithm are examined by comparing its convergence curves and number of successful optimizations to those of the classical DE. Wilcoxon rank-sum test is also applied to ensure that the results are significant in terms of statistics. Furthermore, the antenna array parameters achieved by using subDE are compared to those of the classical DE in the literature. The results show that subDE can exhibit better performance than the classical DE for our antenna array synthesis examples. Additionally, the simulations are executed on an embedded microprocessor to investigate if subDE can also run on such a limited environment. The results demonstrate that the contemporary embedded systems hold promise for evolutionary algorithms.

A new method for optimum shape design of variable capacitance micromotor (VCM) using Differential Evolution (DE), a stochastic search algorithm, is presented. In this optimization exercise, the objective function aims to maximize torque value and minimize the torque ripple, where the geometric parameters are considered to be the variables. The optimization process is carried out using a combination of DE algorithm and FEM analysis. Fitness value is calculated by FEM analysis using COMSOL3.4, and the DE algorithm is realized by MATLAB7.4. The proposed method is applied to a VCM with 8 poles at the stator and 6 poles at the rotor. The results show that the optimized micromotor using DE algorithm had higher torque value and lower torque ripple, indicating the validity of this methodology for VCM design.

In this paper, a new control parameter adaptation scheme is introduced into the classical differential evolution (DE) algorithm. Then, a method for nonlinear system identification is proposed. The method combines modified differential evolution (MDE) and radial basis function (RBF) neural networks, which can auto-configure the structure of RBF networks and obtain the model parameters. The RBF network structure and parameters could be determined simultaneously based on input-output data without a priori knowledge. Finally, an example of nonlinear function identification is given to illustrate the effectiveness of the proposed approach.