A Refined Differential Evolution Algorithm for Improving the Performance of Optimization Process

Application of a Derivative-Free Method with Projection Skill to Solve an Optimization Problem

The Differential Evolution (DE) algorithm, under the family of Evolutionary Algorithms (EAs), is one of the powerful algorithms used for solving continuous parameter optimization challenges. The simplistic nature and robustness of the classical DE algorithm have drawn researchers' attention towards its progressive enhancement. This work reports on an investigation of the behavioral changes of the classical DE algorithm, evoked when its mutation and crossover components are fine tuned for enhancement of DE's performance. The scope of this study covers the implementation of a mutation level enhancement and a crossover level enhancement, followed by their integration. The mutation and the crossover components are augmented by incorporation of Centroid DE and Superior-Superior & Superior-Inferior DE logics, respectively. The algorithms appraised in this inquiry were classical DE, Centroid based DE(cDE), Superior-Superior based DE (ssDE), Superior-Inferior DE (siDE), Centroid Superior-Superior DE (cssDE) and Centroid Superior-Inferior DE (csiDE). These algorithms were evaluated by comparison of the values of their mean objective function (MOV), and their speed, at solving the global optimization problems in a simple benchmarking function suite with 4 functions of different categories. The study concludes that the DE algorithm shows enhancement performance with modified mutation and crossover components. However, with a trend for inconsistency for varying values of its control parameters and benchmarking problems.

In recent years, Differential Evolution (DE) algorithm that is one of the most important delegate of the evolutionary algorithms have been successfully used for solving different optimization problems with its both serial and parallel variants. In this study, the performance of DE algorithm powered with cooperative emigrant creation strategy was investigated over the different types of numerical problems and obtained results were compared with the results of the serial DE and parallel DE algorithm supported with conventional emigrant creation strategy. Experimental studies showed that the convergence speed of the parallel DE algorithm is significantly improved with the cooperative emigrant creation strategy and the proposed parallel DE algorithm produces better results compared to the serial DE algorithm and parallel DE algorithm with the conventional emigrant creation strategy.

Variational Quantum Algorithms (VQAs) are among the most promising NISQ-era algorithms for harnessing quantum computing in diverse fields. However, the underlying optimization processes within these algorithms usually deal with local minima and barren plateau problems, preventing them from scaling efficiently. Our goal in this paper is to study alternative optimization methods that can avoid or reduce the effect of these problems. To this end, we propose to apply the Differential Evolution (DE) algorithm to VQAs optimizations. Our hypothesis is that DE is resilient to vanishing gradients and local minima for two main reasons: (1) it does not depend on gradients, and (2) its mutation and recombination schemes allow DE to continue evolving even in these cases. To demonstrate the performance of our approach, first, we use a robust local minima problem to compare state-of-the-art local optimizers (SLSQP, COBYLA, L-BFGS-B and SPSA) against DE using the Variational Quantum Eigensolver algorithm. Our results show that DE always outperforms local optimizers. In particular, in exact simulations of a 1D Ising chain with 14 qubits, DE achieves the ground state with a 100% success rate, while local optimizers only exhibit around 40%. We also show that combining DE with local optimizers increases the accuracy of the energy estimation once avoiding local minima. Finally, we demonstrate how our results can be extended to more complex problems by studying DE performance in a 1D Hubbard model.

Over the past decades, Assisted History Matching has been the new norm for history matching that leverages the rapid advancement in digital computational performance. Continuous advancements such as parallel computing and GPU accelerates numerical simulation which overcomes the cumbersome experience of working with large fine-scaled model that mainly concerns the simulation time and intervention of engineers. As more interest emerges around artificial intelligence in the optimisation process, this paper explores the Artificial Intelligence algorithm to optimize two proxy modelling techniques: Quadratic Polynomial and Artificial Neural Network proxy model. These techniques are compared with stochastic optimisation method known as Differential Evolution algorithm on their efficiency of optimizing the objective functions, time taken, and knowledge investment needed by engineer, given today's hardware technology. This paper starts off by using Latin hypercube experimental design to generate first ensemble of simulation cases to generate proxy models to match the historical cumulative oil and water production by well level. The quality of both proxy modelling techniques is evaluated using R2 coefficient and proxy plot. Proxy models are then further validated by creating real simulation models from variants generated via Monte Carlo Analysis. The history matching quality and practicality were compared between the AI algorithm that runs optimizer on top of existing proxy models, and Differential Evolution algorithm in optimizing the regional porosity and permeability multipliers. The ANN proxy model prevailed over quadratic proxies to mimic the numerical reservoir model output with high degree of accuracy. The black-box nature of the ANN proxies limits the interpretability of predicted model when compared quadratic proxies where the formula for the proxy model can be obtained. Quadratic approximations are more flexible, simplistic in nature, and requires less computational cost to be constructed. Despite that, its prediction quality maybe subjected to the degree of non-linearity in the simulation model. The use of AI algorithm vastly reduces the number of full reservoir simulation required to achieve the minimum objective function at a shorter timeframe, which is proved to be the strength of such method. However, AI optimisation is highly susceptible to be trapped in local minimum. This paper proved the superiority of Differential Evolution algorithm over AI, that it may avoid being trapped in local minimum to achieve high degree of prediction accuracy for the history matching given the larger number of iterations required. This paper provides a preliminary understanding of optimisation workflow and how to go about each optimisation strategies: quadratic polynomial proxy, ANN proxy, stochastic optimisation, artificial intelligence techniques, and a novel approach of converting proxy predicted variants into real simulation cases to evaluate proxy quality. Hence establishes engineers’ expectation by appraising the pros and cons of each optimisation strategies.

Application of a Derivative-Free Method with Projection Skill to Solve an Optimization Problem

Regulation-based formulas and improved Differential Evolution(DE) algorithm is used to optimize PID parameters. In order to improve the global search ability and the convergence rate of the common DE algorithm, self-adaptive method is introduced to obtain DE parameters. On the other hand, initial population quality of DE algorithm has important influence on convergence of the algorithm. So the regulation-based formulas are used to guide the production of initial population, which is good to improve the convergence rate and realize obtaining of PID parameters completely adaptive without any personal experience. The simulation is developed on steam temperature system of cycle fluidized bed boiler with serious parameter uncertainties and many disturbance and long-time delay. The results show that the improved DE algorithm has higher optimal speed, small amount of calculation and effective optimization of parameters. The proposed method has better control quality and system robustness.

In this work, a method to control the parameters of Differential Evolution (DE) algorithm is proposed. Here the control parameters of DE are co-evolved by Particle Swarm Optimization (PSO) algorithm. The classical DE algorithm has two main control parameters: Scale Factor (F) and Cross-over Rate (CR). These are selected on trial-and-error basis for solving optimization problems. Several optimization problems lead to optimal or sub-optimal solution by proper selection of control parameters of the DE algorithm. In this proposed method, PSO algorithm is used to tune the scale factor and cross-over rate in DE algorithm. Basically PSO algorithm is used as a meta-optimizer for DE algorithm. The proposed method is termed as mPSO-DE in this paper. The mPSO-DE algorithm is applied on 12 benchmark unconstrained optimization problems. The obtained results are compared with that of classical DE algorithm. From the experimental studies, it has been found that the proposed mPSO-DE algorithm performed better than DE algorithm.

A new method for optimum shape design of variable capacitance micromotor (VCM) using Differential Evolution (DE), a stochastic search algorithm, is presented. In this optimization exercise, the objective function aims to maximize torque value and minimize the torque ripple, where the geometric parameters are considered to be the variables. The optimization process is carried out using a combination of DE algorithm and FEM analysis. Fitness value is calculated by FEM analysis using COMSOL3.4, and the DE algorithm is realized by MATLAB7.4. The proposed method is applied to a VCM with 8 poles at the stator and 6 poles at the rotor. The results show that the optimized micromotor using DE algorithm had higher torque value and lower torque ripple, indicating the validity of this methodology for VCM design.

A self-competitive mutation strategy for Differential Evolution algorithms with applications to Proportional–Integral–Derivative controllers and Automatic Voltage Regulator systems

Differential evolution (DE) is a well-known evolutionary algorithm which has been successfully applied in many scientific and engineering fields. In most DE algorithms, the base and difference vectors for mutation are randomly selected from the current population. That is, the useful population information cannot be fully exploited to guide the search of DE through mutation. Furthermore, the selection of parents in mutation has been verified to be critical for the DE performance. Therefore, to alleviate this drawback and improve the performance of DE, a novel DE algorithm with a directional mutation based on cellular topology is proposed in this study. This proposed algorithm is named as Cellular Direction Information based DE (DE-CDI). In DE-CDI, the cellular topology is employed first to define a neighborhood for each individual of population and then the direction information based on the neighborhood is incorporated into the mutation operator. In this way, DE-CDI not only utilizes the neighborhood information to exploit the regions of better individuals and accelerate convergence, but also introduces the direction information to guide the search to the promising area. To evaluate the performance of the proposed method, DE-CDI is applied to the original DE algorithms, as well as several advanced DE variants. Experimental results demonstrate the high performance of DE-CDI for most DE algorithms studied.

The instability of energy resources and corresponding cost of the system are the main two problems for designing the hybrid solar-wind power generation systems. The configuration of the system must have a high reliability on the power supply availability but with a minimum cost. The purpose of this paper is to find the most optimum or balanced configuration between technical reliability and total annual cost for the PV module number, the wind turbine number, and the battery number. The appropriate strategy of load management is needed by adjusting the potential energy resource to the load power demand. Loss of Power Supply Probability (LPSP) is a method to determine the ratio of power generation unavailability by the system configuration which used as technical analysis. Annualized Cost of System (ACS) is a method to determine the total annualized cost of the project lifetime which used as economic analysis. The result from the simulation showed that the Differential Evolution (DE) algorithm can be an alternative method to find the best configuration with a low number of LPSP and ACS. Since DE has a better efficacy and faster time to find global optimum than other algorithms.

Determining the optimal location of wells with the aid of an automated search algorithm is a significant and difficult step in the reservoir development process. It is a computationally intensive task due to the large number of simulation runs required. Therefore,the key issue to such automatic optimization is development of algorithms that can find acceptable solutions with a minimum number of function evaluations. In this study, the Differential Evolution (DE) algorithm is applied for the determination of optimal well locations. DE is a stochastic optimization algorithm that uses a population of solutions which evolve through generations to reach the global optimum. To investigate the performance of this algorithm, three example cases are considered which vary in dimension and complexity of the reservoir model. For each case, both DE algorithm and the widely used Genetic Algorithm (GA) are applied to maximize a Modified Net Present Value (MNPV) as the objective function. It is shown that DE outperforms GA in all cases considered, though the relative advantage of the DE vary from case to case. These results are very promising and demonstrate the applicability of DE for this challenging problem.

Differential evolution (DE) algorithm is a global optimization algorithm over continuous search space. DE also has been applied in many fields, such as artificial neural networks, chemical engineering, mechanical design, robotics, signal processing, biological information, and economics. At the same time, as a powerful evolutionary algorithm for solving global numerical optimization problems, the DE algorithm has drawn more and more attention. However, how to make a proper balance between the global and local search is a burning question and to limit the optimization performance of DE. In this paper, an improved algorithm η_CODE with a new η_Cauchy operator is proposed to enhance the global and local search ability of a well-known DE variant JADE. In order to guarantee the effective performance of the proposed operator, all the fitness values are ranked through a ranking scheme based on increasing order before a new η_Cauchy operator is conducted. The pNP individuals that have better fitness are selected and carried out Cauchy disturbance operation considering the complexity of the algorithm. The Dynamic parameter mechanism is utilized to select pNP individuals that number is also adjusted dynamically in each generation. The scale factor F and crossover probability CR are obtained with Lehmer mean without using determined parameter c in JADE, which aims to balance the exploration and exploitation of the algorithm during the running time. A total of sixty benchmark functions from CEC2014 and CEC2017 on real parameter optimization are employed to prove the validity of η_CODE for solving complex high-dimensional problems. The experiments indicate that η_CODE is better than or at least comparable with several state-of-the-art DE variants, including JADE, SinDE, TSDE, AGDE, and EFADE in the global numerical optimization problems. In order to further analyze the performance of η_CODE, we also select extra two high-powered modified algorithms called EBLSHADE and LSHADESPACMA based on LSHADE to discuss advantages and disadvantages of the proposed algorithm.

A differential evolution algorithm with intersect mutation operator