- Research Article
81
- 10.1016/j.neucom.2014.07.030
A binary differential evolution algorithm learning from explored solutions
- Aug 02, 2014
- Neurocomputing
- Yu Chen + 2 more +2
A binary differential evolution algorithm learning from explored solutions
Many real-world optimization problems are dynamic in nature. The interest in the Evolutionary Algorithms (EAs) community in applying EA variants to dynamic optimization problems has increased greatly. Differential Evolution (DE) belongs to the group of evolutionary algorithms which operate in continuous search spaces. DE has been successfully applied to many stationary problem domains. Recently there has been some research into applying DE to dynamic optimization problems too. Many real-world problems consist of decision variables which require the optimization algorithm to work with binary parameters. This makes it impossible to apply DE in its basic form. For this purpose, binary differential evolution (BDE) approaches have been introduced. The main focus of this paper is to perform a series of experiments to test the behavior of a simple BDE under different change conditions. A simple bit-matching problem is chosen as the test environment. The results of this preliminary study show that further study is needed to make BDEs suitable to work in dynamic environments.
A binary differential evolution algorithm learning from explored solutions
A binary differential evolution algorithm learning from explored solutions
An area coverage algorithm for wireless sensor networks based on differential evolution
Lifetime requirements and coverage demands are emphasized in wireless sensor networks. An area coverage algorithm based on differential evolution is developed in this study to obtain a given coverage ratio [Formula: see text]. The proposed algorithm maximizes the lifetime of wireless sensor networks to monitor the area of interest. To this end, we translate continuous area coverage into classical discrete point coverage, so that the optimization process can be realized by wireless sensor networks. Based on maintaining the ε-coverage performance, area coverage algorithm based on differential evolution takes the minimal energy as optimization objective. In area coverage algorithm based on differential evolution, binary differential evolution is redeveloped to search for an improved node subset and thus meet the coverage demand. Taking into account that the results of binary differential evolution are depended on the initial value, the resulting individual is not an absolutely perfect node subset. A compensation strategy is provided to avoid unbalanced energy consumption for the obtained node subset by introducing the positive and negative utility ratios. Under the helps of those ratios and compensation strategy, the resulting node subset can be added additional nodes to remedy insufficient coverage, and redundancy active nodes can be pushed into sleep state. Furthermore, balance and residual energy are considered in area coverage algorithm based on differential evolution, which can expand the scope of population exploration and accelerate convergence. Experimental results show that area coverage algorithm based on differential evolution possesses high energy and computation efficiencies and provides 90% network coverage.
Read moreThermal Unit Commitment Using Binary Differential Evolution
This paper presents a new approach for thermal unit commitment (UC) using a differential evolution (DE) algorithm. DE is an effective, robust, and simple global optimization algorithm which only has a few control parameters and has been successfully applied to a wide range of optimization problems. However, the standard DE cannot be applied to binary optimization problems such as UC problems since it is restricted to continuous-valued spaces. This paper proposes binary differential evolution (BDE), which enables the DE to operate in binary spaces and applies the proposed BDE to UC problems. Furthermore, this paper includes heuristic-based constraint treatment techniques to deal with the minimum up/down time and spinning reserve constraints in UC problems. Since excessive spinning reserves can incur high operation costs, the unit de-commitment strategy is also introduced to improve the solution quality. To demonstrate the performance of the proposed BDE, it is applied to largescale power systems of up to 100-units with a 24-hour demand horizon.
Read moreAn efficient binary differential evolution algorithm for the multidimensional knapsack problem
This paper proposes a novel approach for the multidimensional knapsack problem (MDKP) using differential evolution. Firstly, the principle and the pseudo-code of binary differential evolution with hybrid encoding (HBDE) are presented. On the basis of the existing repair operator 2 (RO2), an improved repair operator 3 (RO3) for handling the infeasible solutions of MDKP is developed. Then, combine HBDE with RO3, an efficient algorithm (HBDE-RO3) for MDKP is proposed. Finally, the experiment results of the 138 well-known MDKP benchmarks show that RO3 is advantageous to deal with the infeasible solutions than RO2, and the proposed algorithm HBDE-RO3 has superior performance for solving MDKP than the state-of-the-art algorithms.
Read moreArtificial Ants in the Real World: Solving On-line Problems Using Ant Colony Optimization
In the last years, there has been a large growth in the research of computational techniques inspired in nature. This area, named Bioinspired Computing, has provided biologically motivated solutions for several real world problems. Among Bioinspired Computing techniques, one can mention Artificial Neural Networks (ANN), Evolutionary Algorithms (EA), Artificial Immune Systems (AIS) and Ant Colony Optimization (ACO). ACO is a meta-heuristic based on the structure and behavior of ant colonies. It has been successfully applied to several optimization problems. Several real world optimization problems may change the configuration of its search space with time. These problems are known as dynamic optimization problems. This chapter presents the main concepts of ACO and show how it can be applied to solve real optimization problems on dynamic environments. As a case study, it will be illustrated how ACO can be applied to process scheduling problems. The chapter starts describing how real ants forage for food, environmental modifications related to this activity (for example, the blockage of a path) and the effects of these modifications in the colony. After, a brief review of previous works on Ant Colony Optimization is presented. For computer simulations, the activities of an ant colony may be modeled as a graph. After modeling the problem of foraging for food (as a graph), the goal (finding the shortest path at a given moment) is defined and the mechanism to solve the problem is presented. The need to model an on-line problem as a graph, the goal of finding the shortest path and the mechanisms adopted for solving the problem (an adapted version of the AntSystem) are detailed. Before ACO is applied to the process scheduling problem, the problem is analyzed and modeled using a graph representation. Next, simulation results obtained in a set of experiments are presented, which are validated by results obtained in a real implementation. Important issues related with the use of ACO for process scheduling, like parameter adjustments, are discussed. In the conclusion of this chapter, we point out a few future directions for ACO researches. The use of computational techniques inspired in nature has become very frequent in the last years. This area, named Bioinspired Computing, provides efficient biologically motivated
Read moreTaguchi-enhanced binary differential evolution algorithm
This paper proposed an improved binary differential evolution (BDE) algorithm based on a Taguchi approach (Taguchi-BDE) for optimization problems. An estimation operator with efficient probability was adopted to preserve the diversity of populations and enhance the global search ability in Taguchi-BDE, and the Taguchi approach was used to optimize solutions after the crossover operations in Taguchi-BDE The performance of the Taguchi-BDE algorithm was evaluated on a set of ten numerical benchmarks, and the results showed that our algorithm achieved better mean values over 40 repeated tests than did the other BDE-based algorithms. Taguchi-BDE was also applied to a real-world problem in statistical data mining, namely identification of interactions between single nucleotide polymorphisms. A total of 1,500 data sets under different settings were used to evaluate the efficiency of Taguchi-BDE, and the results showed that the proposed algorithm can achieve a 92.07% success rate. In conclusion, Taguchi-BDE revealed efficient convergence toward promising search regions, and achieved satisfactory search results.
Read moreHigh utility itemset mining using binary differential evolution: An application to customer segmentation
High utility itemset mining using binary differential evolution: An application to customer segmentation
Binary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application
Binary metaheuristic algorithms for 0–1 knapsack problems: Performance analysis, hybrid variants, and real-world application
Read moreHierarchical k-nearest neighbours classification and binary differential evolution for fault diagnostics of automotive bearings operating under variable conditions
Hierarchical k-nearest neighbours classification and binary differential evolution for fault diagnostics of automotive bearings operating under variable conditions
Read moreUDE: Differential Evolution with Uniform Design
Differential evolution (DE) is significantly faster and robust for solving numerical optimization problem and is more likely to find true global optimum of functions. It has solved many real-world optimization problems. However, DE has sometimes been shown slow convergence and low accuracy of solutions when the solution space is hard to explore. Population initialization is very important to the performance of differential evolution. A good initialization method can help in finding better solutions and improving convergence rate. In this paper, a uniform-differential evolution algorithm (UDE) is proposed. It incorporates uniform design initialization method into differential evolution to accelerate its convergence speed and improve the stability. UDE is compared with other two algorithms of standard differential evolution (SDE) and orthogonal differential evolution (ODE). Experiments have been conducted on 23 benchmark problems of diverse complexities. The results indicate that our approach has the stronger ability and higher calculation accuracy to find better solutions than other two algorithms.
Read moreDEPSOSVM: variant of differential evolution based on PSO for image and text data classification
PurposeFeature selection is an important step for data pre-processing specially in the case of high dimensional data set. Performance of the data model is reduced if the model is trained with high dimensional data set, and it results in poor classification accuracy. Therefore, before training the model an important step to apply is the feature selection on the dataset to improve the performance and classification accuracy.Design/methodology/approachA novel optimization approach that hybridizes binary particle swarm optimization (BPSO) and differential evolution (DE) for fine tuning of SVM classifier is presented. The name of the implemented classifier is given as DEPSOSVM.FindingsThis approach is evaluated using 20 UCI benchmark text data classification data set. Further, the performance of the proposed technique is also evaluated on UCI benchmark image data set of cancer images. From the results, it can be observed that the proposed DEPSOSVM techniques have significant improvement in performance over other algorithms in the literature for feature selection. The proposed technique shows better classification accuracy as well.Originality/valueThe proposed approach is different from the previous work, as in all the previous work DE/(rand/1) mutation strategy is used whereas in this study DE/(rand/2) is used and the mutation strategy with BPSO is updated. Another difference is on the crossover approach in our case as we have used a novel approach of comparing best particle with sigmoid function. The core contribution of this paper is to hybridize DE with BPSO combined with SVM classifier (DEPSOSVM) to handle the feature selection problems.
Read more$\eta$ _CODE: A Differential Evolution With $\eta$ _Cauchy Operator for Global Numerical Optimization
Differential evolution (DE) algorithm is a global optimization algorithm over continuous search space. DE also has been applied in many fields, such as artificial neural networks, chemical engineering, mechanical design, robotics, signal processing, biological information, and economics. At the same time, as a powerful evolutionary algorithm for solving global numerical optimization problems, the DE algorithm has drawn more and more attention. However, how to make a proper balance between the global and local search is a burning question and to limit the optimization performance of DE. In this paper, an improved algorithm η_CODE with a new η_Cauchy operator is proposed to enhance the global and local search ability of a well-known DE variant JADE. In order to guarantee the effective performance of the proposed operator, all the fitness values are ranked through a ranking scheme based on increasing order before a new η_Cauchy operator is conducted. The pNP individuals that have better fitness are selected and carried out Cauchy disturbance operation considering the complexity of the algorithm. The Dynamic parameter mechanism is utilized to select pNP individuals that number is also adjusted dynamically in each generation. The scale factor F and crossover probability CR are obtained with Lehmer mean without using determined parameter c in JADE, which aims to balance the exploration and exploitation of the algorithm during the running time. A total of sixty benchmark functions from CEC2014 and CEC2017 on real parameter optimization are employed to prove the validity of η_CODE for solving complex high-dimensional problems. The experiments indicate that η_CODE is better than or at least comparable with several state-of-the-art DE variants, including JADE, SinDE, TSDE, AGDE, and EFADE in the global numerical optimization problems. In order to further analyze the performance of η_CODE, we also select extra two high-powered modified algorithms called EBLSHADE and LSHADESPACMA based on LSHADE to discuss advantages and disadvantages of the proposed algorithm.
Read moreA modified DE: Population or generation based levy flight differential evolution (PGLFDE)
Researchers can solve Simple optimization problems using various methods. But differential Evolution (DE) is a method(population based) to solve complex optimization problems in some easy steps that is not possible to handle by mathematical optimization methods. For global optimization problems DE is a probabilistic approach. DE when tested over some bench mark functions and real world problems it performed better than some evolutionary algorithms and swarm - intelligence based algorithms. Balancing between Exploration and Exploitation using DE mutation and crossover with control parameters F and CR (fine tunned) is to be done. DE does not complete demand of good convergence and stagnation. DE Explore better but this exploration capability sometimes may skip the true solution and exhibit premature convergence. To improve this we can decrease the step size but this exhibit stagnation. So for Better exploitation, another approach called Memetic algorithm based on levy flight based local search strategy is used with DE. Further to balance exploration and exploitation in local search area in this paper a population or generation based exploitation of local search area in LFDE is proposed that is called PGLFDE. To show better result proposed strategy is tested on some bench mark functions and compare with recent variants of DE.
Read moreA New Differential Evolution Algorithm with Alopex-Based Local Search
Differential evolution (DE), as a class of biologically inspired and meta-heuristic techniques, has attained increasing popularity in solving many real world optimization problems. However, DE is not always successful. It can easily get stuck in a local optimum or an undesired stagnation condition. This paper proposes a new DE algorithm Differential Evolution with Alopex-Based Local Search (DEALS), for enhancing DE performance. Alopex uses local correlations between changes in individual parameters and changes in function values to estimate the gradient of the landscape. It also contains the idea of simulated annealing that uses temperature to control the probability of move directions during the search process. The results from experiments demonstrate that the use of Alopex as local search in DE brings substantial performance improvement over the standard DE algorithm. The proposed DEALS algorithm has also been shown to be strongly competitive (best rank) against several other DE variants with local search.
Read moreBinary Differential Evolution based Feature Selection Method with Mutual Information for Imbalanced Classification Problems
The feature selection process aims to eliminate redundant attributes in the data set, thus it leads to improved classification accuracy. The solution to a feature selection problem is challenging due to the ever-increasing data volume. This problem gets more complicated in the case of imbalanced data sets. Most of the traditional feature selection methods weigh on the majority class when selecting the informative feature subset, thus the selected features often get a bias towards the majority class and neglect the significance of the minority class in the whole process, which results in poor classification performance in the case of minority class objects. Multiple evolutionary algorithms based feature selection methods have been introduced in the past but most of them ignore the class imbalance problem while selecting the most informative feature subset. In this article, we propose a binary differential evolution algorithm with Manhattan distance-based mutation, which employs a joint mutual information maximization based feature selection criteria along with a novel class distribution-based weight assignment scheme to tackle the class imbalance problem. In the experimental studies, we have tested the performance of the proposed method on well-known data sets using three widely-used performance metrics (Average Classification Accuracy, F-measure, G-Means). According to the empirical results, the proposed method performs better than its contenders in most of the data sets.
Read more