Comparison of Two Constraint Handling Techniques: An empirical study

This paper presents a novel boundary approach which is included as a constraint-handling technique in an ant colony algorithm. The necessity of approaching the boundary between the feasible and infeasible search space for many constrained optimization problems is a paramount challenge for every constraint-handling technique. Our proposed technique precisely focuses the search on the boundary region and can be either used alone or in combination with other constraint-handling techniques depending on the type and number of problem constraints. For validation purposes, an ant algorithm is adopted as our search engine. We compare our proposed approach with respect to constraint-handling techniques that are representative of the state-of-the-art in constrained evolutionary optimization using a set of standard test functions.

A fast constrained state transition algorithm

Almost all real-world and engineering problems involve multi-objective optimization of some sort that is often constrained. To solve these constrained multi-objective optimization problems, constrained multi-objective optimization evolutionary algorithms (CMOEAs) are enlisted. These CMOEAs require specific constraint handling techniques. This study aims to address and test the most successful constraint handling techniques, seven different penalty constraint techniques, as applied to the Non-dominated Sorting Genetic Algorithm II (NSGA-II). In this paper, NSGA-II is chosen because of its high popularity amongst evolutionary algorithms. Inverted Generational Distance and Hypervolume are the main metrics that are discussed to compare the constraint handling techniques. NSGA-II is applied on 13 constrained multi-objective problems known as CF1-CF10, C1-DTLZ1, C2-DTLZ2, and C3-DTLZ4. The result of IGD and HV values are compared and the feasibility proportions of each combination on each problem are shown. The results of simulation present interesting findings that have been presented at the end of paper as discussion and conclusion.

Economic Load Dispatch (ELD) optimization is an important and difficult task in power system planning. Previously, most of the research mainly focused on proposing various evolutionary algorithms (EAs) to pursue better results of ELD problems. However, few comprehensive analysis of the effects of various constraint handling techniques (CHTs) on the performance of EA-based techniques are available so far. In this paper, we try to fill this gap by experimentally testing the algorithmic variants of combining four effective and widely used EAs with three CHTs. From the experimental results on the ELD problems with valve-point and those problems with both valve-point and multiple-fuel effect, several important conclusions can be achieved, including 1) for the low scale ELD problem with valve-point only, the selection of EAs is more important than CHTs; 2) for the large scale problems, CHTs play crucial roles; 3) the appropriate combination of EA and CHT is helpful to achieve better performance. This study is also expected to provide solid basis for further strengthening the robustness of EAs for ELD optimization. It is also interesting to observe that the experimental results obtained in this paper are much better than those of the previous effective ELD optimization algorithms.

Several constraint handling techniques have been proposed to be used with the evolutionary algorithms (EAs). According to the no free lunch theorem, it is impossible for a single constraint handling technique to outperform all other techniques on every problem. In other words, depending on several factors such as the ratio between feasible search space and the whole search space, multi-modality of the problem, the chosen EA and global exploration/local exploitation stages of the search process, different constraint handling techniques can be effective on different problems and during different stages of the search process. Motivated by these observations, we proposed an ensemble of constraint handling techniques (ECHT) to solve constrained real-parameter optimization problems. In ECHT, each constraint handling method has its own population and every function call is used effectively. Being a general concept, the ECHT can be realized with any existing EA. In this paper, we present ECHT with Differential Evolution (DE) as the basic search algorithm (ECHT-DE). The ECHT is formed using four different constraint handling techniques present in the literature. ECHT-DE is evaluated on the functions from CEC 2010 problem set.

A rank-based constraint handling technique for engineering design optimization problems solved by genetic algorithms

A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization

In this paper, we consider a multi-fidelity optimization under two types of constraints: prior constraints and posterior constraints. The prior constraints are prerequisite to execution of the simulation that computes the objective function value and the posterior constraint violation values, and are evaluated independently from the simulation with significantly lower computational time than the simulation. We have several simulators that approximately simulate the objective and constraint violation values with different trade-offs between accuracy and computational time. We propose an approach to solve the described constrained optimization problem with as little computational time as possible by utilizing multiple simulators. Based on a covariance matrix adaptation evolution strategy, we combines three algorithmic components: prior constraint handling technique, posterior constraint handling technique, and adaptive simulator selection technique for multi-fidelity optimization. We apply the proposed approach to a compliance minimization problem and show a promising convergence behavior.

Currently, rehabilitation systems with closed kinematic chain mechanisms are low-cost alternatives for treatment and health care. In designing these systems, the dimensional synthesis is commonly stated as a constrained optimization problem to achieve repetitive rehabilitation movements, and metaheuristic algorithms for constrained problems are promising methods for searching solutions in the complex search space. The Constraint Handling Techniques (CHTs) in metaheuristic algorithms have different capacities to explore and exploit the search space. However, the study of the relationship in the CHT performance of the mechanism dimensional synthesis for rehabilitation systems has not been addressed, resulting in an important gap in the literature of such problems. In this paper, we present a comparative empirical study to investigate the influence of four CHTs (penalty function, feasibility rules, stochastic-ranking, and ϵ-constraint) on the performance of ten representative algorithms that have been reported in the literature for solving mechanism synthesis for rehabilitation (four-bar linkage, eight-bar linkage, and cam-linkage mechanisms). The study involves analysis of the overall performance, six performance metrics, and evaluation of the obtained mechanism. This identified that feasibility rules usually led to efficient optimization for most analyzed algorithms and presented more consistency of the obtained results in these kinds of problems.

Handling constraints in evolutionary algorithms (EAs) is a challenging issue, since an EA does not handle constraints directly. Thus, developing a heuristic that can guide the search toward feasible and good-performing solutions has become a topic of considerable interest in the field of evolutionary computation in recent years. If a heuristic is applied that is not appropriate or properly fine-tuned, the EA may converge on infeasible solutions, or on feasible solutions with poor objective function values. This paper presents a new constraint-handling technique based on stochastic tournament selection (STS). The performance of this technique is compared to various other constraint-handling techniques applied to a genetic algorithm(GA-) based irrigation canal management problem. The problem involves finding an efficient strategy of irrigation canal network operations that can minimize the total water consumed while preventing problems such as water shortage and flooding. The most common way to handle constraints in EAs is to incorporate penalty functions into the fitness criterion to degrade the fitness of solutions that violate one or more constraints. Alternative techniques have also been reported in the literature, including multiobjective optimization techniques that treat the constraints in single objective problems as additional objectives and stochastic techniques. This paper investigates the performance of five constraint-handling techniques (four techniques from the literature, and the new proposed STS technique). Three scenarios of the case study, with different levels of difficulty and different numbers of constraints, are tested. A comparison of the performances is made to help provide guidelines for the most promising constraint-handling techniques for EA-based management of water supply and irrigation canal operations, based on the level of difficulty of the problem. Copyright ASCE 2006 World Environmental and Water Resources Congress 2006 2

On the equality constraints tolerance of Constrained Optimization Problems

Evolutionary Algorithms have been widely used to solve difficult constrained optimization problems. However, Evolutionary algorithms are intrinsically unconstrained optimization techniques. Constraint handling is mostly incorporated additionally and its choice has great bearing on the quality of the solution. Stochastic Ranking was introduced as an improvement over Feasibility Rules for handling constraints in Evolutionary Optimization. It is widely believed that stochastic ranking is currently the best-known technique for handling constraints. However, a fair comparative study has never been attempted in the literature, where by the performance of both the constraint handling technique is compared on the same Evolutionary Algorithm. This paper fairly compares the performance of both the constraint handling techniques on the same Evolutionary Algorithm over a set of parameters like feasibility rate, successful run, success rate and success performance in addition to objective function value and number of function evaluations. The results put a question mark over the belief that Feasibility Rules are worse than Stochastic Ranking.

How to balance diversity and convergence as well as constraint violation and objective function in Constrained Optimization Problems (COPs) is an important and key issue when designing a new Constrained Optimization Evolutionary Algorithms (COEAs). C <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> oDE set a good example on this point, and obtains promising results. In C <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> oDE, the two Constraint Handling Techniques (CHTs) are adopted fixed in two phases. To verify whether there are some other more efficient combinations, Stochastic Ranking (SR) is adopted to balance the combination. Experimental results show a good performance, which also give some inspiration for other research.

Aimed at improving the insufficient search ability of constraint differential evolution with single constraint handling technique when solving complex optimization problem, this paper proposes a constraint differential evolution algorithm based on ensemble of constraint handling techniques and multi-population framework, called ECMPDE. First, handling three improved variants of differential evolution algorithms are dynamically matched with two constraint handling techniques through the constraint allocation mechanism. Each combination includes three variants with corresponding constraint handling technique and these combinations are in the set. Second, the population is divided into three smaller subpopulations and one larger reward subpopulation. Then a combination with three constraint algorithms is randomly selected from the set, and the three constraint algorithms are run in three sub-populations respectively. According to the improvement of fitness value, the optimal constraint algorithm is selected to run on the reward sub-population, which can share information and close cooperation among populations. In order to verify the effectiveness of the proposed algorithm, 12 standard constraint optimization problems and 10 engineering constraint optimization problems are tested. The experimental results show that ECMPDE is an effective algorithm for solving constraint optimization problems.

Real world problems are often formularised as constrained optimisation problems (COPs). Constraint handling techniques are important for efficient search, and various approaches such as penalty methods or feasibility rule have been studied. The penalty methods deal with a single fitness function by combining an objective function value and a constraint violation with a penalty factor. Moreover, the penalty factor can be flexibly adapted by feeding back information on search process in adaptive penalty methods. However, setting parameters properly and keeping the good balance between the objective function value and the constraint violation are difficult. In this paper, we propose a new parameter-free adaptive penalty method with balancing the objective function value and the constraint violation. L-SHADE is adopted as a base search algorithm, and the optimisation results of 28 benchmark functions provided by the CEC2017 and CEC2018 competitions on constrained single-objective numerical optimisations are compared with other methods.