Analysis Of Genetic Algorithm, Particle Swarm Optimization and Simulated Annealing On Benchmark Functions

Non-traditional algorithms are the realistic models that are used for solving many complex engineering optimization problems. Machining is one of the most important and widely used manufacturing processes which rely on optimization. Optimization problems may be either constrained or unconstrained in nature. The complication factor with constrained optimization is that there is a possible existence of one or more complex constraints. These constraints must be incorporated into the problem otherwise solution is unacceptable from a practical standpoint. Non-traditional algorithms are the best way for solving the constrained optimization problems. The advantages of non-traditional techniques are its tolerant of imprecision, uncertainty, and meta-heuristics. In this work, three different non-traditional algorithms such as genetic algorithm (GA), simulated annealing (SA), and particle swarm optimization (PSO) are used in multi-pass turning machining operation to identify the set of optimal parameter values for minimizing unit production cost. The mathematical model is taken from the literature (Chen and Tsai, Int J Prod Res 34:2803–2825, 1996 and it is used for the evaluation of algorithmic parameters. The main aim of this work is to analyze the effect of algorithmic parameters of non-traditional technique in turning operation. The analyses performed are (i) sensitivity analysis in GA, PSO, and SA, (ii) analysis to find the best reproduction method in GA (iii) analysis to analyze the performance of GA, PSO, and SA by varying algorithmic parameters, and (iv) analysis to compare the results of the algorithms with the literature, and the best one is proposed.

Metaheuristic algorithms are constructed to solve optimization problems, but they cannot solve all the problems with best solutions. This work proposes a novel self-adaptive metaheuristic optimization algorithm, named Optimal Stochastic Process Optimizer (OSPO), which can solve different kinds of optimization problems with promising performance. Specifically, OSPO regards the procedure of optimization as a realization of stochastic process, and with the help of Subjective Probability Distribution Function (SPDF) and Receding Sampling Strategy proposed in this paper, OSPO can control the exploration-exploitation property online by the adaptive modification of the parameters in SPDF. This adaptive exploration-exploitation property of OSPO contributes to dealing with different kinds of problems; thus, it makes OSPO have the potential to solve at least a vast majority of optimization problems. The proposed algorithm is first benchmarked on uni-modal, multi-modal and composite test functions both in low and high dimensions. The results are verified by comparative studies with seven well-performed metaheuristic algorithms. Then, 21 real-world optimization problems are used to further investigate the effectiveness of OSPO. The winners of CEC2020 Competition on Real-World Single Objective Constrained Optimization, SASS algorithm, sCMAgES algorithm, EnMODE algorithm and COLSHADE algorithm are used as four comparative algorithms in real-world optimization problems. The analysis of simulations demonstrates that OSPO is able to provide very competitive performance compared to the comparative meta-heuristics both in benchmark functions and in real-world optimization problems; thus, the potential of OSPO to solve at least a vast majority of optimization problems is verified. A corresponding MATLAB APP demo is available on https://github.com/JiahongXu123/OSPO-algorithm.git.

Henry gas solubility optimization: A novel physics-based algorithm

In this article, we present an application of metaheuristics optimization approaches to improve medical classifier performance. Genetic Algorithm (GA), Simulated Annealing (SA) and Particle Swarm Optimization (PSO) have been applied in conjunction with Least Square Support Vector Machine (LS-SVM) approach to optimize the total misclassification error in term of False Positive and False Negative rates. We validate our experimental results, based on five well known unbalanced medical datasets. Presented results show that the SA achieved the best results. Both SA and GA outperform PSO metaheuristic.

<p>In last decade, numerous meta-heuristic algorithms have been proposed for dealing the complexity and difficulty of numerical optimization problems in the realworld which is growing continuously recently, but only a few algorithms have caught researchers’ attention. In this study, a new swarm-based meta-heuristic algorithm called Rhizostoma optimization algorithm (ROA) is proposed for solving the optimization problems based on simulating the social movement of Rhizostoma octopus (barrel jellyfish) in the ocean. ROA is intended to mitigate the two optimization problems of trapping in local optima and slow convergence. ROA is proposed with three different movement strategies (simulated annealing (SA), fast simulated annealing (FSA), and Levy walk (LW)) and tested with 23 standard mathematical benchmark functions, two classical engineering problems, and various real-world datasets including three widely used datasets to predict the students’ performance. Comparing the ROA algorithm with the latest meta-heuristic optimization algorithms and a recent published research proves that ROA is a very competitive algorithm with a high ability in optimization performance with respect to local optima avoidance, the speed of convergence and the exploration/exploitation balance rate, as it is effectively applicable for performing optimization tasks.</p>

In compressed sensing, the Toeplitz sensing matrices are generated by randomly drawn entries and further optimizes them with suitable optimization methods. However, during an optimization process, state-of-the-art optimization methods tend to lose control over the structure of measurement matrices. In this paper, we proposed the novel approach for optimization of Toeplitz sensing matrices based on evolutionary algorithms such as Genetic Algorithm (GA), Simulated Annealing (SA), and Particle Swarm Optimization (PSO) for compression of an image signal. Furthermore, we investigated the performance of Basis Pursuit (BP) and Orthogonal Matching Pursuit (OMP) algorithms for the reconstruction of the images. The proposed optimized Toeplitz sensing matrices based on evolutionary algorithms such as GA, SA, and PSO exhibit a significant reduction in the mutual coherence (μ) and thus improved the recovery performance of 2D images compared to state-of-the-art non-optimized Toeplitz sensing matrices. The result reveals that the optimized Toeplitz sensing matrices with Basis Pursuit (BP) achieved more accurate results with a robust and uniform reconstruction guarantee compared to the OMP algorithm. However, BP shows the slow reconstruction performance of the image signal. On the other hand, an optimized Toeplitz sensing matrix with OMP shows a fast reconstruction guarantee, but at the cost of a reduction in the PSNR. Furthermore, the proposed approach retains the structure of Toeplitz sensing matrices and improves the image recovery performance of compressed sensing. Finally, the experimental results validate the effectiveness of the proposed method based on evolutionary algorithms for image compression.

This study compares the performance of four different metaheuristics for solving a constraint satisfaction scheduling problem of the outfitting process of shipbuilding. The ship outfitting process is often unorganised and chaotic due to the complex interactions between the stakeholders and the overall lack of sufficiently detailed planning. The examined methods are genetic algorithms (GA), simulated annealing (SA), genetic simulated annealing (GSA) and discrete particle swarm optimisation (PSO). Each of these methods relies on a list scheduling heuristic to transform the solution space into feasible schedules. Although the SA had the best performance for a medium-sized superstructure section, the GSA created the best schedules for engine room double-bottom sections, the most complex sections in terms of outfitting. The GA provided the best scalability in terms of computational time while only marginally sacrificing solution quality. The solution quality of the PSO was very poor in comparison with the other methods. All methods generated schedules with sufficiently high resource utilisation, approximately 95%. The findings from this work will be incorporated into a larger project with the aim of creating a tool which can automatically generate an outfitting planning for a vessel.

This Portfolio selection Problem (PSP) remains an intractable research problem in finance and economics and often regarded as NP-hard problem in optimization and computational intelligence. This paper solved the extended Markowitz mean- variance portfolio selection model with an efficient Metaheuristics method of Generalized Differential Evolution 3 (GDE3). The extended Markowitz mean- variance portfolio selection model consists of four constraints: bounds on holdings, cardinality, minimum transaction lots, and expert opinion. There is no research in literature that had ever engaged the set of four constraints with GDE3 to solve PSP. This paper is the first to conduct the study in this direction. The first three sets of constraints have been presented in other researches in literatures. This paper introduced expert opinion constraint to existing portfolio selection models and solved with GDE3. The computational results obtained in this research study show improved performance when compared with other Metaheuristics methods of Genetic algorithm (GA), Simulated Annealing (SA), Tabu Search (TS) and Particle Swarm Optimization (PSO).

In this paper, we present a comprehensive and in-depth investigation on the optimization of Proportional-Integral (PI) controller tuning for achieving stability and desired overshoot in the step response. The main objective of this study is to compare the effectiveness of Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) techniques in finding the optimal parameters for the PI controller. The PI controller is a widely used control algorithm that plays a crucial role in many industrial processes. Its tuning greatly affects the system's performance, particularly in terms of stability and overshoot. Therefore, finding the optimal tuning parameters is of utmost importance. To address this optimization problem, we propose the utilization of two popular metaheuristic algorithms, GA and PSO. These algorithms are known for their ability to efficiently search through large solution spaces and find near-optimal solutions. By applying these algorithms to the PI controller tuning problem, we aim to determine which technique yields better results in terms of stability and overshoot tuning. In our comparative study, we provide a detailed explanation of both GA and PSO algorithms, focusing on their working principles and mathematical formulations. We also describe how these algorithms can be applied to the PI controller tuning problem. Furthermore, we highlight the key differences between GA and PSO, shedding light on their strengths and weaknesses. To assess the performance of GA and PSO, we conduct several experiments using different benchmark functions and step response models. We measure the stability and overshoot metrics for various parameter settings obtained through GA and PSO. By thoroughly analyzing the obtained results, we draw meaningful conclusions regarding the effectiveness of each technique. Our findings demonstrate that both GA and PSO exhibit promising results in optimizing PI controller tuning. These observations provide valuable insights and guidelines for choosing the appropriate algorithm based on specific control requirements. In conclusion, this comparative study is thought to contribute to the field of control systems engineering by offering a comprehensive analysis of GA and PSO techniques in the context of PI controller tuning. By highlighting their strengths and weaknesses, it is aimed to provide researchers and practitioners with valuable information for making informed decisions when optimizing control parameters for stability and overshoot reduction purposes.

This paper studies the two-stage assembly flow shop problem (TAFSP) considering aging effects of the machines and preventive maintenance activities. At the first stage, m-1 parallel machines process parts of each jobs, and at the second stage, related parts of the jobs are assembled by one assembly machine. As the machines work on the jobs, their tools get aged. Aging effects on the machines causes that they will not be able to complete the jobs in the same time could as they were new or when they are operating jobs immediately after their preventive maintenance activity. Processing times of the job are related to the positions, in which it is located after the last preventive maintenance. The job that is operated in a position immediately after the preventive maintenance activity on a machine has its standard processing time. However, the processing time of the jobs operated in the further positions increase based on the number of the positions. The machines return to the initial condition after each preventive maintenance activity. The objective is to schedule the jobs on the machines and determine when the preventive maintenance activities get done on them in order to minimize the total weighted tardiness and maintenance costs. An integer mathematical model is presented for the problem and its validation is shown by solving an example in small scale. Since two-stage assembly flow shop problem is NP-hard, in order to solve the problem in medium and large scale two meta-heuristic algorithms, hybrid genetic algorithm (HGA) and hybrid particle swarm optimization (HPSO) are proposed. These algorithms are the hybrid version of genetic algorithm and particle swarm optimization representatively with simulated annealing. The algorithms are tuned by using Taguchi method, and are used to solve many numerical examples. Finally, the statistical analysis illustrates that the performance of HPSO is better than HGA.

The research and development of metaheuristic methods are critical issues in computer science. In the past decade, metaheuristic algorithms have been used in many engineering applications such as optimization of engineering problems, telecommunications, information security, and image processing. Many metaheuristic algorithms such as particle swarm optimization (PSO), ant colony optimization (ACO), and genetic algorithm (GA) are recently becoming very popular.There are many studies conducted in the literature on the comparison of PSO with other metaheuristic algorithms. In this chapter, various studies carried out between the years of 2010 and 2020 about the comparison of PSO with the other metaheuristic algorithms will be examined. The metaheuristic algorithms to be considered are simulated annealing (SA), genetic algorithm (GA), differential evolution (DE), ant colony optimization (ACO), artificial bee colony (ABC) algorithm, particle swarm optimization (PSO), tabu search (TS), harmony search (HS), firefly algorithm (FF), cuckoo search (CS), bat-inspired algorithm (BA), water wave optimization (WWO), clonal selection algorithm (CLONALG), chemical reaction optimization (CRO), sine cosine algorithm (SCA), glowworm swarm optimization (GSO), and grey wolf optimizer (GWO). This study aims to evaluate and analyze the covered papers according to several criteria such as (a) rates of studies according to publishing years, (b) the metaheuristic algorithms that are compared to PSO, (c) performance evaluation of compared algorithms, (d) the metaheuristic algorithms with their inspirational approaches and their initial proposed studies and years, (e) the field of subjects where the algorithms are applied in the reviewed studies, and (f) used databases in the examined studies.This study is a comprehensive literature review of the comparison of PSO with the most popular metaheuristic algorithms. The intention of this review is to be useful for researchers who want to conduct a survey on this area of the subject as this chapter will cover the essential and helpful analysis of the related research.

Real-world optimization problems in engineering, logistics, and resource allocation are often constrained and multi-modal, posing a challenge for traditional optimization algorithms. Metaheuristic algorithms inspired by natural and artificial phenomena have shown promise, but many fail to balance exploration and exploitation effectively, especially under stringent constraints. Existing algorithms such as Genetic Algorithms (GA), Particle Swarm Optimization (PSO), and Differential Evolution (DE) face issues in convergence speed and constraint handling, particularly in high-dimensional spaces or when constraints are dynamic or complex. We propose an Adaptive Pattern-Driven Optimization (APDO) algorithm, a novel tailor-inspired metaheuristic that mimics the adaptive decision-making process of a tailor designing garments. APDO integrates three primary operators—Pattern Selection, Fabric Adjustment, and Stitch Reinforcement—to handle constraints adaptively. The algorithm combines pattern memory (historical bests), probabilistic pattern mutation, and a constraint-domination principle to ensure feasibility and diversity. The core idea is to iteratively “cut and stitch” solutions to adapt the search process, enabling dynamic constraint satisfaction and global optimization. We benchmarked APDO against five popular methods (GA, PSO, DE, Firefly Algorithm, and Whale Optimization Algorithm) on a suite of 10 real-world constrained problems, including mechanical component design and energy scheduling tasks. APDO outperformed all baselines in terms of convergence speed, constraint satisfaction rate, and solution quality. In particular, APDO achieved an average feasibility rate of 97.6% and an improvement of 4.2–11.8% in best fitness across problems.

The development of a novel hybrid algorithm (AOA) with the aid of simulated annealing technique is discussed in this paper. The novel algorithm, named modified arithmetic optimization algorithm (mAOA), is proposed as an effective tool for optimizing power system stabilizer (PSS) adopted in a single-machine infinite-bus power system. To perform the assessments, MATLAB/Simulink software was used. The evaluations on the proposed algorithm are initially performed using several benchmark functions that have unimodal and multimodal natures. The results are then compared with five of the other competitive approaches (arithmetic optimization algorithm, simulated annealing algorithm, genetic algorithm, particle swarm optimization and gravitational search algorithm). The comparisons with respect to those algorithms demonstrate the great promise of the constructed hybrid mAOA algorithm. This shows the greater balance between global and local search stages achieved by the mAOA algorithm. The performance of the developed mAOA algorithm is also assessed through designing an optimally performing PSS for further evaluation which allows the observation of its capability for complex real world engineering problems. To do so, PSS damping controller is formulated as an optimization problem and the constructed mAOA algorithm is used to search for optimal controller parameters to demonstrate the applicability and the greater performance of the proposed hybrid algorithm for such a complex real-world engineering problem. The obtained results for the latter case are compared with the sine-cosine and symbiotic organisms search algorithms as they are the best performing reported algorithms. The comparisons have demonstrated the superiority of the mAOA algorithm over reported best performing algorithms in terms of PSS design, as well.

The Meta heuristic algorithms are the higher level technique which helps to find the best feasible solution out of all possible solution of an optimization problem. There are various different types of meta heuristic algorithms like Ant Colony Optimization (ACO), Genetic Algorithm, Simulated Annealing, Particle Swarm Optimization, etc. Genetic Algorithm is a search-based optimization technique based on the biological principle of Genetics and adaptation. It is a meta-heuristic approach which is used to solve complex combinatorial problem. The integration of Genetic algorithm with machine learning will be helpful in solving unconstrained and constrained optimization problem. The various genetic operator like selection operator, mutation and cross-over are discussed which will be helpful in knowing how these operators significantly improves State Space search. In this paper the various applications of Genetic algorithms which can be used in machine learning has been discussed. In this paper the author discussed how the significance of Genetic algorithm will be improved while solving complex optimization problem in machine learning. In this paper, flow diagram of Genetic Algorithms has been discussed which will ease the understanding of complex optimization problem like 0–1 Knapsack, Traveling Salesman Problem, etc. In this paper a comparative analysis between traditional algorithm and genetic algorithm has been done on the basis of parameters like flow of control, state space search, Complication, Preconditions, CPU utilization etc. The various limitations of Genetic Algorithms in solving problems with optimal solutions has also been discussed.

Optimization of process parameters in the abrasive waterjet machining using integrated SA–GA