Optimization of Reinforced Concrete Structures by Simulated Annealing

This paper presents several local search heuristics for the problem of scheduling a single machine to minimize total weighted tardiness. We introduce a new binary encoding scheme to represent solutions, together with a heuristic to decode the binary representations into actual sequences. This binary encoding scheme is compared to the usual “natural” permutation representation for descent, simulated annealing, threshold accepting, tabu search and genetic algorithms on a large set of test problems. Computational results indicate that all of the heuristics which employ our binary encoding are very robust in that they consistently produce good quality solutions, especially when multistart implementations are used instead of a single long run. The binary encoding is also used in a new genetic algorithm which performs very well and requires comparatively little computation time. A comparison of neighborhood search methods which use the permutation and binary representations shows that the permutation-based methods have a higher likelihood of generating an optimal solution, but are less robust in that some poor solutions are obtained. Of the neighborhood search methods, tabu search clearly dominates the others. Multistart descent performs remarkably well relative to simulated annealing and threshold accepting.

This chapter presents a comparison of population-based (e.g. Genetic Algorithms (GA), Firefly Algorithm (FA), and Ant Colony Optimization (ACO))and single point search meta-heuristic methods (e.g. Simulated Annealing (SA), Threshold Accepting (TA), and Tabu Search (TS)) applied to an optimal tuning of a universal digital proportional-integral-derivative (PID) controller. The PID controllers control feed rate and maintain glucose concentration at the desired set point for an E. coli MC4110 fed-batch cultivation process. The model of the cultivation process is represented by dynamic non-linear mass balance equations for biomass and substrate. In the control the design measurement, process noise, and time delay of the glucose measurement system were taken into account. To achieve good closed-loop system the constants (Kp, Ti, Td, b, c and N) were tuned in the PID controller algorithm so the controller can provide control action designed for the specific process requirements resulting in an optimal set of PID controller settings. For a time the controllers set and maintained the control variable at the desired set point during the E. coli MC4110 fed-batch cultivation process. Average, best, and worst objective function values and PID controller's parameters were used as criteria to compare the performance of the considered meta-heuristic algorithms. This indicates that the population-based meta-heuristics performs better than the single point search methods. GA and ACO show better performance than FA. It also indicates that TS results are comparable to those of FA. The results show that SA and TA algorithms failed to solve the PID controller tuning problem.

A comparative study of various meta-heuristic techniques applied to the multilevel thresholding problem

Research Highlights: (1) Optimizing mid-rotation thinning increased modeled land expectation values by as much as 5.1–10.1% over a representative reference prescription on plots planted at 2.7 and 3.7 m square spacings. (2) Eight heuristics, five of which were newly applied to selecting individual trees for thinning, produced thinning prescriptions of near identical quality. (3) Based on heuristic sampling properties, we introduced a variant of the hero heuristic with a 5.3–20% greater computational efficiency. Background and Objectives: Thinning, which is arguably the most subjective human intervention in the life of a stand, is commonly executed with limited decision support in tree selection. This study evaluated heuristics’ ability to support tree selection in a factorial experiment that considered the thinning method, tree density, thinning age, and rotation length. Materials and Methods: The Organon growth model was used for the financial optimization of even age Douglas-fir (Pseudotsuga menziesii (Mirb.) Franco) harvest rotations consisting of a single thinning followed by clearcutting on a high-productivity site. We evaluated two versions of the hero heuristic, four Monte Carlo heuristics (simulated annealing, record-to-record travel, threshold accepting, and great deluge), a genetic algorithm, and tabu search for their efficiency in maximizing land expectation value. Results: With 50–75 years rotations and a 4% discount rate, heuristic tree selection always increased land expectation values over other thinning methods. The two hero heuristics were the most computationally efficient methods. The four Monte Carlo heuristics required 2.8–3.4 times more computation than hero. The genetic algorithm and the tabu search required 4.2–8.4 and 21–52 times, respectively, more computation than hero. Conclusions: The accuracy of the resulting thinning prescriptions was limited by the quality of stand measurement, and the accuracy of the growth and yield models was linked to the heuristics rather than to the choice of heuristic. However, heuristic performance may be sensitive to the chosen models.

Supervised Neural Network (NN) learning is a process in which input patterns and known targets are presented to a NN while it learns to recognize (classify, map, fit, etc.) them as desired. The learning is mathematically defined as an optimisation problem, i.e., an error function representing the differences between the desired and actual output, is being minimized (Bishop, 1995; Haykin, 1999). Because the most popular supervised learning techniques are gradient based (Backpropagation BP), they suffer from the so-called Local Minima Problem (Bishop, 1995). This has motivated the employment of Global Optimisation (GO) methods for the supervised NN learning. Stochastic and heuristic GO approaches including Evolutionary Algorithms (EA) demonstrated promising performance over the last decades (Smagt, 1994; Sexton et al., 1998; Jordanov & Georgieva, 2007; etc.). EA appeared more powerful than BP and its modifications (Sexton et al., 1998; Alba & Chicone 2004), but hybrid methods that combine the advantages of one or more GO techniques and local searches were proven to be even better (Yao, 1999; Rocha et al., 2003; Alba & Chicano, 2004; Ludemir et al., 2006). Hybrid methods were promoted over local searches and simple population based techniques in Alba & Chicone (2004). The authors compared five methods: two BP implementations (gradient descent and Levenberg-Marquardt), Genetic Algorithms (GA), and two hybrid methods, combining GA with different local methods. The methods were used for NN learning applied to problems arising in medicine. Ludemir et al. (2006) optimized simultaneously NN weights and topology with a hybrid method combining Simulated Annealing (SA), Tabu Search (TS) and BP. A set of new solutions was generated on each iteration by TS rules, but the best solution was only accepted according to the probability distribution as in conventional SA. Meanwhile, the topology of the NN was also optimized and the best solution was kept. Finally, BP was used to train the best NN topology found in the previous stages. The new methodology compared favorably with SA and TS on four classification and one prediction problems. Plaginakos et al. (2001) performed several experiments to evaluate various training methods – six Differential Evolution (DE) implementations (with different mutation operators), BP, BPD (BP with deflection), SA, hybridization of BP and SA (BPSA), and GA. They reported O pe n A cc es s D at ab as e w w w .in te ch w eb .o rg

Many new approaches to solve optimization problems have been proposed with the appearance of methods based on analogies to natural processes. For the user in practice, it is not only difficult to assess which method is the "best" one but also to judge how easy or complicated it is to implement and apply the methods. This is mainly due to the fact that most methods have interacting parameters which need to be tuned before a method can be used. The paper discusses ease of use and implementation as well as performance aspects based on computational tests. Thre iterative improvement methods (simulated annealing, tabu search, threshold accepting) and two evolutionary methods (genetic algorithms, PRSA) are compared with regard to an optimization problem (standard cell placement in chip design). Based on results from a large number of test runs, we discuss how easy or difficult it is to prepare the methods for a specific application. In summary, iterative improvement methods were found easier to implement and to use than evolutionary methods. They also outperformed the latter ones in terms of solution quality and computing time.

During the last 20 years, structural optimization has become one of the most important topics of engineering applications. Design optimization of structure has been an interesting area of research in the field of engineering design for its ability to short the design cycle and to enhance product quality. Significant research activity has occurred in the area of structural optimization in the last decade. Especially for topology optimization of structure, many new theoretical, algorithmic, and computational contributions have resulted by researchers and engineers. Topology optimization is a powerful tool for global and multi-scale design of macrostructures, microstructures, and the cell of prescribed composite materials. The population based evolutionary algorithms have emerged as powerful mechanism for finding optimum solutions of complex optimization problems in engineering during the last two decades. Evolutionary computation is the study of computational systems which use ideas and get inspiration from natural evolution and adaptation [1]. The thinking has wide application in various engineering fields, such as computer science, artificial intelligence, operations research. Genetic algorithm is another kind of bio-inspired optimization method and it is playing an increasingly important role in studies of complex adaptive systems. Its application ranges from adaptive agents in economic theory to the use of machine learning techniques in the design of complex devices and structures, such as aircraft turbines and integrated circuits [2]. Optimization of structures can be classified into three categories: sizing, shaping, and topology optimization. In the topology optimization, it is concerned with the structure members and connectivity between members. In general, it is easily represented by discrete variables rather than by those used for continuous optimization problems. Topology optimization is the most difficult and complex among three categories and it is special useful in developing innovative conceptual designs. Structural optimization, in particular the topology optimization, has been identified as one of the most challenging tasks in structural design. Various techniques and approaches have been established during the last two decades. Topology optimization usually referred to as layout optimization or general shape optimization [3]. It lets engineers get the optimal topology of structure or new configurations during product design phase, as they are implementing the design of the size

In this paper, we study the resource management problem in Direct Sequence-Wideband Code Division Multiple Access (DS-WCDMA) systems. The control variables, transmission power, and transmission rate for resource management are considered. Three meta-heuristic techniques, Genetic Algorithms (GA), Simulated Annealing (SA), and Tabu Search (TS), are utilized to solve this optimization problem. Also, a nonlinear programming technique, Generalized Reduced Gradient (GRG) method, is adopted to compare with the three meta-heuristic techniques. Two approaches, the single objective approach and the multiobjective approach, are used in the simulation. The results obtained by GA, SA, TS, and GRG are compared in a single objective approach. In a multiobjective approach, Multiobjective Genetic Algorithm (MOGA) is employed to compare with the other two well-known multiobjective evolutionary algorithms (MOEAs), Pareto Archived Evolution Strategy (PAES) and Micro-Genetic Algorithms (MICRO-GA). Two scenarios, scenario (a): 25 users and scenario (b): 50 users, are considered for both approaches. The simulation results of a single objective approach show that GA outperforms SA, TS, and GRG in the two scenarios. Also, the simulation results of a multiobjective approach show that MOGA outperforms PAES and MICRO-GA, and obtains nondominated trade-off solutions with better convergence and diversity between trade minimization of total power and maximization of total rate in two scenarios.

Evolutionary algorithms, simulated annealing and tabu search: a comparative study

Aiming at the disadvantage of premature convergence of basic genetic algorithm, an adaptive simulated annealing genetic tabu search algorithm is proposed. This algorithm fully combines the global convergence and adaptability of simulated annealing algorithm and the strong climbing ability and high efficiency of tabu search strategy. It has strong convergence and adaptability. The simulation results of the adaptive simulated annealing genetic tabu search algorithm are given and compared with the basic genetic algorithm and simulated annealing algorithm. The simulation results show that the algorithm has better convergence and optimization performance, and can better solve the combinatorial optimization problem.

The existence of multiple decision-makers and goals, spatial and non-linear forest management objectives and the combinatorial nature of forest planning problems are reasons that support the use of heuristic optimisation algorithms in forest planning instead of the more traditional LP methods. A heuristic is a search algorithm that does not necessarily find the global optimum but it can produce relatively good solutions within reasonable time. The performance of different heuristics may vary depending on the complexity of the planning problem. This study tested six heuristic optimisation techniques in five different, increasingly difficult planning problems. The heuristics were evaluated with respect to the objective function value that the techniques were able to find, and the time they consumed in the optimisation process. The tested optimisation techniques were 1) random ascent (RA), 2) Hero sequential ascent technique (Hero), 3) simulated annealing (SA), 4) a hybrid of SA and Hero (SA+Hero), 5) tabu search (TS) and 6) genetic algorithm (GA). The results, calculated as averages of 100 repeated optimisations, were very similar for all heuristics with respect to the objective function value but the time consumption of the heuristics varied considerably. During the time the slowest techniques (SA or GA) required for convergence, the optimisation could have been repeated about 200 times with the fastest technique (Hero). The SA+Hero and SA techniques found the best solutions for non-spatial planning problems, while GA was the best in the most difficult problems. The results suggest that, especially in spatial planning problems, it is a benefit if the method performs more complicated moves than selecting one of the neighbouring solutions. It may also be beneficial to combine two or more heuristic techniques.

Three heuristic search methods, Genetic Algorithm, Simulated Annealing and Tabu Search are implemented to invert Rayleigh wave phase velocity for shallow S-wave velocity profiling in seismic surface wave surveying. Unlike linearized least-squares inversion, they do not require derivative calculation, or an initial model, only the forward modeling calculation. In this study, the performances of the three heuristic techniques are compared with numerical experiments. With common paramerization and search limits, the three algorithms can accurately reconstruct shallow S-wave profiles with and without a velocity reversal from the synthetic data without any specific initial models. The Genetic Algorithms and the Simulated Annealing show fast convergence. However, the Simulated Annealing can find models with the smallest misfits. It is also found that the decrease of the misfits is the most gradual in the Tabu Search.

An ant colony approach for clustering

This chapter describes and discusses stochastic optimization methods for solving problems involved in process intensification, given an emphasis in multiobjective optimization due to its increasing importance in the chemical engineering community. A brief description of the multiobjective optimization strategies such as genetic algorithms, simulated annealing, tabu search, differential evolution, ant colony and particle swarm optimization is provided, including several applications of evolutionary optimization methods in the intensification of separation processes.

The probabilistic travelling salesman problem (PTSP) is an extension of the well-known travelling salesman problem (TSP), which has been extensively studied in the field of combinatorial optimization. The goal of the TSP is to find the minimum length of a tour to all customers, given the distances between all pairs of customers whereas the objective of the PTSP is to minimize the expected length of the a priori tour where each customer requires a visit only with a given probability (Bertsimas, 1988; Bertsimas et al., 1990; Jaillet, 1985). The main difference between the PTSP and the TSP is that in the PTSP the probability of each node being visited is between 0.0 and 1.0 while in TSP the probability of each node being visited is 1.0. Due to the fact that the element of uncertainty not only exists, but also significantly affects the system performance in many real-world transportation and logistics applications, the results from the PTSP can provide insights into research in other probabilistic combinatorial optimization problems. Moreover, the PTSP can also be used to model many real-world applications in logistical and transportation planning, such as daily pickup-delivery services with stochastic demand, job sequencing involving changeover cost, design of retrieval sequences in a warehouse or in a cargo terminal operations, meals on wheels in senior citizen services, trip-chaining activities, vehicle routing problem with stochastic demand, and home delivery service under e-commerce (Bartholdi et al., 1983; Bertsimas et al., 1995; Campbell, 2006; Jaillet, 1988; Tang & Miller-Hooks, 2004). Early PTSP computational studies, dating from 1985, adopted heuristic approaches that were modified from the TSP (e.g., nearest neighbor, savings approach, spacefilling curve, radial sorting, 1-shift, and 2-opt exchanges) (Bartholdi & Platzman, 1988; Bertsimas, 1988; Bertsimas & Howell, 1993; Jaillet, 1985, 1987; Rossi & Gavioli, 1987). With its less than satisfactory performance in yielding solution quality, researchers in the recent years switch to metaheuristic methods, such as ant colony optimization (Bianchi, 2006; Branke & Guntsch, 2004), evolutionary algorithm (Liu et al., 2007), simulated annealing (Bowler et al., 2003), threshold accepting (Tang & Miller-Hooks, 2004) and scatter search (Liu, 2006, 2007, 2008). Because the genetic algorithm (GA), a conceptual framework of the population-based metaheuristic method, has been shown to yield promising outcomes for solving various complicated optimization problems in the past three decades (Back et al., 1997; Davis, 1991; O pe n A cc es s D at ab as e w w w .ite ch on lin e. co m