Effects of Random Values for Particle Swarm Optimization Algorithm

Beetle Antennae Search (BAS) is an intelligent algorithm that mimics the beetle preying process. In BAS, there is a beetle which has a left and a right antennae sensing the intensity of the odor emitted by the food. The beetle learns the different sense of two antennas to determine the flight and finally finds the food. The BAS algorithm has been proved to have good optimizing speed and precision when it is applied for low-dimensional optimization problems. However, when solving high-dimensional problems, the algorithm is easily trapped into local optimum. In order to improve the optimization ability of BAS, we have combined particle swarm optimization (PSO) algorithm and proposed a new hybrid BAS and PSO algorithm (BAS-PSO). In BAS-PSO, firstly, the standard PSO is used for particle velocity and position updating. Particles learn ontology information and group optimal information for evolution. Then each particle in the swarm is taken as a beetle independently applying a local search with BAS algorithm. To verify the performance of BAS-PSO, four benchmark functions have been selected in our simulation experiments. The results show that the performance of BAS-PSO is better than BAS and PSO.

Neural Network system for SoC is one topic in the world. Recently, SoC began to combine AI technique by Python. When developers consider Intelligent system on SoC, the co-design software and hardware are significant. In this case, small devices and embedded system are target system. For IoT, those techniques will grow up in the world. Those cases, avoiding premature convergence while keeping performance is a challenge in training the neural network, especially in a case of large NNs or a large number of training data. In this case, one problem is a huge memory and processing power. For tiny memory and processing system as SoC, we propose an improved particle swarm optimization (PSO) algorithm called the PSOseed2 algorithm for training NN. The PSOseed2 algorithm solves the premature convergence of the standard PSO (SPSO) algorithm by slightly modifying the velocity update function without adding many computational tasks to the SPSO algorithm. We evaluated this algorithm on field programmable gate array (FPGA)-based NN and software-based NN and trained these NNs with different PSO algorithms that are SPSO, PSOseed, PSOseed2, and dissipative PSO. Experimental results with different datasets confirmed that the NNs trained by the proposed PSOseed2 algorithm had better recognition rates and lower global learning errors than the NN trained by other PSO algorithms. In this talk, I would like to talk those relational research in the world and our results and discussion.

The Particle swarm optimization (PSO) algorithm is a population-based intelligent stochastic search technique encouraged from the intrinsic manner of bee swarm seeking for their food source. With flexibility for numerical experimentation, the PSO algorithm has been mostly used to resolve diverse kind of optimization problems. The PSO algorithm is frequently captured in local optima meanwhile handling the complex real-world problems. Many authors improved the standard PSO algorithm with different mutation strategies but an exhausted comprehensive overview about mutation strategies is still lacking. This article aims to furnish a concise and comprehensive study of problems and challenges that prevent the performance of the PSO algorithm. It has tried to provide guidelines for the researchers who are active in the area of the PSO algorithm and its mutation strategies. The objective of this study is divided into two sections: primarily to display the improvement of the PSO algorithm with mutation strategies that may enhance the performance of the standard PSO algorithm to great extent and secondly, to motivate researchers and developers to use the PSO algorithm to solve the complex real-world problems. This study presents a comprehensive survey of the various PSO algorithms based on mutation strategies. It is anticipated that this survey would be helpful to study the PSO algorithm in detail for researchers.

In order to improve the stability and sensitivity of particle swarm optimization (PSO) algorithm and to solve the problem of premature convergence, in this re-search, a computer PSO algorithm based on thermodynamic motion mechanism is proposed based on the principle of thermodynamic motion mechanism. Firstly, the thermodynamic motion phenomenon, the diffusion law in kinematics and the standard PSO algorithm are introduced. Then, according to the basic idea of thermodynamic motion mechanism, the standardized PSO algorithm is optimized and its optimization process is introduced. Finally, the experimental results are analysed by setting the test function. The results show that among the five test functions, the computer PSO algorithm based on thermodynamic motion mechanism has a higher probability of jumping out of the local optimal solution. Its robustness and stability are much better than standard PSO algorithms. The evolution ability of the computer PSO algorithm based on thermodynamic motion mechanism is better than that of the standard PSO algorithm. The standard PSO algorithm is superior because it is based on thermodynamic motion mechanism. The research in this paper can provide good guidance for improving the performance of PSO algorithm.

The particle swarm optimization (PSO) algorithm presents a new way for finding optimal solutions of complex optimization problems. In this paper a modified particle swarm optimization algorithm is presented. We modify the PSO algorithm in some aspects. Firstly, a contractive factor is introduced to the position update equation, and the particles are limited in search region. A new strategy for updating velocity is then adopted, in which the velocity is weakened linearly. Thirdly, using an idea of intersecting two modified PSO algorithms. Finally, adding an item of integral control in the modified algorithm can improve its global search ability. Based on these strategies, we proposed a new PSO algorithm named crossed PSO algorithm. Simulation results show that the crossed PSO is superior to the original PSO algorithm and can get overall promising performance over a wide range of problems.

Collaborative beamforming in wireless sensor networks using a novel particle swarm optimization algorithm variant

Collaborative particle swarm optimization with a data mining technique for manufacturing cell design

Since the last years different metaheuristic methods have been used to solve clustering problems. This paper addresses the problem of manufacturing Cell Formation using a modified particle swarm optimisation (PSO) algorithm. The main modification made to the original PSO algorithm consists on that in this work it is not used the vector of velocities as the standard PSO algorithm does. The proposed algorithm uses the concept of proportional likelihood with modifications, a technique that is used in data mining techniques. Some simulations are presented and compared. The criterion used to group the machines in cells is based on the minimization of inter-cell movements. The computational results show that the PSO algorithm is able to find the optimal solutions on almost all instances.

To solve the strong randomicity and slow convergence of the Particle Swarm Optimization(PSO) algorithms, two new particle’s position renewal formulas were analyzed on the basis of extrapolation in mathematics. A new modified PSO algorithms (called Leading PSO algorithms) was put forward. The Direct Torque Control(DTC) System was built in the environment of Matlab(Simulink). The weight and threshold values of BP Neural Network were trained using the modified PSO algorithms. Some disadvantages such as slow convergence speed and easily plunging into the local solution were avoided effectively. The simulation result shows that the system works well, and the rotor speed identifier has great static and dynamic performance.

Modified particle swarm optimization algorithm for variable selection in MLR and PLS modeling: QSAR studies of antagonism of angiotensin II antagonists.

In order to overcome the drawbacks of falling into local extremum and lower optimization precision of standard particle swarm optimization (PSO) algorithm, multipopulation strategy, adaptive dynamic adjustment strategy and co-evolution mode are introduced into the standard PSO algorithm in order to propose an improved coevolutionary PSO(MPACEPSO) algorithm based on multi-strategy evolution mode and multi-population co-evolutionary mechanism. In the evolutionary process of MPACEPSO algorithm, the multi-population strategy is used to divide the population into several subpopulations, which use different co-evolutionary model to evolve. These sub-populations are influenced and promoted each other in order to realize the exchange of information and co-evolution among the sub-populations, improve the convergence speed and search precision of MPACEPSO algorithm, and effectively suppress the appearance of the local optimum. The adaptive dynamic adjustment strategy of inertia weight is used to keep the diversity of population, reduce the probability of falling into the local extremum. Finally, the ZDT functions are selected to test the optimization performance of proposed MPACEPSO algorithm. The experimental results show that the proposed MPACEPSO algorithm has faster convergence speed, stronger global search ability, higher solving precision and better dynamic optimization performance. The experimental result analysis shows that the proposed MPACEPSO algorithm is insensitive to parameters and easy to be used in solving the complex optimization problems.

Improved Adaptive PSO-based Gain Tuning for PID Controllers in Utility Boilers

Standard Particle Swarm Optimization(PSO) algorithm falls into local optima easily and has low convergence accuracy when it is used to address the problem of complex functions optimization.In order to overcome the shortcomings,an improved PSO algorithm was proposed.The proposed algorithm integrated the attraction-repulsion mechanism in the field of biology into PSO algorithm and took full advantage of the mutual influence between particles to modify velocity updating formula,and thus maintained population diversity and enhanced the ability of particle to escape from the local optima.The experimental results demonstrate that the proposed algorithm outperforms two existing variants of the PSO algorithm in terms of convergence accuracy while improving the velocity of convergence in the later evolution phase and avoiding premature convergence problem effectively.

Particle swarm optimisation (PSO) was developed by Kennedy and Eberhart in 1995 (Kennedy & Eberhart, 1995) inspired by the collective behaviour of natural birds or fish. PSO is a stochastic optimisation technique that uses a behaviour of population composed by many search points called particle. In spite of easy implementation in computer algorithms, it is well known as a powerful numerical optimizer. In the typical PSO algorithms, a set of particles searches the optimal solution in the problem space efficiently, by sharing the common attractor called global best. There are many modified versions of PSO by improving convergence property to a certain problem. While, a standard PSO is defined by Bratton and Kennedy (Bratton & Kennedy, 2007) to give a real standard for PSO studies. PSO seems as one of the evolutionary computations (ECs), and it has been shown that PSO is comparable to a genetic algorithm (Angeline, 1998). Thus, a lot of studies have demonstrated the effectiveness of PSO family in optimizing various continuous and discrete optimization problems. And a plenty of applications of PSO, such as the neural network training, PID controller tuning, electric system optimisation have been studied and achieved well results (Kennedy, 1997). However, PSO is often failed in searching the global optimal solution in the case of the objective function has a large number of dimensions. The reason of this phenomenon is not only existence of the local optimal solutions, the velocities of the particles sometimes lapsed into the degeneracy, so that the successive range is restricted in the sub-plain of the whole search hyper-plain. The sub-plane that is defined by finite number of particle velocities is a partial space in the whole search space. The issue of local optima in PSO has been studied and proposed several modifications on the basic particle driven equation (Parsopoulos et al., 2001; Hendtlass, 2005; Liang et al., 2006). There used a kind of adaptation technique or randomized method (e.g. mutation in evolutionary computations) to keep particles velocities or to accelerate them. Although such improvements work well and have ability to avoid fall in the local optima, the problem of early convergence by the degeneracy of some dimensions is still remaining, even if there are no local optima. Hence the PSO algorithm does not always work well for the high-dimensional function.

Cable-driven parallel robots (CDPRs) have been widely used in engineering fields because of their significant advantages including high load-bearing capacity, large workspace, and low inertia. However, the impact of convergence speed and solution accuracy of optimization approaches on optimal performances can become a key issue when it comes to the optimal design of CDPR applied to large storage space. An adaptive adjustment inertia weight particle swarm optimization (AAIWPSO) algorithm is proposed for the multi-objective optimal design of CDPR. The kinematic and static models of CDPR are established based on the principle of virtual work. Subsequently, two performance indices including workspace and dexterity are derived. A multi-objective optimization model is established based on performance indices. The AAIWPSO algorithm introduces an adaptive adjustment inertia weight to improve the convergence efficiency and accuracy of traditional particle swarm optimization (PSO) algorithm. Numerical examples demonstrate that final convergence values of the objective function by the AAIWPSO algorithm can almost be 14∼20% and 19∼40% higher than those by the PSO algorithm and genetic algorithm (GA) for the optimal design of CDPR with different configurations and masses of end-effectors, respectively.