An improved particle swarm optimization of support vector machine parameters for hyperspectral image classification

Automatic recognition of skin symptom plays an importance role in the skin diagnosis and treatment. Feature selection is to increase the classification performance of skin symptom. In this paper, the effects of feature selection on the classification of 4-class skin symptoms (chloasma, blackhead, freckled and comedone) are analyzed. Support vector machine (SVM) is employed to construct classifier, the parameters setting is very crucial to the learning results and generalization ability of SVM, and many irrelevant and redundant features degrade the performance of classification, furthermore, the choice of SVM parameters is influenced by the feature subset taken into account and vice versa. So a joint optimization method for selecting features and SVM parameters is proposed. Genetic algorithms, which have a lot of improvements about fitness, crossover and mutation in comparison with simple genetic algorithms, is to achieve a balance between the classification accuracy and the size of the feature subsets selected and have a fast convergence rate. Furthermore, ‘one-against-one’ approach is used to solve multi-class classification problems and a comparison of the model performances is made among the results of the joint optimization and the single optimization of features or SVM parameters in the experiments. The simulation result shows that our approach can find subsets of features for 4-class skin symptoms classification with higher average cross validation accuracy and a higher rate of convergence compared with single optimization of features or SVM parameters.

Due to errors, accuracy of Global Positioning System is not so high. Therefore, the Real Time Differential Global Poisoning System (RTDGPS) which is based on the successive transmission message of RTCM protocol, is using in real-time applications. Stability and accuracy of the system, significantly depends to a fast transmission of correction messages. These messages come from the reference station to the user stations and affected by the errors related to each satellite. Receiving correction factors which are transmitted by the reference station are facing with time-lag problem, which can increase the error of the RTDGPS. To overcome this problem, prediction algorithms are used. In this research, support vector machine (SVM) model is used to predict the pseudo range correction. Unfortunately, the practical use of SVM is limited because the quality of SVM models depends on a proper setting of SVM and SVM kernel parameters. Therefore, to determine the main parameters of the SVM, both particle swarm optimization (PSO) and genetic algorithm (GA), as two optimization techniques, are used. The proposed methodology has been implemented by a 6-s predicts time step. Simulations showed that the accuracy of GA–SVM and PSO–SVM are equal to 0.186 and 0.154, respectively.

The types of kernel function and relevant parameters’ selection in support vector machine (SVM) have a major impact on the performance of the classifier. In order to improve the accuracy and generalization ability of the model, we used mixed kernel function SVM classification algorithm based on the information entropy particle swarm optimization (PSO): on the one hand, the generalization ability of classifier is effectively enhanced by constructing a mixed kernel function with global kernel function and local kernel function; on the other hand, the accuracy of classification is improved through optimization for related kernel parameters based on information entropy PSO. Compared with PSO-RBF kernel and PSO-mixed kernel, the improved PSO-mixed kernel SVM can effectively improve the classification accuracy through the classification experiment on biomedical datasets, which would not only prove the efficiency of this algorithm, but also show that the algorithm has good practical application value in biomedicine prediction.

흡수, 분포, 대사, 배설 특성 및 독성을 예측하기 위한 효과적인 툴을 개발하는 것은 신약개발의 초기단계에서 NCE(new chemical entity)에 대한 가장 중요한 업무 중의 하나이다. 최근에 이런 시도중의 하나로서 ADME/T(absorption, distribution, metabolism, excretion, toxicity)관련 성질들의 예측에 support vector machine(SVM)을 이용하고 있다. 그리고 SVM은 ADME/T 성질들을 정확하게 예측하는데 많이 사용 되고 있다. 그러나 SVM 모델링에 두 가지 문제가 있다. 특성 선택(feature selection) 과 매개변수 설정(parameter setting)은 여전히 해결해야 할 과제이다. 이 두 가지 문제들은 SVM 분류의 효율성과 정확도에 결정적인 영향을 끼친다. 특히 특성 선택과 최적화된 SVM 변수의 설정은 서로 영향을 주기 때문에 동시에 다루어져야 한다. 여기서 우리는 genetic algorithm(GA) – 특성 선택에 사용 – 과 grid search(GS) method– 변수최적화에 사용 – 두 가지를 통합하는 효과적인 해결책을 제시하였다. ADME/T관련 성질 중 하나인 심장부정맥을 야기시키는 hERG 이온채널 저해제 분류 모델이 여기서 제안된 GA-GS-SVM을 위해 할당되고 테스트 되었다. 1891개의 화합물을 가지는 트레이닝 셋으로 단일 모델 3개, 앙상블 모델 3개, 총 6개의 모델을 만들었고 175개의 외부 데이터를 테스트 셋으로 사용하여 검증하였다. 데이터의 불균형 문제를 해결하기 위하여 GA-GS-SVM 단일 모델에 의한 예측 정확도와 GA-GS-SVM 앙상블 모델 예측 정확도를 비교하였으며, 앙상블모델을 사용하여 예측의 정확도를 높일 수 있었다. Developing effective tools for predicting absorption, distribution, metabolism, excretion properties and toxicity (ADME/T) of new chemical entities in the early stage of drug design is one of the most important tasks in drug discovery and development today. As one of these attempts, support vector machines (SVM) has recently been exploited for the prediction of ADME/T related properties. However, two problems in SVM modeling, i.e. feature selection and parameters setting, are still far from solved. The two problems have been shown to be crucial to the efficiency and accuracy of SVM classification. In particular, the feature selection and optimal SVM parameters setting influence each other, which indicates that they should be dealt with simultaneously. In this account, we present an integrated practical solution, in which genetic-based algorithm (GA) is used for feature selection and grid search (GS) method for parameters optimization. hERG ion-channel inhibitor classification models of ADME/T related properties has been built for assessing and testing the proposed GA-GS-SVM. We generated 6 different models that are 3 different single models and 3 different ensemble models using training set - 1891 compounds and validated with external test set - 175 compounds. We compared single model with ensemble model to solve data imbalance problems. It was able to improve accuracy of prediction to use ensemble model.

The victory prediction of DotA 2 game is an interesting thing to know as it is one of the popular online games and is often played by players around the world. The winning opportunity of a team in this game is largely determined by the combination of heroes chosen so that a proper selection of heroes can give the team a victory. A classification is one of many ways used to make prediction. In this study, the classification will be divided into 2 classes, namely win and lose. One popular classification method is the Support Vector Machine (SVM). SVM method is suitable for classification based on 2 classes. However, in the SVM method, it is necessary to determine the optimum parameters to obtain good accuracy results, so that this research will use one of the optimization methods of Particle Swarm Optimization (PSO) for optimization of SVM parameters to increase the accuracy value. In this study, the SVM parameter to be optimized is C Parameter on linear kernel and it is proven that Optimization of C Parameter on SVM using PSO can increase SVM accuracy from 0.53866 to 0.600349718.

In this paper, an interval type-2 Takagi-Sugeno fuzzy classification system (IT2T-SFCS) learned by particle swarm optimization (PSO) and support vector machine (SVM) for antecedent and consequent parameters optimization is proposed. The IT2T-SFCS is constructed by fuzzy if-then rules whose antecedents are interval type-2 fuzzy sets and consequents are linear state equations. The antecedents of IT2T-SFCS use the fuzzy iterative self-organizing data analysis technique (ISODATA) and PSO to learn and calculate the optimal centers and the uncertain widths of the Gaussian membership functions. Consequent parameters in IT2T-SFCS are learned through SVM for the purpose of achieving higher generalization ability. The proposed IT2T-SFCS is able to directly handle uncertainties, minimize the effects of uncertainties and get the better generalization performance, which inherits the benefits of interval type-2 T-S fuzzy system and SVM. For demonstration, IT2T-SFCS is used as a classifier in gender recognition. The experimental results show that the performance of the proposed IT2T-SFCS is superior to that of the previous mainstream classifiers.

近年来，支持向量机(SVM)理论广泛应用于模式分类，然而影响其分类准确率的两个主要因素特征选择和参数优化又是相互影响和制约的。文章提出一种BA + SVM算法，利用蝙蝠算法(BA)来同步完成SVM的参数优化和输入数据的特征属性选择，提高了SVM的分类能力。设计的三种实验方式在10个测试数据集上实验结果表明，BA + SVM同步优化算法与单一进行参数优化或单一进行特征选择算法相比，具有输入特征少分类准确率高的优势。 Support vector machines (SVM), which is a popular method for pattern classification, has been recently adopted in range of problems. In training procedure of SVM, feature selection and parameter optimization are two main factors that impact on classification accuracy. In order to improve the classification accuracy by optimizing parameter and choosing feature subset for SVM, a new algorithm is proposed through combining Bat Algorithm (BA) with SVM, termed BA + SVM. For assessing the performance of BA + SVM, 10 public data-sets are employed to test the classification accuracy rate. Compared with grid algorithm, conventional parameter optimization method, our study concludes that BA + SVM has a higher classification accuracy with fewer input features for support vector classification.

Support vector machine(SVM) can effectively solve the classification problem with small samples, nonlinear and high dimensions, but it exits the weak generalization ability and low classification accuracy. So an improved genetic algorithm(IGA) is introduced in order to propose a new classification(IGASVM) method based on combining improved GA and SVM model. In the proposed IGASVM method, the self-adaptive control parameter strategy and improving convergence speed strategy are introduced into the GA to keep the diversity of the population, promptly reflect the premature convergence of the individual and escape from the local optimal solution for improving the search performance. Then the improved GA is used to optimize and determine the parameters of the SVM model in order to improve the learning ability and generalization ability of the SVM model for obtaining new classification (IGASVM) method. Finally, the experiment data is selected to test the effectiveness of the proposed IGASVM method. The experiment results show that the improved GA can effectively optimize and determine the parameters of the SVM model, and the IGASVM method takes on the better learning ability, generalization ability and classification accuracy.

In order to improve the performance of Support Vector Machine (SVM) classifier for imbalanced data, this paper proposes dynamic cost-sensitive SVM classifier based on chaos particle swarm optimization (CPDC_SVM). Firstly, this paper introduces dynamic cost-sensitive thought to SVM classifier, and gives the method for structuring dynamic cost and cost-sensitive SVM model. Secondly, we propose the evaluation methodology performance for classifier, and adopts decimal base to code the particles. At last, chaos thought is introduced in particle swarm optimization algorithm, and the Algorithm of the dynamic cost-sensitive SVM classifier is given, which improves convergent speed and accuracy of particle swarm optimization, and can optimize dynamic cost-sensitive SVM well, so CPDC_SVM adds effectively the convergence speed and accuracy for the particle swarm optimization algorithm. Experimental results show CPDC_SVM has higher precision than traditional SVM classifier, and dynamic cost and chaos particle swarm optimization can improve the performance for classifier.

Sleep quality is one of the most important factors for human physical and mental health. Sleep disorder may increase the risk of developing chronic physical and mental illnesses such as heart failure, coronary heart disease, depression, and bipolar disorder. In addition, sleep disorder also decreases work productivity and increases the risk of traffic accidents. The problem of sleep disorder is usually associated with the irregularity in sleep cycles. People need to get the right proportion of every stages and sufficient number of cycles to obtain a quality sleep. The aim of this study is to examine distinctive features related to sleep stages (wake, light sleep, deep sleep) from heart rate variability (HRV), and evaluate their usefulness to classify sleep stages. We utilize support vector machine (SVM) to classify the sleep stages classification and compare the result with conventional methods. We also utilize particle swarm optimization (PSO) for feature selection. The simulation results show that our proposed sleep classification with SVM and PSO can improve the accuracy of sleep stage classification.

Recently, the use of the particle swarm optimization (PSO) technique for the reconstruction of microwave images has received increasing interest from the optimization community due to its simplicity in implementation and its inexpensive computational overhead. However, the basic PSO algorithm is easily trapping into local minimum and may lead to the premature convergence. When a local optimal solution is reached with PSO, all particles gather around it, and escaping from this local optima becomes di-cult. To overcome the premature convergence of PSO, we propose a new hybrid algorithm of particle swarm optimization (PSO), simulated annealing (SA) and tabu search algorithm (TS) for solving the scattering inverse problem. The incorporation of tabu search (TS) and simulated annealing (SA) as local improvement approaches enable the hybrid algorithm to overleap local optima and intensify its search ability in local regions. Reconstructions of dielectric scatterers from experimental inverse- scattering data are flnally presented to demonstrate the accuracy and e-ciency of the hybrid technique.

Classification is data mining techniques which used for the purposes of diagnosis in the medical field as measured by the high accuracy produced. The accuracy of classification algorithm is influenced by the use of features and dimensions in dataset. In this study, Chronic Kidney Disease (CKD) dataset was used where the data is one of the high dimension datasets. Support Vector Machine (SVM) algorithm is used because its ability to handle high-dimensional data. In the dataset, it consists of 24 attributes and 1 class which if all are used results accuracy of classification will be diminished. Method for selecting features with Particle Swarm Optimization (PSO) is applied to reduce redundant features and produce optimal features. In addition, ensemble AdaBoost also applied in this research to increase performance of entirety classification algorithm. The results showed that the optimization of SVM algorithm by using PSO as a selection and ensemble feature of AdaBoost with an average of selected features of 18 features could increase the accuracy of 36.20% to 99.50% in the diagnosis of CKD compared to the SVM algorithm without optimization only resulting in accuracy 63.30%. This research can be used as a reference for further research in focusing on the preprocessing stage.

Autonomous groups of particles swarm optimization (AGPSO), inspired by individual diversity in biological swarms such as insects or birds, is a modified particle swarm optimization (PSO) variant. The AGPSO method is simple to understand and easy to implement on a computer. It has achieved an impressive performance on high-dimensional optimization tasks. However, AGPSO also struggles with premature convergence, low solution accuracy and easily falls into local optimum solutions. To overcome these drawbacks, random-walk autonomous group particle swarm optimization (RW-AGPSO) is proposed. In the RW-AGPSO algorithm, Levy flights and dynamically changing weight strategies are introduced to balance exploration and exploitation. The search accuracy and optimization performance of the RW-AGPSO algorithm are verified on 23 well-known benchmark test functions. The experimental results reveal that, for almost all low- and high-dimensional unimodal and multimodal functions, the RW-AGPSO technique has superior optimization performance when compared with three AGPSO variants, four PSO approaches and other recently proposed algorithms. In addition, the performance of the RW-AGPSO has also been tested on the CEC’14 test suite and three real-world engineering problems. The results show that the RW-AGPSO is effective for solving high complexity problems.

Support Vector Machine (SVM) has become a popular method in machine learning in recent years. SVM is widely used as a tool in many classifiction areas. The selection optimum values of the parameters (model selection) for SVM is an important step in SVM design. This paper presents the results of research and testing method Particle Swarm Optimization (PSO) in selecting the parameters for SVM. Here we focus on the selection parameter γ of the RBF function and soft margin parameter C of SVM for classification problems. In this paper we propose a Particle Swarm Optimization variation model which combine the cognition-only model with the social-only model and use randomised low discrepancy sequences for initialising particle swarms. We then evaluate the suggested strategies with a series of experiments on 6 benchmark datasets. Experimental results demonstrate the model we proposed better than grid search and full PSO-SVM model.

A model integrating Particle Swarm Optimization (PSO) and support vector machines (SVM) is presented to forecast short-term load of electric power systems in this paper. PSO is a method for finding a solution of stochastic global optimizer based on swarm intelligence. Using the interaction of particles, PSO searches the solution space intelligently and finds out the best one. The PSO-SVM method proposed in this paper is based on the global optimization of PSO and local accurate searching of SVM. Practical example results indicate that the application of the PSO-SVM method to short term load forecasting of power systems is feasible and effective. And to prove the effectiveness of the model, other existing methods are used to compare with the result of SVM. The results show that the model is effective and highly accurate in the forecasting of short-term power load.