Image Classification and Land Cover Mapping Using Sentinel-2 Imagery: Optimization of SVM Parameters

This paper proposes a hybrid Electroencephalogram (EEG) classification approach based on grey wolf optimizer (GWO) enhanced support vector machines (SVMs) called GWO-SVM approach for automatic seizure detection. In order to decompose EEG into five sub-band components, the discrete wavelet transform (DWT) was utilized to extracted features set. Then, this features are used to train the SVM with radial basis function (RBF) kernel function. Further, GWO was used for selecting the significant feature subset and the optimal parameters of SVM in order to obtain a successful EEG classification. The experimental results proved that the proposed GWO-SVM approach, able to detect epileptic and could thus further enhance the diagnosis of epilepsy with accuracy 100%. Furthermore, the proposed approach has been compared with genetic algorithm (GA) with support vector machines (GA-SVMs) and SVM using RBF kernel function. The computational results reveal that GWO-SVM approach achieved better classification accuracy outperforms both GA-SVM and typical SVMs.

Abstract. In this paper, a framework is developed based on Support Vector Machines (SVM) for crop classification using polarimetric features extracted from multi-temporal Synthetic Aperture Radar (SAR) imageries. The multi-temporal integration of data not only improves the overall retrieval accuracy but also provides more reliable estimates with respect to single-date data. Several kernel functions are employed and compared in this study for mapping the input space to higher Hilbert dimension space. These kernel functions include linear, polynomials and Radial Based Function (RBF). The method is applied to several UAVSAR L-band SAR images acquired over an agricultural area near Winnipeg, Manitoba, Canada. In this research, the temporal alpha features of H/A/α decomposition method are used in classification. The experimental tests show an SVM classifier with RBF kernel for three dates of data increases the Overall Accuracy (OA) to up to 3% in comparison to using linear kernel function, and up to 1% in comparison to a 3rd degree polynomial kernel function.

Optical image provides a unique spectral and textural opportunity to acquire data free of charge in cloud-free weather conditions. However, textural information from recent Sentinel-2A data has not been sufficiently recognized. Several researches have shown that texture features are essential for extracting crop information. This study presents a new scheme that integrates spectral bands and textural features for mapping maize fields and other land cover types (i.e., build-up, trees, others, and water) and evaluates the effectiveness of random forest (RF) and support vector machine (SVM) classifiers with different kernel functions based on Sentinel 2A (S-2A) data. The textural features were derived from multiple bands of S-2A image using a grey-level co-occurrence matrix (GLCM) algorithm. To normalize the analysis of these features, Random Forest feature selection was employed. The outcomes show that S-2A images are appropriate for mapping maize fields and other land covers when the image is accessible during the growing season. The SVM classifier with a radial basis function (RBF) kernel is superior to a polynomial (P), linear (L), and sigmoid (S) kernel functions, and the RF classifiers. For the SVM_RBF, the highest overall accuracy was obtained from the integration of spectral bands and textural features at scenario 2 SVM_RBF (87.40%), followed by the combination of spectral and textural features at scenario 2 SVM_P kernel (86.56%). However, scenario 5 SVM_P kernel (85.54%), scenario 4 SVM_P kernel function (85.30%), the spectral features alone, and the SVM_P kernel function, have the highest O/A (83.90%) than that of the SVM_RBF (83.66%). The inclusion of textural features contributed significantly in mapping the smallholder’s maize field in the study area. This demonstrated the value of S-2A in agricultural research.

High temporal resolution of synthetic aperture radar (SAR) imagery (e.g., Sentinel-1 (S1) imagery) creates new possibilities for monitoring green vegetation in urban areas and generating land-cover classification (LCC) maps. This research evaluates how different pre-processing steps of SAR imagery affect classification accuracy. Machine learning (ML) methods were applied in three different study areas: random forest (RF), support vector machine (SVM), and extreme gradient boosting (XGB). Since the presence of the speckle noise in radar imagery is inevitable, different adaptive filters were examined. Using the backscattering values of the S1 imagery, the SVM classifier achieved a mean overall accuracy (OA) of 63.14%, and a Kappa coefficient (Kappa) of 0.50. Using the SVM classifier with a Lee filter with a window size of 5×5 (Lee5) for speckle reduction, mean values of 73.86% and 0.64 for OA and Kappa were achieved, respectively. An additional increase in the LCC was obtained with texture features calculated from a grey-level co-occurrence matrix (GLCM). The highest classification accuracy obtained for the extracted GLCM texture features using the SVM classifier, and Lee5 filter was 78.32% and 0.69 for the mean OA and Kappa values, respectively. This study improved LCC with an evaluation of various radiometric and texture features and confirmed the ability to apply an SVM classifier. For the supervised classification, the SVM method outperformed the RF and XGB methods, although the highest computational time was needed for the SVM, whereas XGB performed the fastest. These results suggest pre-processing steps of the SAR imagery for green infrastructure mapping in urban areas. Future research should address the use of multitemporal SAR data along with the pre-processing steps and ML algorithms described in this research.

Electromyography (EMG) signal is an electrical indicator for neuromuscular activation. It provides direct access to physiological processes enabling the muscle to generate force and produce movement in order to accomplish countless functions. As a successful classification of the EMG signal is basically dependent on the selection of the best parameters carefully, this paper proposes a hybrid optimized classification model for EMG signals classification. The proposed system implements grey wolf optimizer (GWO) combined with support vector machines (SVMs) classification algorithm in order to improve the classification accuracy via selecting the optimal settings of SVMs parameters. The proposed approach consists of three phases; namely pre-processing, feature extraction, and GWO-SVMs classification phases. The obtained experimental results obviously indicate that significant enhancements in terms of classification accuracy have been achieved by the proposed GWO-SVMs classification system. It has outperformed the typical SVMs classification algorithm via achieving an accuracy of over 90 % using the radial basis function (RBF) kernel function.

The types of kernel function and relevant parameters’ selection in support vector machine (SVM) have a major impact on the performance of the classifier. In order to improve the accuracy and generalization ability of the model, we used mixed kernel function SVM classification algorithm based on the information entropy particle swarm optimization (PSO): on the one hand, the generalization ability of classifier is effectively enhanced by constructing a mixed kernel function with global kernel function and local kernel function; on the other hand, the accuracy of classification is improved through optimization for related kernel parameters based on information entropy PSO. Compared with PSO-RBF kernel and PSO-mixed kernel, the improved PSO-mixed kernel SVM can effectively improve the classification accuracy through the classification experiment on biomedical datasets, which would not only prove the efficiency of this algorithm, but also show that the algorithm has good practical application value in biomedicine prediction.

Beras Miskin (Raskin) Program is a program of social protection, as supporters of other programs such as nutrition improvement, healthy increase, education and productivity improvement of Poor Households. According to Badan Pusat Statistika, there were 14 criteria to determine a household is classified as poor households. Based on these criteria it will be classified of recipient households and non-recipient households of Beras Miskin (Raskin) Program by Support Vector Machine (SVM) method using LibSVM. The concept of classification by SVM is search for the best hyperplane which serves as a separator of two classes of data in the input space. Kernel function is used to convert the data into a higher dimensional space to allow a separation. LibSVM is a package program created by Chih-Chung Chang and Chih-Jen Lin from Department of Computer Science at National Taiwan University. The method used by LibSVM to obtain global solution of duality lagrange problem is decomposition method. To determine the best parameters of kernel function, used k-vold cross validation method and grid search algorithm. In this classification by SVM method using LibSVM, obtain the best accuracy value as 83,1933%, which is the kernel function Radial Basis Function (RBF). Keywords : Beras Miskin (Raskin) Program, Classification, Support Vector Machine (SVM), LibSVM, Kernel Function

The changes in China’s stock market are inseparable from the country’s economic development and macroeconomic regulation and control and have far-reaching significance in promoting China’s national economic growth. Compared with the Western developed capital market, China’s current stock market’s main smart investment strategy still has certain defects. Based on the SVM model, this paper establishes a predictive model that combines kernel parameters and parameter optimization to model. The mesh search method, genetic algorithm, and particle swarm optimization algorithm are used to optimize the parameters of the SVM under various kernel functions such as radial basis kernel function. The algorithm and particle swarm optimization algorithm optimize the parameters of the SVM to strengthen the applicability of the model in practice. The empirical results show that under the three-parameter optimization algorithms, the prediction results are higher than the random prediction accuracy, which indicates that it is effective to optimize the model by adjusting the parameters of the SVM. Among them, the SVM using the genetic algorithm parameter optimization under the radial basis kernel function shows the better prediction effect, which is the closest to the real value in the stock market forecast. The particle swarm algorithm supports the vector machine to predict the effect is slightly lower than the grid. Search method. In addition, through comparison experiments, the guess accuracy of BP neural network is worse than that of the support vector machine model before the adjustment. Finally, this paper uses the well-trained model to plan the stock smart investment plan.

Performance analysis of SAR filtering techniques using SVM and Wishart Classifier

I335 the training of Support Vector Machine (SVM) classification model, some problems such as over-fitting, under-fitting, slow training speed and prediction affected by penalty and kernel function parameters are exposed. A fault classification method of rolling bearing based on Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) and Grey Wolf Optimization (GWO) -SVM is proposed. Firstly, the acquire signals are adaptively decomposed into a plurality of Intrinsic Mode Function(IMF) component by CEEMDAN, and the energy entropy of each IMF component is extracted to form a set of high dimensional feature vector. Then, the processed feature vectors are introduced into the diagnosis network of GWO-SVM algorithm to build a fault classification model of motor rolling bearing. The classification results show that the CEEMDAN and GWO-SVM fault classification network of motor rolling bearing has higher accuracy and shorter diagnosis time than Particle Swarm Optimization (PSO) -SVM and Cross Validation (CV) -SVM.

The major disadvantage of Support Vector Machine (SVM) happens in its training phase as it requires to solve a quadratic programming problem, making computation very costly. With the integration of LiDAR data and high spatial resolution orthophoto, more input data layers are available for object-based Support Vector Machine classification. Initially, confusion among classes arises because of the presence of irrelevant and redundant data layers. Hence, this study applies Decision Tree (DT), a popular data mining technique, as a pre-classification process in SVM to select the relevant features from the input variables. We assessed the effectiveness of seven vegetation indices, two vegetation index combinations and 14 LiDAR height metrics for mapping agricultural resources in Calatagan, Batangas. We were able to filter the input variables and subsequently achieve at least 73% reduction of training features. With the DT-based feature selection, we were able to reduce the number of input features as well as make the SVM training and classification time shorter by more than 90%. Importantly, the overall accuracy and kappa index of agreement both increased when DT-based SVM was used in contrast with using all the variables for SVM classification.

Distributed Denial of Service (DDoS) attacks represent a significant danger in network security because they can lead to extensive service interruptions. With these attacks increasingly mirroring regular traffic, smart and effective detection systems are essential. This research seeks to assess the efficacy of the Support Vector Machine (SVM) classification algorithm in identifying DDoS attacks in network traffic. The data utilized is CICIDS2017, focusing on the subset Friday-WorkingHours-Afternoon-DDos.pcap_ISCX.csv, which contains both legitimate traffic and DDoS attacks like DoS-Hulk, DoS-GoldenEye, and DDoS. The preprocessing stage included eliminating duplicates and null entries, label binary encoding, normalization through Min-Max Scaler, and feature selection applying the Chi-Square technique. The data was divided into 80% for training and 20% for testing purposes. The Radial Basis Function (RBF) kernel was utilized to train the SVM model, and hyperparameter optimization was performed with GridSearchCV. The evaluation of the model's performance was conducted through accuracy, precision, recall, F1-score, confusion matrix, and visual representations including ROC and Precision-Recall Curves. The findings indicate that prior to tuning, the model reached an accuracy of 97%, which increased to 99% post-tuning, accompanied by an F1-score of 0.99. This shows that the SVM algorithm, when paired with appropriate preprocessing and optimization, is very efficient in identifying DDoS attacks within network traffic.

Abstract: Image retrieval using Support Vector Machine (SVM) classification verydepends on kernel function and parameter. Kernel function used by dot productsubstitution from old dimension feature to new dimension depends on imagedataset condition. In this research, parameter of Gaussian /Radial BasisFunction (RBF) kernel function is optimized using multi class non-linear SVMmethod and implemented to training and test datasets of traditional Indonesian batik images. The batik images dataset is limited to four geometric motifs textures,which are ceplok/ceplokan, kawung, nitikand parang/lerang. Discrete WaveletTransform level 3 daubechies 2 is used to result feature dataset of traditionalbatik images dataset of four classesgeometric motifs textures. The batikimages are used for training and test dataset in SVM-RBF kernel parameteroptimation to maximize accuracy value in non-linear multi-class classification.Cross Validation and Grid-search methods are used to analyze and evaluateSVM-RBF kernel parameter optimation. Confusion matrix measurement method isused to result accuracy value in every evaluationconducted in every combination of cost function/C and gamma/γ as SVM-RBF kernel parameter. Maximumaccuracy parameter value is C = 27 and γ = 2-15 achieved by 10 times evaluation wit different testdataset for each evaluation. Maximum accuracy value is 0.77 to 0.86.

Recently, focus on maintenance strategies has been shifted towards prognostic health management (PHM) and a number of state of the art algorithms based on data-driven prognostics have been developed to predict the health states of degrading components based on sensory data. Amongst these algorithms, Multiclass Support Vector Machines (MC-SVM) has gained popularity due to its relatively high classification accuracy, ability to classify multiple patterns and capability to handle noisy / incomplete data. However, its application is limited by the difficulty in determining the required kernel function and penalty parameters. To address this problem, this paper proposes a hybrid differential evolution – particle swarm optimization (DE-PSO) algorithm to optimize the MC-SVM kernel function and penalty parameters. The differential algorithm (DE) obtains the search limit for the SVM parameters, while the particle swarm optimization algorithm (PSO) determines the global optimum parameters for a given training data set. Since degrading machinery components display several degradation stages in their lifetime, the MC-SVM trained with optimum parameters are used to estimate the health states of a degrading machinery component, from which the remaining useful life (RUL) is predicted. This method improves the classification accuracy of MC-SVM in predicting the health states of a machinery component and consequently increases the accuracy of RUL predictions. The feasibility of the method is validated using bearing prognostic run-to-failure data obtained from NASA public data repository. A comparative study between MC-SVM with parameters obtained using simple grid search with n-fold cross validation and MC- SVM with DE-PSO based on prognostic performance metrics reveals that the proposed method has better performance, with all the cases considered falling within a 10 % error margin. The method also outperforms other soft computing methods proposed in literature.

BBM, or fuel oil, is one of the essential needs of the Indonesian people. The government's policy regarding the increase in fuel prices raises many opinions from the public. Twitter is one of the social media that Indonesian people often use to express opinions on a topic. In this study, sentiment analysis was carried out on public opinion regarding the fuel price increase policy from Twitter social media. This research is expected to help determine public opinion regarding the fuel price increase policy with positive, neutral and negative sentiments. The sentiment analysis method used is the Support Vector Machine (SVM) classification algorithm. The results of the accuracy of SVM were compared with accuracy by adding a feature selection process. The Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) algorithms are used for the feature selection method. After several experiments using the three methods, the SVM method with the Radial Basis Function (RBF) kernel produced the best accuracy of 71.2%. The combination of the SVM method with the RBF and PSO kernels obtained an accuracy of 68.84%, and the combination of the RBF and GA kernel SVM methods obtained an accuracy of 69.52%.