Low-Rank & Sparse Matrix Decomposition and Support Vector Machine for Hyperspectral Anomaly Detection

Although hyperspectral anomaly detection is commonly conducted in the visible, near-infrared, and shortwave infrared spectral regions, there has been less research on hyperspectral anomaly detection in the longwave infrared (LWIR) hyperspectral region. The radiance of thermal infrared hyperspectral imagery is determined by the temperature and emissivity. To avoid the detection uncertainty caused by the single factor of temperature, emissivity can be introduced to detect anomalies. However, in the emissivity domain, the spectral contrast and signal-to-noise ratio (SNR) are low, which makes it difficult to separate the anomalies from the background. In this paper, an anomaly detection method combining emissivity and a segmented low-rank prior (EaSLRP) is proposed for use with thermal infrared hyperspectral imagery. The EaSLRP method is divided into three parts—1) temperature/emissivity retrieval, 2) extraction of the thermal infrared hyperspectral background information, and 3) Mahalanobis distance detection. A homogeneous region generation method is also proposed to solve the problem of the complex global background leading to inaccurate background estimation. The GoDec method is used for matrix decomposition and background information extraction and to remove some of the noise. The proposed Mahalanobis distance detector then uses the background component and original image for anomaly detection, while highlighting the spectral difference between the anomalies and background. This method can also suppress the influence of noise, to some extent. The experimental results obtained with airborne Fourier transform thermal infrared spectrometer hyperspectral images demonstrate that the EaSLRP method is effective when compared with the Reed–Xiaoli detector (RXD), the segmented RX detector (SegRX), the low-rank and sparse representation-based detector (LRASR), the low-rank and sparse matrix decomposition (LRaSMD)-based Mahalanobis distance method (LSMAD), and the locally enhanced low-rank prior method (LELRP-AD).

Near infrared spectroscopy was used in discrimination of intact bovine teeth in terms of animal sex, diet, tooth type and place of origin. Discriminant Analysis (DA) models were developed and tested using a stratified random 70:30 data split to calibration and test sets. Of the discriminant techniques of Soft Independent Modelling of Class Analogy (SIMCA), Partial Least Squares – DA, Artificial Neural Networks (ANN) and Support Vector Machine (SVM), SVM and PLS-DA models performed best in most instances, with pretreatment choice impacting technique success. For test set prediction of animal sex, an accuracy of 95% was achieved using a PLS-DA model, and similar performance achieved using a SVM model. SVM, ANN and SIMCA models predicted three categories of tooth type (deciduous, permanent unerupted and erupted) with similar accuracies (89, 79 and 82%, respectively), however, permanent unerupted teeth were conflated with permanent erupted teeth. Prediction accuracy for ANN, SVM and PLS-DA models were also similar for discrimination of teeth from animals on a grain versus grass diet (PLS-DA 82%). There was considerable variation between models in prediction of geographic origin. Of the seven locations, two were discriminated with true positive rate around 70% using SVM and ANN models. Potential applications of this technology are discussed.

기업의 부도를 예측하는 것은 회계나 재무 분야에서 중요한 연구주제이다. 지금까지 기업 부도예측을 위해 여러 가지 데이터마이닝 기법들이 적용되었으나 주로 단일 모형을 사용함으로서 복잡한 분류 문제에의 적용에 한계를 갖고 있었다. 본 논문에서는 최근에 각광받고 있는 SVM (support vector machine) 모형들을 결합한 앙상블 SVM 모형 (ensemble SVM model)을 부도예측에 사용하고자 한다. 제안된 앙상블 모형은 v-조각 교차 타당성 (v-fold cross-validation)에 의해 얻어진 여러 가지 모형 중에서 성능이 좋은 상위 k개의 단일 모형으로 구성하고 과반수 투표 방식 (majority voting)을 사용하여 미지의 클래스를 분류한다. 본 논문에서 제안된 앙상블 SVM 모형의 성능을 평가하기 위해 실제 기업의 재무비율 자료와 모의실험자료를 가지고 실험하였고, 실험결과 제안된 앙상블 모형이 여러 가지 평가척도 하에서 단일 SVM 모형들보다 좋은 성능을 보임을 알 수 있었다. Corporate bankruptcy prediction has been an important topic in the accounting and finance field for a long time. Several data mining techniques have been used for bankruptcy prediction. However, there are many limits for application to real classification problem with a single model. This study proposes ensemble SVM (support vector machine) model which assembles different SVM models with each different kernel functions. Our ensemble model is made and evaluated by v-fold cross-validation approach. The k top performing models are recruited into the ensemble. The classification is then carried out using the majority voting opinion of the ensemble. In this paper, we investigate the performance of ensemble SVM classifier in terms of accuracy, error rate, sensitivity, specificity, ROC curve, and AUC to compare with single SVM classifiers based on financial ratios dataset and simulation dataset. The results confirmed the advantages of our method: It is robust while providing good performance.

Astrocytoma is the most common neuroepithelial neoplasm, and its grading greatly affects treatment and prognosis. According to relevant factors of astrocytoma, this study developed a support vector machine (SVM) model to predict the astrocytoma grades and compared the SVM prediction with the clinician's diagnostic performance. Patients were recruited from a cohort of astrocytoma patients in our hospital between January 2008 and April 2009. Among all astrocytoma patients, nine had grade I, 25 had grade II, 12 had grade III, and 60 had grade IV astrocytoma. An SVM model was constructed using radial basis kernel. The SVM model was trained with nine magnetic resonance (MR) features and one clinical parameter by fivefold cross-validation and differentiated astrocytomas of grades I-IV at two levels, respectively. The clinician also predicted the grade of astrocytoma. According to the two prediction methods above, the areas under receiving operating characteristics (ROC) curves to discriminate low- and high-grade groups, accuracies of high-grade grouping, overall accuracy, and overall kappa values were compared. For SVM, the overall accuracy was 0.821 and the overall kappa value was 0.679; for clinicians, the overall accuracy was 0.651 and the overall kappa value was 0.466. The diagnostic performance of SVM is significantly better than clinician performance, with the exception of the low-grade group. The SVM model can provide useful information to help clinicians improve diagnostic performance when predicting astrocytoma grade based on MR images.

Comparative study of different machine learning models in landslide susceptibility assessment: A case study of Conghua District, Guangzhou, China

Aggregate stability is a useful soil physical dynamic index of soil resistivity to surface wind and water erosion in all ecosystems, especially, in arid and semi-arid regions. Two machine learning techniques including support vector machines (SVMs) and artificial neural networks (ANNs) were used to develop predictive models for the estimation of geometric mean diameter (GMD) of soil aggregates. An empirical multiple linear regression (MLR) model was also constructed as the benchmark to compare their performances. Furthermore, the influence of feature space dimension reduction using parallel genetic algorithm (PGA) on the prediction accuracy of all investigated techniques was evaluated. The ANN model achieved greater accuracy in GMD prediction as compared to the MLR and SVM models. The obtained ERROR% value in GMD prediction using the ANN model was 6.9%, while it was 15.7 and 10.6% for the MLR and SVM models, respectively. Feature selection using PGA improved the prediction accuracy of all investigated techniques. The coefficient of determination (R2) values between the measured and the predicted GMD values using PGA-based MLR, SVM, and ANN models increased by 20.0, 12.2, and 8.8% in comparison with the proposed MLR, SVM, and ANN models. In conclusion, it appears that the PGA-based ANN model could be considered as an alternative to conventional regression models for the GMD prediction.

The paper explores the hybrid of SVM and system of Artificial Neural Network as the finest binary classification system for calculating the diabetic nature of people in comparison to Support Vector Machine (SVM). In this research, the sets of all the parameters describing the diabetic nature of a person are taken from the laboratories. This approach is chosen so that a better learning method can be used for various problems. The testing results were found to be in accordance with the accepted results that resemble with the direct diagnosis of a physician. The results of this research shows that this hybrid SVM and Artificial Neural Network (ANN) model is more precise than the SVM model. These results of the hybrid SVM and ANN model suggest that it is very effective for the classification of Diabetic and Non Diabetic nature of a person. This paper highlights the concept of Support Vector Machines and its integration with Artificial Neural Network, the two key characteristics with one being the generalization theory of the SVM model that best describes how to select a hypothesis and functions given by Kernel that introduces the idea of non-linearity without the inclusion of the actual algorithm.

This study compares single and hybrid soft computing models for estimating daily solar radiation flux for two scenarios. Scenario I developed single soft computing models, including multilayer perceptron (MLP), support vector machines (SVM), adaptive neuro-fuzzy inference system (ANFIS), and multivariate adaptive regression splines (MARS), for estimating daily solar radiation flux at two stations from the USA and South Korea. The MLP model was used to evaluate the effect of factors controlling daily solar radiation flux. Using different combinations of controlling factors as input, the MLP and SVM models, based on evaluation measures, were found to be superior to the ANFIS and MARS models at Big Bend station, USA. In addition, the MLP, SVM, and MARS models performed better than did the ANFIS model at Incheon station, South Korea. Scenario II combined the discrete wavelet transform (DWT) and single soft computing models (e.g., MLP and SVM) for improved performance using 4-input combination. The wavelet-based MLP (WMLP) and SVM (WSVM) models were superior to other single soft computing models (MLP, SVM, ANFIS, and MARS) at two stations. Taylor diagrams, violin plots and point density plots were also utilized to examine the similarity between the observed and estimated solar radiation flux values. Results showed that scenarios I and II can be alternatives for estimating daily solar radiation flux based on different meteorological information, such as peninsular and continental conditions.

Purpose: Accurate lymph node (LN) status evaluation for intrahepatic cholangiocarcinoma (ICC) patients is essential for surgical planning. This study aimed to develop and validate a prediction model for preoperative LN status evaluation in ICC patients.Methods and Materials: A group of 106 ICC patients, who were diagnosed between April 2011 and February 2016, was used for prediction model training. Image features were extracted from T1-weighted contrast-enhanced MR images. A support vector machine (SVM) model was built by using the most LN status-related features, which were selected using the maximum relevance minimum redundancy (mRMR) algorithm. The mRMR method ranked each feature according to its relevance to the LN status and redundancy with other features. An SVM score was calculated for each patient to reflect the LN metastasis (LNM) probability from the SVM model. Finally, a combination nomogram was constructed by incorporating the SVM score and clinical features. An independent group of 42 patients who were diagnosed from March 2016 to November 2017 was used to validate the prediction models. The model performances were evaluated on discrimination, calibration, and clinical utility.Results: The SVM model was constructed based on five selected image features. Significant differences were found between patients with LNM and non-LNM in SVM scores in both groups (the training group: 0.5466 (interquartile range (IQR), 0.4059-0.6985) vs. 0.3226 (IQR, 0.0527-0.4659), P<0.0001; the validation group: 0.5831 (IQR, 0.3641-0.8162) vs. 0.3101 (IQR, 0.1029-0.4661), P=0.0015). The combination nomogram based on the SVM score, the CA 19-9 level, and the MR-reported LNM factor showed better discrimination in separating patients with LNM and non-LNM, comparing to the SVM model alone (AUC: the training group: 0.842 vs. 0.788; the validation group: 0.870 vs. 0.787). Favorable clinical utility was observed using the decision curve analysis for the nomogram.Conclusion: The nomogram, incorporating the SVM score, CA 19-9 level and the MR-reported LNM factor, provided an individualized LN status evaluation and helped clinicians guide the surgical decisions.

Flooding causes several threats with outcomes which include peril to human and animal life, damage to property, and adversity to agricultural fields. Therefore, flood prediction is of prime importance for reducing loss of life and devastation to property. To model complex nature of hydrologic processes artificial neural network (ANN) tool is effectively being utilized for modelling different nonlinear relationships, and has proved to be an appropriate method for flood prediction. Present study investigated relative accuracy of radial basis function neural network (RBFNN) and support vector machine (SVM) models combined with Firefly Algorithm (FA) in predicting river flood discharge and contrasted with that of regular ANN, RBFNN and SVM models. Monthly river flow data of Silchar and Dholai stations located in Cachar district of Assam, India are utilized for the present study. For assessing model performance, coefficient of determination (R2), mean square error (MSE) and root mean square error (RMSE) were measured. Evaluation of outcomes shows that both RBF-FA (radial basis function - firefly algorithm) and SVM-FA (support vector machine - firefly algorithm) hybrid models give more precise forecasting results than RBFNN, FFBPNN (feed forward back propagation neural network) and SVM models. Yet, it can be observed that SVM-FA model give better forecasting outputs with R2 value 0.9818 than RBF-FA model. Results also reveal that simple SVM model performs marginally better than simple ANN model.

Flood susceptibility mapping using a novel ensemble weights-of-evidence and support vector machine models in GIS

Bus arrival time prediction is an important part of intelligent transport system, the prediction accuracy directly affects the overall level of the intelligent transport system. This paper mainly studies the hybrid bus arrival time prediction model, which combines the real-time prediction and support vector machine (SVM) model. And in the SVM model, three factors was chosen as reference, which is time, weather, holidays. This paper is based on the analysis of the characteristics of Yuxi intelligent transport system, and choosing the support vector machine (SVM) model as prediction model, which is adaptive, robustness, and fitting small sample prediction. At the same time, using the GPS technology, which solves the problem of the complexity of the road traffic and the singularity of historical data. The model of this paper effectively solves the problem of bus arrival time prediction.

Existing studies have attempted to determine the tool chipping condition using the indirect method of data capture and intelligent analysis techniques considering machine parameters, and tool conditions using signal processing techniques. Due to the obstructive nature of the machining operation, however, it is daunting to use signal capturing to intelligently capture the condition of the tool as well as that of the workpiece. This study aimed to apply some advanced signal processing techniques to the vibration signals captured experimentally during machining operation for the decision making and analysis of tool and workpiece conditions. Vibration signals were captured during turning operations while using four (4) classes of tools, based on their flank wear. The signals were first pre-processed and decomposed using the Empirical Mode Decomposition (EMD) method. The Hilbert–Huang transform (HHT) was applied to the resulting IMFs obtained to compute the feature vectors used to classify the condition of the tool and workpiece. A total of 12 features, consisting of instantaneous properties such as instantaneous energy, instantaneous frequencies, and amplitudes, were obtained for data training and classification of tool conditions. To optimize the classification process, feature selection was performed using a genetic algorithm (GA) to reduce the number of features from 12 to 4 for data training and classification. The feature vectors were first trained for tool classification with a neural network scaled conjugate gradient (SCG) algorithm. The result showed that the model classification error was 0.102. Two other machine learning models, support vector machine (SVM) and K-Nearest Neighbors (KNN), were also implemented for classifying the tool conditions, from the feature vector, to determine the model that most accurately predicted the condition of the tool. To avoid bias and reduce misclassification errors, the k-fold cross-validation technique was applied with ‘k’ taken as 5 and 10. The computed feature vectors were used as inputs to train the machine learning model using both SVM and KNN models to classify the tool and workpiece condition during machining. The error loss of each model was evaluated and plotted to review the performance. The average overall error loss of 0.5031 was observed for the SVM model with 5-fold cross-validation, whereas the error loss of 0.0318 was observed for the KNN model with 5-fold cross-validation. The average overall error loss of 0.5009 was observed for the SVM model with 10-fold cross-validation when trained using the features selected by a genetic algorithm (GA), while the average overall error loss of 0.0343 was observed for the KNN model. The optimal performance of the SVM model was obtained when all features were used for the training, whereas the KNN model performed better when feature selection was implemented. The error losses of the models were evaluated to be less in KNN models, compared to SVM and SCG. The obtained results also showed that the developed KNN models performed 10 times better than the SVM model in predicting the tool condition from the captured vibration signal during the machining process.

To the nonlinear controlled objects that generally exist in industrial processes, a predictive control algorithm based on support vector machine (SVM) model was proposed. First, SVM model with RBF kernel function was constructed offline. Then, the future values of controlled variable were predicted and linearized online using the SVM model. Finally, generalized predictive control (GPC) was applied to realize control goal. The simulation proves that this method is effective.

A kernel-free fuzzy reduced quadratic surface [formula omitted]-support vector machine with applications