Combining Support Vector Machines for Classifying Fingerprint Images

Near infrared spectroscopy was used in discrimination of intact bovine teeth in terms of animal sex, diet, tooth type and place of origin. Discriminant Analysis (DA) models were developed and tested using a stratified random 70:30 data split to calibration and test sets. Of the discriminant techniques of Soft Independent Modelling of Class Analogy (SIMCA), Partial Least Squares – DA, Artificial Neural Networks (ANN) and Support Vector Machine (SVM), SVM and PLS-DA models performed best in most instances, with pretreatment choice impacting technique success. For test set prediction of animal sex, an accuracy of 95% was achieved using a PLS-DA model, and similar performance achieved using a SVM model. SVM, ANN and SIMCA models predicted three categories of tooth type (deciduous, permanent unerupted and erupted) with similar accuracies (89, 79 and 82%, respectively), however, permanent unerupted teeth were conflated with permanent erupted teeth. Prediction accuracy for ANN, SVM and PLS-DA models were also similar for discrimination of teeth from animals on a grain versus grass diet (PLS-DA 82%). There was considerable variation between models in prediction of geographic origin. Of the seven locations, two were discriminated with true positive rate around 70% using SVM and ANN models. Potential applications of this technology are discussed.

Astrocytoma is the most common neuroepithelial neoplasm, and its grading greatly affects treatment and prognosis. According to relevant factors of astrocytoma, this study developed a support vector machine (SVM) model to predict the astrocytoma grades and compared the SVM prediction with the clinician's diagnostic performance. Patients were recruited from a cohort of astrocytoma patients in our hospital between January 2008 and April 2009. Among all astrocytoma patients, nine had grade I, 25 had grade II, 12 had grade III, and 60 had grade IV astrocytoma. An SVM model was constructed using radial basis kernel. The SVM model was trained with nine magnetic resonance (MR) features and one clinical parameter by fivefold cross-validation and differentiated astrocytomas of grades I-IV at two levels, respectively. The clinician also predicted the grade of astrocytoma. According to the two prediction methods above, the areas under receiving operating characteristics (ROC) curves to discriminate low- and high-grade groups, accuracies of high-grade grouping, overall accuracy, and overall kappa values were compared. For SVM, the overall accuracy was 0.821 and the overall kappa value was 0.679; for clinicians, the overall accuracy was 0.651 and the overall kappa value was 0.466. The diagnostic performance of SVM is significantly better than clinician performance, with the exception of the low-grade group. The SVM model can provide useful information to help clinicians improve diagnostic performance when predicting astrocytoma grade based on MR images.

기업의 부도를 예측하는 것은 회계나 재무 분야에서 중요한 연구주제이다. 지금까지 기업 부도예측을 위해 여러 가지 데이터마이닝 기법들이 적용되었으나 주로 단일 모형을 사용함으로서 복잡한 분류 문제에의 적용에 한계를 갖고 있었다. 본 논문에서는 최근에 각광받고 있는 SVM (support vector machine) 모형들을 결합한 앙상블 SVM 모형 (ensemble SVM model)을 부도예측에 사용하고자 한다. 제안된 앙상블 모형은 v-조각 교차 타당성 (v-fold cross-validation)에 의해 얻어진 여러 가지 모형 중에서 성능이 좋은 상위 k개의 단일 모형으로 구성하고 과반수 투표 방식 (majority voting)을 사용하여 미지의 클래스를 분류한다. 본 논문에서 제안된 앙상블 SVM 모형의 성능을 평가하기 위해 실제 기업의 재무비율 자료와 모의실험자료를 가지고 실험하였고, 실험결과 제안된 앙상블 모형이 여러 가지 평가척도 하에서 단일 SVM 모형들보다 좋은 성능을 보임을 알 수 있었다. Corporate bankruptcy prediction has been an important topic in the accounting and finance field for a long time. Several data mining techniques have been used for bankruptcy prediction. However, there are many limits for application to real classification problem with a single model. This study proposes ensemble SVM (support vector machine) model which assembles different SVM models with each different kernel functions. Our ensemble model is made and evaluated by v-fold cross-validation approach. The k top performing models are recruited into the ensemble. The classification is then carried out using the majority voting opinion of the ensemble. In this paper, we investigate the performance of ensemble SVM classifier in terms of accuracy, error rate, sensitivity, specificity, ROC curve, and AUC to compare with single SVM classifiers based on financial ratios dataset and simulation dataset. The results confirmed the advantages of our method: It is robust while providing good performance.

Comparative study of different machine learning models in landslide susceptibility assessment: A case study of Conghua District, Guangzhou, China

Aggregate stability is a useful soil physical dynamic index of soil resistivity to surface wind and water erosion in all ecosystems, especially, in arid and semi-arid regions. Two machine learning techniques including support vector machines (SVMs) and artificial neural networks (ANNs) were used to develop predictive models for the estimation of geometric mean diameter (GMD) of soil aggregates. An empirical multiple linear regression (MLR) model was also constructed as the benchmark to compare their performances. Furthermore, the influence of feature space dimension reduction using parallel genetic algorithm (PGA) on the prediction accuracy of all investigated techniques was evaluated. The ANN model achieved greater accuracy in GMD prediction as compared to the MLR and SVM models. The obtained ERROR% value in GMD prediction using the ANN model was 6.9%, while it was 15.7 and 10.6% for the MLR and SVM models, respectively. Feature selection using PGA improved the prediction accuracy of all investigated techniques. The coefficient of determination (R2) values between the measured and the predicted GMD values using PGA-based MLR, SVM, and ANN models increased by 20.0, 12.2, and 8.8% in comparison with the proposed MLR, SVM, and ANN models. In conclusion, it appears that the PGA-based ANN model could be considered as an alternative to conventional regression models for the GMD prediction.

Bus arrival time prediction is an important part of intelligent transport system, the prediction accuracy directly affects the overall level of the intelligent transport system. This paper mainly studies the hybrid bus arrival time prediction model, which combines the real-time prediction and support vector machine (SVM) model. And in the SVM model, three factors was chosen as reference, which is time, weather, holidays. This paper is based on the analysis of the characteristics of Yuxi intelligent transport system, and choosing the support vector machine (SVM) model as prediction model, which is adaptive, robustness, and fitting small sample prediction. At the same time, using the GPS technology, which solves the problem of the complexity of the road traffic and the singularity of historical data. The model of this paper effectively solves the problem of bus arrival time prediction.

To the nonlinear controlled objects that generally exist in industrial processes, a predictive control algorithm based on support vector machine (SVM) model was proposed. First, SVM model with RBF kernel function was constructed offline. Then, the future values of controlled variable were predicted and linearized online using the SVM model. Finally, generalized predictive control (GPC) was applied to realize control goal. The simulation proves that this method is effective.

Purpose: Accurate lymph node (LN) status evaluation for intrahepatic cholangiocarcinoma (ICC) patients is essential for surgical planning. This study aimed to develop and validate a prediction model for preoperative LN status evaluation in ICC patients.Methods and Materials: A group of 106 ICC patients, who were diagnosed between April 2011 and February 2016, was used for prediction model training. Image features were extracted from T1-weighted contrast-enhanced MR images. A support vector machine (SVM) model was built by using the most LN status-related features, which were selected using the maximum relevance minimum redundancy (mRMR) algorithm. The mRMR method ranked each feature according to its relevance to the LN status and redundancy with other features. An SVM score was calculated for each patient to reflect the LN metastasis (LNM) probability from the SVM model. Finally, a combination nomogram was constructed by incorporating the SVM score and clinical features. An independent group of 42 patients who were diagnosed from March 2016 to November 2017 was used to validate the prediction models. The model performances were evaluated on discrimination, calibration, and clinical utility.Results: The SVM model was constructed based on five selected image features. Significant differences were found between patients with LNM and non-LNM in SVM scores in both groups (the training group: 0.5466 (interquartile range (IQR), 0.4059-0.6985) vs. 0.3226 (IQR, 0.0527-0.4659), P<0.0001; the validation group: 0.5831 (IQR, 0.3641-0.8162) vs. 0.3101 (IQR, 0.1029-0.4661), P=0.0015). The combination nomogram based on the SVM score, the CA 19-9 level, and the MR-reported LNM factor showed better discrimination in separating patients with LNM and non-LNM, comparing to the SVM model alone (AUC: the training group: 0.842 vs. 0.788; the validation group: 0.870 vs. 0.787). Favorable clinical utility was observed using the decision curve analysis for the nomogram.Conclusion: The nomogram, incorporating the SVM score, CA 19-9 level and the MR-reported LNM factor, provided an individualized LN status evaluation and helped clinicians guide the surgical decisions.

Exploring effectiveness of frequency ratio and support vector machine models in storm surge flood susceptibility assessment: A study of Sundarban Biosphere Reserve, India

Flooding causes several threats with outcomes which include peril to human and animal life, damage to property, and adversity to agricultural fields. Therefore, flood prediction is of prime importance for reducing loss of life and devastation to property. To model complex nature of hydrologic processes artificial neural network (ANN) tool is effectively being utilized for modelling different nonlinear relationships, and has proved to be an appropriate method for flood prediction. Present study investigated relative accuracy of radial basis function neural network (RBFNN) and support vector machine (SVM) models combined with Firefly Algorithm (FA) in predicting river flood discharge and contrasted with that of regular ANN, RBFNN and SVM models. Monthly river flow data of Silchar and Dholai stations located in Cachar district of Assam, India are utilized for the present study. For assessing model performance, coefficient of determination (R2), mean square error (MSE) and root mean square error (RMSE) were measured. Evaluation of outcomes shows that both RBF-FA (radial basis function - firefly algorithm) and SVM-FA (support vector machine - firefly algorithm) hybrid models give more precise forecasting results than RBFNN, FFBPNN (feed forward back propagation neural network) and SVM models. Yet, it can be observed that SVM-FA model give better forecasting outputs with R2 value 0.9818 than RBF-FA model. Results also reveal that simple SVM model performs marginally better than simple ANN model.

A kernel-free fuzzy reduced quadratic surface [formula omitted]-support vector machine with applications

Garlic prices fluctuate dramatically in recent years and it is very difficult to predict garlic prices. The autoregressive integrated moving average (ARIMA) model is currently the most important method for predicting garlic prices. However, the ARIMA model can only predict the linear part of the garlic prices, and cannot predict its nonlinear part. Therefore, it is urgent to adopt a method to analyze the nonlinear characteristics of garlic prices. After comparing the advantages and disadvantages of several major prediction models which used to forecast nonlinear time series, using support vector machine (SVM) model to predict the nonlinear part of garlic prices and establish ARIMA-SVM hybrid forecast model to predict garlic prices. The monthly average price data of garlic in 2010-2017 was used to test the effect of ARIMA model, SVM model and ARIMA-SVM model. The experimental results show that: (1) Garlic price is affected by many factors but the most is the supply and demand relationship; (2) The SVM model has a good effect in dealing with the nonlinear relationship of garlic prices; (3) The ARIMA-SVM hybrid model is better than the single ARIMA model and SVM model on the accuracy of garlic price prediction, it can be used as an effective method to predict the short-term price of garlic.

Understanding the drivers underlying waste production in general, and source-segregated waste in particular, is of utmost importance for waste managers. This work aims at evaluating the performance of support vector machines (SVM) models in the prediction of separate collection yields for packaging waste at municipal level. Two SVM models were developed for a case study of 42 municipalities simultaneously serviced by separate collection of packaging waste and by unsorted waste collection. The “SVM-fixed” model used a fixed set of 5 variables to predict collection yields, whereas the “SVM-optimal” model chose from a pool of 14 variables those that optimized performance, using a genetic algorithm. These SVM models were compared with 3 traditional regression models: the ordinary least square linear (OLS-L), the ordinary least square non-linear (OLS-NL) and robust regression. The robust regression model was further compared against the other regression models in order to assess the influence of the dataset outliers on the model performance. The coefficient of determination, R2, was used to evaluate the performance of these models. The highest performance was attained by the SVM-optimal model (R2 = 0.918), compared to the SVM-fixed model (R2 = 0.670). The performance of the SVM-optimal model was 42% higher than the best performing regression model, the OLS-NL model (R2 = 0.646). The differences in performance among the 3 regression models are small (circa 3%), whereas the exclusion of outliers improved their performance by 13%, indicating that outliers impacted more on performance than the type of traditional regression technique used. The results demonstrate that SVM model can be a viable alternative for prediction of separate collection of packaging waste yields and that there are nine important drivers that all together explain roughly 92% (R2 = 0.918) of the variability in the separate collection yields data.

In this paper, we present an approach for the fast deployment and efficient scoring of Support Vector Machine (SVM) models. We developed a compiler for transforming a formal specification of a SVM and generating source code in different versions of the C/C++ language. This effectively automates the deployment of SVM models and its integration into the operational software for its use. The proposed compiler generates efficient code to deploy SVM models in CPUs (single or multi-core) and in Graphics Processing Units (GPUs) through NVIDIA's Computed Unified Device Architecture (CUDA). We also present an empirical evaluation of our compiler's targets scoring a SVM model with a linear kernel. In our experiments we score a real dataset in batch mode at different scales. The results show that our C CUDA implementation performs better as data scale increases and it is approximately 38 times faster than the single-core implementation using single precision floating-point values.

Reliable hourly flood forecasting using weather radar rainfall data for early warning system is essential for reducing natural disaster risk during extreme typhoon events. This study proposed a novel approach integrated with physics-based WASH123D and HEC-HMS models to forecast 1 h ahead flood level in the Fengshan Creek basin, northern Taiwan. The comparison was done with data-driven support vector machine (SVM) model, and performances were assessed by using statistical indicators (root mean square error, correlation coefficient, the error of time to peak flood level, the error of peak flood). Four typhoons and two plum rain events (with 620 data sets) were selected for the process of model calibration and validation. The model performs better when it used quantitative precipitation estimate radar data rather than rain gauge data. Results of using 1 h ahead quantitative precipitation forecast (QPF) as input for flood forecasting were encouraging but not feasible to use directly for early flood warning system due to errors in peak flood levels and timing. Therefore, the improvement in accuracy of 1 h ahead flood forecasting was done using physics-based approach and SVM model. The systematic comparison revealed that the SVM model is an attractive way out to improve the accuracy of QPF forecasted flood levels but unable to fully describe the flood level patterns in terms of timings and flood peaks, while the results obtained by the physics-based approach were accurate and much better than the SVM model. The approach fully described the physics of hydrograph patterns and outputs have exactly the same 1 h ahead predictions, in excellent agreement with observations. The reliable and accurate reflections of timing and amount of flood peaks in all selected typhoons by a newly developed physics-based approach with its operational nature are recommended to use by the government in the future for early warning to reduce the flood impacts during typhoon events.