Comparison Support Vector Machine and Fuzzy Possibilistic C-Means based on the kernel for Knee Osteoarthritis data Classification

Beras Miskin (Raskin) Program is a program of social protection, as supporters of other programs such as nutrition improvement, healthy increase, education and productivity improvement of Poor Households. According to Badan Pusat Statistika, there were 14 criteria to determine a household is classified as poor households. Based on these criteria it will be classified of recipient households and non-recipient households of Beras Miskin (Raskin) Program by Support Vector Machine (SVM) method using LibSVM. The concept of classification by SVM is search for the best hyperplane which serves as a separator of two classes of data in the input space. Kernel function is used to convert the data into a higher dimensional space to allow a separation. LibSVM is a package program created by Chih-Chung Chang and Chih-Jen Lin from Department of Computer Science at National Taiwan University. The method used by LibSVM to obtain global solution of duality lagrange problem is decomposition method. To determine the best parameters of kernel function, used k-vold cross validation method and grid search algorithm. In this classification by SVM method using LibSVM, obtain the best accuracy value as 83,1933%, which is the kernel function Radial Basis Function (RBF). Keywords : Beras Miskin (Raskin) Program, Classification, Support Vector Machine (SVM), LibSVM, Kernel Function

Bond rating is regarded as an important event for measuring financial risk of companies and for determining the investment returns of investors. As a result, it has been a popular research topic for researchers to predict companies' credit ratings by applying statistical and machine learning techniques. The statistical techniques, including multiple regression, multiple discriminant analysis (MDA), logistic models (LOGIT), and probit analysis, have been traditionally used in bond rating. However, one major drawback is that it should be based on strict assumptions. Such strict assumptions include linearity, normality, independence among predictor variables and pre-existing functional forms relating the criterion variablesand the predictor variables. Those strict assumptions of traditional statistics have limited their application to the real world. Machine learning techniques also used in bond rating prediction models include decision trees (DT), neural networks (NN), and Support Vector Machine (SVM). Especially, SVM is recognized as a new and promising classification and regression analysis method. SVM learns a separating hyperplane that can maximize the margin between two categories. SVM is simple enough to be analyzed mathematical, and leads to high performance in practical applications. SVM implements the structuralrisk minimization principle and searches to minimize an upper bound of the generalization error. In addition, the solution of SVM may be a global optimum and thus, overfitting is unlikely to occur with SVM. In addition, SVM does not require too many data sample for training since it builds prediction models by only using some representative sample near the boundaries called support vectors. A number of experimental researches have indicated that SVM has been successfully applied in a variety of pattern recognition fields. However, there are three major drawbacks that can be potential causes for degrading SVM's performance. First, SVM is originally proposed for solving binary-class classification problems. Methods for combining SVMs for multi-class classification such as One-Against-One, One-Against-All have been proposed, but they do not improve the performance in multi-class classification problem as much as SVM for binary-class classification. Second, approximation algorithms (e.g. decomposition methods, sequential minimal optimization algorithm) could be used for effective multi-class computation to reduce computation time, but it could deteriorate classification performance. Third, the difficulty in multi-class prediction problems is in data imbalance problem that can occur when the number of instances in one class greatly outnumbers the number of instances in the other class. Such data sets often cause a default classifier to be built due to skewed boundary and thus the reduction in the classification accuracy of such a classifier. SVM ensemble learning is one of machine learning methods to cope with the above drawbacks. Ensemble learning is a method for improving the performance of classification and prediction algorithms. AdaBoost is one of the widely used ensemble learning techniques. It constructs a composite classifier by sequentially training classifiers while increasing weight on the misclassified observations through iterations. The observations that are incorrectly predicted by previous classifiers are chosen more often than examples that are correctly predicted. Thus Boosting attempts to produce new classifiers that are better able to predict examples for which the current ensemble's performance is poor. In this way, it can reinforce the training of the misclassified observations of the minority class. This paper proposes a multiclass Geometric Mean-based Boosting (MGM-Boost) to resolve multiclass prediction problem. Since MGM-Boost introduces the notion of geometric mean into AdaBoost, it can perform learning process considering the geometric mean-based accuracy and errors of multiclass. This study applies MGM-Boost to the real-world bond rating case for Korean companies to examine the feasibility of MGM-Boost. 10-fold cross validations for threetimes with different random seeds are performed in order to ensure that the comparison among three different classifiers does not happen by chance. For each of 10-fold cross validation, the entire data set is first partitioned into tenequal-sized sets, and then each set is in turn used as the test set while the classifier trains on the other nine sets. That is, cross-validated folds have been tested independently of each algorithm. Through these steps, we have obtained the results for classifiers on each of the 30 experiments. In the comparison of arithmetic mean-based prediction accuracy between individual classifiers, MGM-Boost (52.95%) shows higher prediction accuracy than both AdaBoost (51.69%) and SVM (49.47%). MGM-Boost (28.12%) also shows the higher prediction accuracy than AdaBoost (24.65%) and SVM (15.42%)in terms of geometric mean-based prediction accuracy. T-test is used to examine whether the performance of each classifiers for 30 folds is significantly different. The results indicate that performance of MGM-Boost is significantly different from AdaBoost and SVM classifiers at 1% level. These results mean that MGM-Boost can provide robust and stable solutions to multi-classproblems such as bond rating.

Accurate estimation of river flow can have a significant importance in water resources management. In this study, Genetic programming (GP) and Support Vector Machine (SVM) methods were used to forecast daily discharge of Barandoozchay River. The daily discharge data of Barandoozchay River measured at the Dizaj hydrometric station during 2007 to 2011 was used for modeling, which 80% of the data used for training and remaining 20% used for testing of models. The results showed that in the both of considered methods, the models including discharges of one, two and three days ago had higher accuracy in verification step and the accuracy of models decreased with increasing discharge values. Comparing the performance of GP and SVM methods indicated that, however the accuracy of the GP method with the R=0.978 and RMSE=1.66 (m3/s) was slightly more than SVM method with R=0.976 and RMSE=1.80 (m3/s), but the SVM is easier than GP method. Thus, the SVM method can be used as an alternative method in forecasting daily river discharge.

Flood susceptibility mapping using a novel ensemble weights-of-evidence and support vector machine models in GIS

The structural risk minimisation (SRM) principle based on the statistical learning theory of Vapnik aims to prevent the phenomenon of overfitting by balancing the complexity of models with their fit to the data. This principle has been embodied in support vector machines, a widely acclaimed generic approach to machine learning. This paper investigates the performance of the SRM principle in its application to standard least-squares regression and compares it with its integration with support vector machines.

Accuracy of data and information on various types of land use and land cover (LULC) is crucial in watershed management planning. The development of remote sensing technology in predicting LULC has been widely used, such as the Support Vector Machine (SVM) and Random Trees (RT) methods. Both methods are part of the model of machine learning and belong to the category of supervised learning. This method can predict, study, and recognize data patterns from the results of training data. The aim of this research is the use of SVM and RT methods for the identification of LULC. Based on the SVM method analysis results, the forest area is 211.61 km2, coffee plantations are 32.92 km2, shrubs are 16.85 km2, built-up/bare land is 3.40 km2, the water body is 3.17 km2, and cloud/shadow is 6.79 km2. While the RT method obtained a forest area of 215.51 km2, coffee plantations covering an area of 29.32 km2, shrubs are covering an area of 16.32 km2, built-up/bare land surrounding an area of 7.22 km2, water body covering an area of 2.62 km2, and cloud/shadow covering an area of 3.75 km2. Overall, the percentage accuracy of the SVM method of 87%, and the RT of 86%. The success rate of modeling SVM (AUC = 0.73) and RT (AUC = 0.75) based on the results of data validation using the area under the receiver operating characteristic curve (AUC) was considered fair good.

The statistical learning theory has formulated the Structural Risk Minimization (SRM) principle, based upon the functional form of risk bound on the generalization performance of a learning machine. This paper addresses the application of this formula, which is equivalent to a complexity penalty, to model selection tasks for decision trees, whereas the quantization of the machine capacity for decision trees is estimated using an empirical approach. Experimental results show that, for either classification or regression problems, this novel strategy of decision tree pruning performs better than alternative methods. We name classification and regression trees pruned by virtue of this methodology as Statistical Learning Intelligent Trees (SLIT).

Boosting diagnosis accuracy of Alzheimer's disease using high dimensional recognition of longitudinal brain atrophy patterns

The specifications of the forests in Kalimantan are part of the vegetation type which is characteristic of dry lowland forests that are rich in biodiversity. The Kalimantan forest area is known as an area that has the highest vascular biodiversity in the world. Until 2014, the rate of forest loss as a source of biodiversity was always high every year. The National Polar-Orbiting Suomi Partnership (Suomi NPP) is a new generation of weather satellite imagery from NASA which currently continues to develop application algorithms for environmental monitoring. The support vector machine (SVM) method is a one-class learning machine method with artificial neural network methods that can recognize patterns from input or examples given and also include supervised learning. This study aims to analyze the effect of each parameter on the SVM method and the combination that can produce the highest accuracy, and analyze the ability of the SVM method for making hotspot maps based on the number of forest fire areas in East Kalimantan. The results of the study showed that the Support Vector Machine (SVM) method on the spectral data produced a total of 85%.

A combination classification algorithm, ER-SVM, is proposed to improve the generalization performance of support vector machine (SVM) by directly making full use of the empirical risk (ER) information of SVM in the paper. SVM classification is the implementation of structure risk minimization (SRM) principle. SVM may achieve SRM from the minimal summation of ER and VC confidence according to the theory of VC dimension. However, the ER is seldom zero for a trained SVM in practice. That is, though the minimal summation of ER and VC confidence can be achieved in theory, it is very time-consuming in parameters selection for a given task to make ER zero. In order to overcome such difficulty, a combination classification algorithm is proposed to improve the performance by utilizing ER information. The SR arising from the existing ER is reduced by using aided nearest neighbor method. In addition, the proposed algorithm is independent of training parameters in SVM. The experimental results verify the effectiveness of the proposed algorithm

A support vector machine is a machine learning method based on the statistical learning theory and structural risk minimization. The support vector machine is a much better method than ever, because it may solve some actual problems in small samples, high dimension, nonlinear and local minima etc. The article utilizes the theory and method of support vector machine (SVM) regression and establishes the regressive model based on the least square support vector machine (LS-SVM). Through predicting passenger flow on Hangzhou highway in 2000–2008, the paper shows that the regressive model of LS-SVM has much higher accuracy and reliability of prediction, and therefore may effectively predict passenger flow on the highway. Santrauka Atraminių vektorių metodas (Support Vector Machine – SVM) yra skaičiuojamasis metodas, paremtas statistikos teorija, struktūriniu požiūriu mažinant riziką. SVM metodas, palyginti su kitais metodais, yra patikimesnis metodas, nes juo remiantis galima išspręsti realias problemas, esant įvairioms sąlygoms. Tyrimams naudojama SVM metodo regresijos teorija ir sukuriamas regresinis modelis, kuris grindžiamas mažiausių kvadratų atraminių vektorių metodu (Least Squares Support Vector Machine – LS-SVM). Straipsnio autoriai prognozuoja keleivių srautą Hangdžou (Kinija) greitkelyje 2000–2008 m. Gauti rezultatai rodo, kad regresinis LS-SVM modelis yra labai tikslus ir patikimas, todėl gali būti efektyviai taikomas keleivių srautams prognozuoti greitkeliuose. Резюме Метод опорных векторов (Support Vector Machine – SVM) – это набор аналогичных алгоритмов вида «обучение с учителем», использующихся для задач классификации и регрессионного анализа. Метод SVM принадлежит к семейству линейных классификаторов. Основная идея метода SVM заключается в переводе исходных векторов в пространство более высокой размерности и поиске разделяющей гиперплоскости с максимальным зазором в этом пространстве. Алгоритм работает в предположении, что чем больше разница или расстояние между параллельными гиперплоскостями, тем меньше будет средняя ошибка классификатора. В сравнении с другими методами метод SVM более надежен и позволяет решать проблемы с различными условиями. Для исследования был использован метод SVM и регрессионный анализ, затем создана регрессионная модель, основанная на методе опорных векторов с квадратичной функцией потерь (Least Squares Support Vector Machine – LS-SVM). Авторы прогнозировали пассажирский поток на автомагистрали Ханчжоу (Китай) в 2000–2008 гг. Полученные результаты показывают, что регрессионная модель LS-SVM является надежной и может быть применена для прогнозирования пассажирских потоков на других магистралях.

Sirekap is a mobile application that was built to help the public monitor and oversee the development of the 2024 elections held in Indonesia. The research aims to apply the Support Vector Machine algorithm in analyzing sentiment about the use of the Sirekap application in 2024. The Support Vector Machine method is used to classify user sentiment into classes, namely positive, negative, and very negative. The amount of data used is 15,000 data sourced from Sirekap application reviews on Google PlayStore, with more detailed research stages including data collection, data preprocessing, data labeling, visualization, word weighting, and testing and analysis. The results show that the Support Vector Machine algorithm provides an accuracy of 88% for the Sirekap 2024 application. These results are expected to help developers to develop further the Sirekap 2024 application in improving the quality of the application and providing better user comfort Based on the results of the sentiment analysis of Sirekap 2024 application users on the Google Play store using the Support Vector Machine (SVM) method, an accuracy rate of 88% was obtained in classifying the sentiment of reviews into positive, negative, and very negative. This shows that the Support Vector Machine method is quite accurate for sentiment analysis of Indonesian text data. Overall, most reviews are very negative with a percentage reaching 76.9%, followed by negative reviews at 12.6%, and the least are positive reviews at 11%.

In this paper, we develop a low-cost portable spectrometer based on Support Vector Machines (SVM) method. The purpose of the spectrometer development is for halal food research project. The portable spectrometer uses various light-emitting diodes (LEDs), light sensor and Arduino microcontroller. The initial research of the spectrometer is testing various oil, such as palm oil, olive oil, sesame oil, soybean oil, and lard. The waveform analysis of each oil can be distinguished by spectroscopy method. But, by using Support Vector Machines (SVM) method the various oil can be distinguished and classified better. The data measurement, classification, and graphical interface result show on the interface of Raspberry Pi based on Python 2.7. Thus, the spectrometer can be used for lard detection.

Support vector machine (SVM) is a new sort of machine learning method based on Structure Risk Minimization (SRM) principle, which has high generalization capability. Many problems with small samples, nonlinearity or high dimension in pattern recognition could be solved by the method. In this paper, the traffic data on freeway were taken as research objects and an information fusion algorithm based on SVM about freeway incident detection was proposed. A SVM was trained and tested using the data obtained from the simulation under the condition of incident and non-incident. Compared with the multi-layer feed forward neural network (MLF) algorithm trained with the same data, the simulation results showed that the SVM offers a lower misclassification rate, higher correct detection rate and lower false alarm, and it can improve the detection performance.

Industrial big data has created a challenge for data measurement, detection, and processing. This paper shows that support vector machine (SVM) is extremely useful in detecting fault information in modern complex industrial processes. With a pilot plant of Continuous Stirred Tank Heater (CSTH) process, the SVM method with radial basis function (RBF) kernels is tested on the CSTH database and compared with an improved Partial Least Squares (IPLS) and Principal Component Analysis (PCA). The performance of SVM is validated using k-fold cross-validation where the classifier based on SVM outperforms those based on PCA and IPLS. These comparisons show that SVM has remarkable detection performance and satisfying elapsed time. From an industrial point of view, the vitality of SVM algorithm in actual industrial process is discussed.