SV-M/D: Support Vector Machine-Singular Value Decomposition Based Face Recognition

Automatic classification of electrocardiogram (ECG) is importance in cardiac disease diagnosis. Support vector machine (SVM) has drawn more and more attention on pattern recognition, including ECG feature extraction and cardiac disease detection. The most prominent advantage of SVM can be represent as its excellent performance on simplification of inner product operation from high dimensional space to low dimensional space, avoiding calculations in high dimension space. In this study, a multi-classification method is proposed utilizing wavelet multi-resolution analysis (WMRA) and SVM. WMRA is applied to eliminate interference with frequency beyond the frequency interval of ECG signals (0.05∼100Hz). Meanwhile, WMRA provides detail coefficients and approximation coefficients of different decomposition levels, which are the input features fed into SVM for classification. After that, SVM is employed to recognize 6 types of cardiac beats from MIT-BIH arrhythmia database. Besides, different parameters C and γ are discussed and tested. Experimental results indicate that the classification performance gets better as C increases and γ decreases. When C and γ are set to be 1000 and 0.1 respectively, an overall classification accuracy, sensitivity and positive predictivity of 95.23%, 97.42% and 97.71% respectively are achieved.

Bond rating is regarded as an important event for measuring financial risk of companies and for determining the investment returns of investors. As a result, it has been a popular research topic for researchers to predict companies' credit ratings by applying statistical and machine learning techniques. The statistical techniques, including multiple regression, multiple discriminant analysis (MDA), logistic models (LOGIT), and probit analysis, have been traditionally used in bond rating. However, one major drawback is that it should be based on strict assumptions. Such strict assumptions include linearity, normality, independence among predictor variables and pre-existing functional forms relating the criterion variablesand the predictor variables. Those strict assumptions of traditional statistics have limited their application to the real world. Machine learning techniques also used in bond rating prediction models include decision trees (DT), neural networks (NN), and Support Vector Machine (SVM). Especially, SVM is recognized as a new and promising classification and regression analysis method. SVM learns a separating hyperplane that can maximize the margin between two categories. SVM is simple enough to be analyzed mathematical, and leads to high performance in practical applications. SVM implements the structuralrisk minimization principle and searches to minimize an upper bound of the generalization error. In addition, the solution of SVM may be a global optimum and thus, overfitting is unlikely to occur with SVM. In addition, SVM does not require too many data sample for training since it builds prediction models by only using some representative sample near the boundaries called support vectors. A number of experimental researches have indicated that SVM has been successfully applied in a variety of pattern recognition fields. However, there are three major drawbacks that can be potential causes for degrading SVM's performance. First, SVM is originally proposed for solving binary-class classification problems. Methods for combining SVMs for multi-class classification such as One-Against-One, One-Against-All have been proposed, but they do not improve the performance in multi-class classification problem as much as SVM for binary-class classification. Second, approximation algorithms (e.g. decomposition methods, sequential minimal optimization algorithm) could be used for effective multi-class computation to reduce computation time, but it could deteriorate classification performance. Third, the difficulty in multi-class prediction problems is in data imbalance problem that can occur when the number of instances in one class greatly outnumbers the number of instances in the other class. Such data sets often cause a default classifier to be built due to skewed boundary and thus the reduction in the classification accuracy of such a classifier. SVM ensemble learning is one of machine learning methods to cope with the above drawbacks. Ensemble learning is a method for improving the performance of classification and prediction algorithms. AdaBoost is one of the widely used ensemble learning techniques. It constructs a composite classifier by sequentially training classifiers while increasing weight on the misclassified observations through iterations. The observations that are incorrectly predicted by previous classifiers are chosen more often than examples that are correctly predicted. Thus Boosting attempts to produce new classifiers that are better able to predict examples for which the current ensemble's performance is poor. In this way, it can reinforce the training of the misclassified observations of the minority class. This paper proposes a multiclass Geometric Mean-based Boosting (MGM-Boost) to resolve multiclass prediction problem. Since MGM-Boost introduces the notion of geometric mean into AdaBoost, it can perform learning process considering the geometric mean-based accuracy and errors of multiclass. This study applies MGM-Boost to the real-world bond rating case for Korean companies to examine the feasibility of MGM-Boost. 10-fold cross validations for threetimes with different random seeds are performed in order to ensure that the comparison among three different classifiers does not happen by chance. For each of 10-fold cross validation, the entire data set is first partitioned into tenequal-sized sets, and then each set is in turn used as the test set while the classifier trains on the other nine sets. That is, cross-validated folds have been tested independently of each algorithm. Through these steps, we have obtained the results for classifiers on each of the 30 experiments. In the comparison of arithmetic mean-based prediction accuracy between individual classifiers, MGM-Boost (52.95%) shows higher prediction accuracy than both AdaBoost (51.69%) and SVM (49.47%). MGM-Boost (28.12%) also shows the higher prediction accuracy than AdaBoost (24.65%) and SVM (15.42%)in terms of geometric mean-based prediction accuracy. T-test is used to examine whether the performance of each classifiers for 30 folds is significantly different. The results indicate that performance of MGM-Boost is significantly different from AdaBoost and SVM classifiers at 1% level. These results mean that MGM-Boost can provide robust and stable solutions to multi-classproblems such as bond rating.

The inclusion in workplaces of video display terminals has brought multiple benefits for the organization of work. Nevertheless, it also implies a series of risks for the health of the workers, since it can cause ocular and visual disorders, among others. In this research, a group of eye and vision-related problems associated with prolonged computer use (known as computer vision syndrome) are studied. The aim is to select the characteristics of the subject that are most relevant for the occurrence of this syndrome, and then, to develop a classification model for its prediction. The estimate of this problem is made by means of support vector machines for classification. This machine learning technique will be trained with the support of a genetic algorithm. This provides the training of the support vector machine with different patterns of parameters, improving its performance. The model performance is verified in terms of the area under the ROC curve, which leads to a model with high accuracy in the classification of the syndrome.

Smoothing methods, extensively used for solving important mathematical programming problems and applications, are applied here to generate and solve an unconstrained smooth reformulation of the support vector machine for pattern classification using a completely arbitrary kernel. We term such reformulation a smooth support vector machine (SSVM). A fast Newton–Armijo algorithm for solving the SSVM converges globally and quadratically. Numerical results and comparisons are given to demonstrate the effectiveness and speed of the algorithm. On six publicly available datasets, tenfold cross validation correctness of SSVM was the highest compared with four other methods as well as the fastest. On larger problems, SSVM was comparable or faster than SVMlight (T. Joachims, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999), SOR (O.L. Mangasarian and David R. Musicant, IEEE Transactions on Neural Networks, vol. 10, pp. 1032–1037, 1999) and SMO (J. Platt, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999). SSVM can also generate a highly nonlinear separating surface such as a checkerboard.

Deep convolutional cross-connected kernel mapping support vector machine based on SelectDropout

This paper presents a novel method for face recognition. First, we generate the new image representation from the decorrelated hybrid color configurations rather than RGB color space via a learning algorithm. The learning algorithm, Principal Component Analysis (PCA) plus Fisher Linear Discriminant analysis (FLD), is able to derive the desired color transformation to generate a discriminating image representation that is optimal for face recognition. Second, we partition face image into some small patches, each of which can obtain its own color transformation, to reduce the effect of illumination variations. Thus, a patch-based novel image representation method is proposed for face recognition. Experiments on the Face Recognition Grand Challenge (FRGC) version 2 Experiment 4 show that the proposed method outperforms gray-scale image and some recent methods in face recognition.

Support vector machine for classification based on fuzzy training data

Vibration signal and shaft orbit are important features that reflect the operating state of rotating machinery. Fault diagnosis and feature extraction are critical to ensure the safety and reliable operation of rotating machinery. A novel method of fault diagnosis based on convolutional neural network (CNN), discrete wavelet transform (DWT), and singular value decomposition (SVD) is proposed in this paper. CNN is used to extract features of shaft orbit images, DWT is used to transform the denoised swing signal of rotating machinery, and the wavelet decomposition coefficients of each branch of the signal are obtained by the transformation. The SVD input matrix is formed after single branch reconstruction of the different branch coefficients, and the singular value is extracted to obtain the feature vector. The features extracted from both methods are combined and then classified by support vector machines (SVMs). The comparison results show that this hybrid method has a higher recognition rate than other methods.

Finger-vein recognition, a new and advanced biometrics recognition method, is attracting the attention of researchers because of its advantages such as high recognition performance and lesser likelihood of theft and inaccuracies occurring on account of skin condition defects. However, as reported by previous researchers, it is possible to attack a finger-vein recognition system by using presentation attack (fake) finger-vein images. As a result, spoof detection, named as presentation attack detection (PAD), is necessary in such recognition systems. Previous attempts to establish PAD methods primarily focused on designing feature extractors by hand (handcrafted feature extractor) based on the observations of the researchers about the difference between real (live) and presentation attack finger-vein images. Therefore, the detection performance was limited. Recently, the deep learning framework has been successfully applied in computer vision and delivered superior results compared to traditional handcrafted methods on various computer vision applications such as image-based face recognition, gender recognition and image classification. In this paper, we propose a PAD method for near-infrared (NIR) camera-based finger-vein recognition system using convolutional neural network (CNN) to enhance the detection ability of previous handcrafted methods. Using the CNN method, we can derive a more suitable feature extractor for PAD than the other handcrafted methods using a training procedure. We further process the extracted image features to enhance the presentation attack finger-vein image detection ability of the CNN method using principal component analysis method (PCA) for dimensionality reduction of feature space and support vector machine (SVM) for classification. Through extensive experimental results, we confirm that our proposed method is adequate for presentation attack finger-vein image detection and it can deliver superior detection results compared to CNN-based methods and other previous handcrafted methods.

Text classification which is an integral part of text mining has caught much attention in various industries and fields recently. The ability is in assigning text documents to one or more pre-defined categories based on content similarity. While most of application of text classification focuses on document level, question classification works at much granular level such as sentence and phrase. There have been numerous studies on question classification in accordance to Bloom taxonomy in assessments to measure cognitive level of learners in higher learning institutions. But it has not been effective yet to resolve overlapping issue of Bloom taxonomy verb keywords being assigned to more than one category of Bloom taxonomy. The presence of this poses a problem in respect of classifying a particular question into a right category of Bloom taxonomy. And feature extraction plays an important role in improving the accuracy of classifier such as Support Vector Machine in question classification. Much of the past related research work focus on feature extraction methods such as bag of word (BOW) and syntactic analysis to classify questions and to address the issue, an improvement in feature extraction is needed. In view of this, this study proposes an integrated approach in feature extraction involving semantic aspect in classifying questions in accordance to Bloom taxonomy. Support Vector Machine classifier is used as it is well known for its high accuracy in text classification. With all this in place, an improved accuracy in classifying questions in accordance to Bloom taxonomy can be expected.

Classification of broad area features in satellite imagery is one of the most important applications of remote sensing. It is often difficult and time-consuming to develop classifiers by hand, so many researchers have turned to techniques from the fields of statistics and machine learning to automatically generate classifiers. Common techniques include Maximum Likelihood classifiers, neural networks and genetic algorithms. We present a new system called Afreet, which uses a recently developed machine learning paradigm called Support Vector Machines (SVMs). In contrast to other techniques, SVMs offer a solid mathematical foundation that provides a probabalistic guarantee on how well the classifier will generalize to unseen data. In addition the SVM training algorithm is guaranteed to converge to the globally optimal SVM classifier, can learn highly non-linear discrimination functions, copes extremely well with high-dimensional feature spaces (such as hyperspectral data), and scales well to large problem sizes. Afreet combines an SVM with a sophisticated spatio-spectral feature construction mechanism that allows it to classify spectrally ambiguous pixels. We demonstrate the effectiveness of the system by applying Afreet to several broad area classification problems in remote sensing, and provide a comparison with conventional Maximum Likelihood classification.

PurposeThe purpose of this paper is to present a novel model for inhabitant prediction in smart houses based on daily life activities. It uses data provided by non intrusive sensors and devices to predict the house occupant. The authors' model, named Behavior Classification Model (BCM), applies Support Vector Machines (SVM) classifier to learn the users' habits when they perform activities, and then predicts the user. BCM was tested using real data and compared with a frequency based approach. In this paper the authors present also their approach to improve the accuracy of BCM using SVM feature selection algorithm.Design/methodology/approachThe model, named Behavior Classification Model (BCM), applies Support Vector Machines (SVM) classifier to learn the users' habits when they perform activities, and then predicts the user.FindingsBCM was tested using real data and compared with a frequency based approach. In this paper the authors' also present their approach to improve the accuracy of BCM using SVM feature selection algorithm.Originality/valueThe paper is based on blind user recognition in smart homes.

Mandau is a sharp weapon like a machete that comes from the culture of the Dayak tribe in Kalimantan. Mandau itself has many types of carvings with different motifs in each typical Dayak tribe. The diversity of Dayak clumps and sub-tribes produces various types of Mandau, which are similar. Most Indonesians cannot distinguish between the existing variety of Mandau because of the information lack about Mandau. The study aims to identify Mandau types by applying Support Vector Machine (SVM) methods according to shape and texture feature extraction of image Mandau. Process of feature extraction using eccentricity, metric, contrast, correlation, energy, and homogeneity parameters. Six parameters obtained from the image feature extraction were used for the classification process. There are four kind of Mandau that used, such as Mandau Benuaq, Mandau Kenyah, Mandau Mahah, and Mandau Tunjung, with each Mandau 24 images, and the total data is 96. The implementation of the SVM method in identifying the type of Mandau using Linear Kernel, Gaussian / RBF Kernel, and Polynomial Kernel. The results indicated that when SVMs were used to identify Mandau images in split data, 80% of the training and 20% of the test data had the highest average accuracy of 82%. Based on the type of Kernel at 80:20 data split, the identification of the Mandau image using the Polynomial Kernel has the highest accuracy rate of 95%.

Support Vector Machine (SVM) is a machine learning algorithm based on the Statistical Learning Theory (SLT), which can get good classification effects with a few learning samples. SVM represents a new approach to pattern classification and has been shown to be particularly successful in many fields such as image identification and face recognition. It also provides us with a new method to develop intelligent fault diagnosis. This paper presents an SVM based approach for fault diagnosis of rolling bearings. Experimentation with vibration signals of bearing was conducted. The vibration signals acquired from the bearings were directly used in the calculating without the preprocessing of extracting its features. Compared with the Artificial Neural Network (ANN) based method, the SVM based method has desirable advantages. Also a multi-fault SVM classifier based on binary clas- sifier is constructed for gear faults in this paper. Other experiments with gear fault samples showed that the multi-fault SVM classifier has good classification ability and high efficiency in mechanical system. It is suitable for on line diagnosis for mechanical system.

In the standard support vector machines for classification, training sets with uneven class sizes results in classification biases towards the class with the large training size. That is to say, the larger the training sample size for one class is, the smaller its corresponding classification error rate is, while the smaller the sample size, the larger the classification error rate. The main causes lie in that the penalty of misclassification for each training sample is considered equally. Weighted support vector machines for classification are proposed in this paper where penalty of misclassification for each training sample is different. By setting the equal penalty for the training samples belonging to same class, and setting the ratio of penalties for different classes to the inverse ratio of the training class sizes, the obtained weighted support vector machines compensate for the undesirable effects caused by the uneven training class size, and the classification accuracy for the class with small training size is improved. Experimental simulations on breast cancer diagnosis show the effectiveness of the proposed methods.