A subspace approach to face detection with support vector machines

A boosted SVM classifier trained by incremental learning and decremental unlearning approach

We propose a novel privacy-preserving support vector machine (SVM) classifier for a data matrixAwhose input feature columns are divided into groups belonging to different entities. Each entity is unwilling to share its group of columns or make it public. Our classifier is based on the concept of a reduced kernelK(A,B′), whereB′ is the transpose of a random matrixB. The column blocks ofBcorresponding to the different entities are privately generated by each entity and never made public. The proposed linear or nonlinear SVM classifier, which is public but does not reveal any of the privately held data, has accuracy comparable to that of an ordinary SVM classifier that uses the entire set of input features directly.

Introduction: In recent decades, the growing rate of cancer incidence is a big concern for most societies. Due to the genetic origins of cancer disease, its internal structure is necessary for the study of this disease. Methods: In this research, cancer data are analyzed based on DNA sequences. The transition probability of occurring two pairs of nucleotides in DNA sequences has Markovian property. This property inspires the idea of feature dimension reduction of DNA sequence for overcoming the high computational overhead of genes analysis. This idea is utilized in this research based on the Markovian property of DNA sequences. This mapping decreases feature dimensions and conserves basic properties for discrimination of cancerous and non-cancerous genes. Results: The results showed that a non-linear support vector machine (SVM) classifier with RBF and polynomial kernel functions can discriminate selected cancerous samples from non-cancerous ones. Experimental results based on the 10-fold cross-validation and accuracy metrics verified that the proposed method has low computational overhead and high accuracy. Conclusion: The proposed algorithm was successfully tested on related research case studies. In general, a combination of proposed Markovian-based feature reduction and non-linear SVM classifier can be considered as one of the best methods for discrimination of cancerous and non-cancerous genes.

The focus is made to develop predictor models for wind speed prediction employing the support vector machine neural models. Basically, support vector machines (SVM) is employed as classifiers, but this contribution models variant of SVM to act as predictors. A developed model of linear support vector machine (LSVM) and proximal support vector machine (PSVM) is proposed to carry out the wind speed prediction using the available real time wind farm data. In developed PSVM predictor, it is modeled for both linear PSVM predictor and non-linear PSVM predictor. The difference between the developed linear and non-linear PSVM predictor models lies in their applicability of kernel functions to perform effective wind speed prediction. The prediction application is implemented for the set of wind farm data with a wind mill height of 50 m in a manner to minimize the mean square error. The training process of the neural network algorithmic flow is done with the developed LSVM, L-PSVM (Linear PSVM) and N-PSVM (nonlinear PSVM) for predicting the wind speed in renewable energy systems. Results computed are compared with the other types of predictors to prove the effectiveness of the proposed variants of SVM predictors. The simulated results presents the effectiveness of the proposed predictors for the real time wind farm data and the applicability of the predictors for the considered datasets.

Abstract: A significant challenge in women’s health is posed by Polycystic Ovary Syndrome (PCOS) because it is a difficult disorder to comprehend and exhibits various symptoms. Thisresearch project suggests the creation of a computerized prediction scheme for PCOS using machine learning algorithms and bioinformatics tools. The aim of this system is to give personalized risk assessment to women thus enabling early detection, and proactive management of PCOS. It combines other intelligible probabilities about PCOS with the use of user provided health data with Machine Learning models such as Random Forest, Logistic Regression, Support Vector Machine, Naive Bayes, Radial SVM, Linear SVM and KNeighbours Classifier. Additionally, it provides intuitive predictions regarding PCOS likelihood through ML models, which are based on Random Forest, Logistic Regression, Support Vector Machine (SVM), Naive Bayes (NB), Radial SVM (RSVM), Linear SVM (LSVM) and KNeighbours Classifier (KNC). By way of thorough assessment as well as comparison within these models the system intends to improve precision together with reliability during prediction of PCOS. The major objective is therefore to enable timely intervention along with individualized healthcare strategies that will promote better health outcomes for all women.

Feature selection is an important combinatorial optimisation problem in the context of supervised pattern classification. This paper presents four novel continuous feature selection approaches directly minimising the classifier performance. In particular, we include linear and nonlinear Support Vector Machine classifiers. The key ideas of our approaches are additional regularisation and embedded nonlinear feature selection. To solve our optimisation problems, we apply difference of convex functions programming which is a general framework for non-convex continuous optimisation. Experiments with artificial data and with various real-world problems including organ classification in computed tomography scans demonstrate that our methods accomplish the desired feature selection and classification performance simultaneously.

Hardware implementation of human detection is a challenging task for embedded designs. This paper presents a real-time image-based field-programmable gate array (FPGA) implementation of human detection. Our implementation is based on the histograms of oriented gradients (HOG) feature and linear support vector machine (SVM) classifier. The novelty of this work is that we replace normalization process of HOG with a modified binarization process. Therefore, during classification process with SVM classifier, all multiplication operations are replaced by addition operations. All these modifications result in reduction of hardware resource. Experimental evaluation reveals that 293 fps can be achieved on a low-end Xilinx Spartan-3e FPGA. Moreover, a detection accuracy of 1.97% miss rate and 1% false positive rate is achieved. For further demonstration, a prototype system is developed with an OV7670 camera device. Restricted to the speed of camera, a detection rate of 30 fps is achieved.

The combination of Brain-Computer Interface (BCI) technology, allowing online monitoring and decoding of brain activity, with virtual and mixed reality (MR) systems may help to shape and guide implicit and explicit learning using ecological scenarios. Real-time information of ongoing brain states acquired through BCI might be exploited for controlling data presentation in virtual environments. Brain states discrimination during mixed reality experience is thus critical for adapting specific data features to contingent brain activity. In this study we recorded electroencephalographic (EEG) data while participants experienced MR scenarios implemented through the eXperience Induction Machine (XIM). The XIM is a novel framework modeling the integration of a sensing system that evaluates and measures physiological and psychological states with a number of actuators and effectors that coherently reacts to the user's actions. We then assessed continuous EEG-based discrimination of spatial navigation, reading and calculation performed in MR, using linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. Dynamic single trial classification showed high accuracy of LDA and SVM classifiers in detecting multiple brain states as well as in differentiating between high and low mental workload, using a 5 s time-window shifting every 200 ms. Our results indicate overall better performance of LDA with respect to SVM and suggest applicability of our approach in a BCI-controlled MR scenario. Ultimately, successful prediction of brain states might be used to drive adaptation of data representation in order to boost information processing in MR.

Deep learning models have recently been proven to be successful in various natural language processing tasks, including sentiment analysis. Conventionally, a deep learning model’s architecture includes a feature extraction layer followed by a fully connected layer used to train the model parameters and classification task. In this paper, we employ a deep learning model with modified architecture that combines Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (Bi-LSTM) for feature extraction, with Support Vector Machine (SVM) for Arabic sentiment classification. In particular, we use a linear SVM classifier that utilizes the embedded vectors obtained from CNN and Bi-LSTM for polarity classification of Arabic reviews. The proposed method was tested on three publicly available datasets. The results show that the method achieved superior performance than the two baseline algorithms of CNN and SVM in all datasets.

Electroencephalogram (EEG) comprises valuable details related to the different physiological state of the brain. In this paper, a framework is offered for detecting the epileptic seizures from EEG data recorded from normal subjects and epileptic patients. This framework is based on a discrete wavelet transform (DWT) analysis of EEG signals using linear and nonlinear classifiers. The performance of the different combinations of two-class epilepsy detection is studied using Support Vector Machine (SVM) and neural network analysis (NNA) classifiers for the derived statistical features from DWT. In this new approach first parse EEG signals to sub-bands in different categories with the help of discrete wavelet transform (DWT) and then we derive statistical features such as Mean, Median, Standard Deviation, Kurtosis, Entropy, Skewness for each sub-band. These features, extracted from details and approximation coefficients of DWT sub-bands, are used as input to Principal Component Analysis (PCA). The classification is based on reducing the feature dimension using PCA and deriving the Support Vector Machine (SVM) and neural network analysis (NNA). In classification of normal and epileptic, results obtained exhibited an accuracy of 100% by applying NNA and 99% by SVM it has been found that the computation time of NNA classifier is lesser than SVM to provide 100% accuracy.

Introduction/Background*The most important prognostic factor for the survival of advanced-stage ovarian cancer is the completeness of cytoreductive surgery (CRS). Therefore, an intraoperative technique to detect microscopic tumours would be of...

The problem with development of the support vector machine (SVM) classifiers using modified particle swarm optimization (PSO) algorithm and their ensembles has been considered. Solving this problem would allow fulfilling the high-precision data classification, especially Big Data classification, with the acceptable time expenditures. The modified PSO algorithm conducts a simultaneous search of the type of kernel functions, the parameters of the kernel function and the value of the regularization parameter for the SVM classifier. The idea of particles' «regeneration» served as the basis for the modified PSO algorithm. In the implementation of this algorithm, some particles change the type of their kernel function to the one which corresponds to the particle with the best value of the classification accuracy. The offered PSO algorithm allows reducing the time expenditures for the developed SVM classifiers, which is very important for Big Data classification problem. In most cases such SVM classifier provides the high quality of data classification. In exceptional cases the SVM ensembles based on the decorrelation maximization algorithm for the different strategies of the decision-making on the data classification and the majority vote rule can be used. Also, the two-level SVM classifier has been offered. This classifier works as the group of the SVM classifiers at the first level and as the SVM classifier on the base of the modified PSO algorithm at the second level. The results of experimental studies confirm the efficiency of the offered approaches for Big Data classification.

This paper develops an approach aiming to identify a pattern defined by malignant dermoscopic skin lesions presented as lesion feature vectors (LFVs) in a 4D Riemannian manifold. The manifold consists of all 4-tuples and its metric is defined on the basis of the Total Dermoscopy Score (TDS) formula used in the ABCD diagnosis rule. Tools in Riemannian geometry including distance functions, directional angles, polar, cylindrical and spherical coordinates are used to study the geometric structures of a sample space defined by malignant 4D LFVs. To explore the geometric structures and the distribution pattern of the malignant LFVs, we find methods to visualize the objects in a 4D manifold by projecting them onto a 2D or 3D space via polar, generalized cylindrical and spherical coordinates. To observe malignancy identification structures in the newly constructed manifold a data-set of 70 lesion images with a ground truth were used to generate LFVs. To build a surface separating the benign and malignant LFVs a linear TDS-based and a non-linear support vector machine (SVM) classifiers were applied. The SVM is build with a polynomial kernel, whose degree and parameters were suggested by a geometric structure observed in a 3D space. A statistical comparison, on the base of experimental results, showed that the polynomial SVM has a better f-measure accuracy than the linear TDS based one.KeywordsSkin lesion classificationRiemannian manifoldSupport vector machines (SVM)

Enhancing color image retrieval performance with feature fusion and non-linear support vector machine classifier

The results of directly comparing the prediction accuracy of optimized 3D Quantitative Structure-Activity Relationship (3D-QSAR) models and linear Support Vector Machine (SVM) classifiers to identify small molecule inhibitors of the BRAF-V600E and HIV Integrase targets are reported. Performance comparisons were carried out using 303 compounds (68 active) against BRAF-V600E and 204 compounds (159 active) against HIV Integrase. A SVM prediction accuracy of 95% (BRAF-V600E) and 100% (HIV Integrase) and 3D-QSAR prediction accuracy of 76% (BRAFV600E) and 82% (HIV Integrase) was observed. To help explain the better performance of SVM in the comparison reported here and to help assess the degree to which a SVM or 3D-QSAR model is likely to perform best for other targetligands of interest a new EPP (Expected Predictive Performance) metric is introduced. How EPP can be used to help predict future performance of SVM and 3D-QSAR models by quantifying the degree of similarity between candidate compounds and training data is also demonstrated. Results show that the EPP metric is capable of predicting future prediction accuracy of SVM and 3D-QSAr models within 7% of actual performance.