Adaptive Incremental Learning with an Ensemble of Support Vector Machines

In this paper we propose a system for visual object detection and tracking based on the extended structural tensor and the ensemble of one-class support vector machines. First, the input color image is transformed with the anisotropic process into the extended structural tensor. Then the tensor space is clustered into the number of partitions which are used to train a corresponding number of one-class support vector machines composing an ensemble of classifiers. In run-time the ensemble classifies the input video stream into an object and background. Thanks to high discriminative properties of the extended structural tensor and to the diversity of the ensemble of classifiers the method shows very good properties which were shown by experiments on real video sequences.

Online dynamic security assessment of wind integrated power system using SDAE with SVM ensemble boosting learner

In order to develop Human-centric Driver Fatigue Monitoring Systems (HDFMS) with aims to increase driving safety, an efficient combined features extraction from Curvelet transform and Gabor wavelet transform for fatigue expressions descriptions of vehicle drivers is proposed, and Random Subspace Ensemble (RSE) of Support Vector Machines (SVMs) with polynomial kernel as the base classifier is then exploited for classification of three predefined fatigue expressions classes, namely, awake expressions, moderate fatigue expressions, and severe fatigue expressions. The results of holdout and cross-validation experiments show that CF by RSE of SVMs with polynomial kernel outperforms other seven classifiers, i.e., Curvelet features by SVMs classifier, Gabor features by SVMs classifier, CF by five individual SVMs classifiers. With CF and RSE of SVMs with polynomial kernel, the classification accuracies of drivers' fatigue expressions are over 90% in both of the holdout and cross-validation experiments, which show the proposed approach of combined features extraction and RSE of SVMs can be used for developing Human-centric Driver Fatigue Monitoring Systems to increase driving safety.

Fine-grained classification is a recognition task where subtle differences distinguish between different classes. To tackle this classification problem, part-based classification methods are mostly used. Partbased methods learn an algorithm to detect parts of the observed object and extract local part features for the detected part regions. In this paper we show that not all extracted part features are always useful for the classification. Furthermore, given a part selection algorithm that actively selects parts for the classification we estimate the upper bound for the fine-grained recognition performance. This upper bound lies way above the current state-of-the-art recognition performances which shows the need for such an active part selection method. Though we do not present such an active part selection algorithm in this work, we propose a novel method that is required by active part selection and enables sequential part-based classification. This method uses a support vector machine (SVM) ensemble and allows to classify an image based on arbitrary number of part features. Additionally, the training time of our method does not increase with the amount of possible part features. This fact allows to extend the SVM ensemble with an active part selection component that operates on a large amount of part feature proposals without suffering from increasing training time.

In this paper, the algorithm design of the support vector machines (SVMs) ensemble in a practical multi-stage framework is analyzed which can be implemented efficiently by evolutionary multi-objective optimization algorithm. The designing of SVMs ensemble is considered in three stages: first, the bootstrap method and a strategy of dynamical parameter range adjustment are used to generate more diverse base SVMs, and the NSGA-II algorithm which can efficiently tune the parameters of SVMs is applied to ensure the accuracy of base SVMs; Second, the NSGA-II algorithm is used again to select the member of ensemble based on the accuracy and diversity of the ensemble we have measured; Last, the reliability of different class is computed and combined to decide the outputs of ensemble in terms of the decision values of base SVMs. The proposed algorithm is applied to the UCI datasets, some useful results has been concluded for the future work in this field.

The rapid spread of information via social media has made text-based fake news detection critically important due to its societal impact.This paper presents a novel detection method called Dynamic Representation and Ensemble Selection (DRES) for identifying fake news based solely on text.DRES leverages instance hardness measures to estimate the classification difficulty for each news article across multiple textual feature representations.By dynamically selecting the textual representation and the most competent ensemble of classifiers for each instance, DRES significantly enhances prediction accuracy.Extensive experiments show that DRES achieves notable improvements over state-of-the-art methods, confirming the effectiveness of representation selection based on instance hardness and dynamic ensemble selection in boosting performance.Codes and data are available at:

Disorders of consciousness (DoC) happen frequently in various brain injuries. Their detection helps timely treatment for better survival outcomes of DoC patients. It is conventionally undertaken via clinical examinations, typically behavioural assessments. However, these neurological examinations consume significant resources of manpower and time, making continuous DoC monitoring practically infeasible. To address this issue, a computer-aided approach is proposed in this article for automated DoC detection through extracting knowledge from electroencephalogram (EEG) signals. It introduces a new connectivity measure: Power Spectral Density Difference (PSDD) incorporating with a recursive Cosine function (CPSDD). Then, the approach classifies brain-injured patients into DoC (i.e., positive) and wakefulness (i.e., negative) classes through an ensemble of support vector machines (EOSVM), which is a type of machine-learning methods. It is further applied to a dataset of 607 patients with brain injuries. Our classification results show that the EOSVM classifier with the new connectivity measure CPSDD has achieved the best classification performance among 12 connectivity measures. For a setting of 97% majority voting from all SVMs, the EOSVM has diagnosed, in high confidence, 35% of patients with the accuracy, sensitivity, and specificity of 98.21%, 100%, and 95.79%, respectively. Thus, the classifier EOSVM incorporating with the new connectivity measure CPSDD is a promising tool for automatic detection of DoC in brain injuries.

Decision making by individuals and its relation to rationality is an important area of research because it allows individuals to make effective decisions. Decision making in groups is when individuals come together and make decisions in whatever manner that is feasible. Governments, organizations and companies are involved in group decision making. This chapter studies the concept of group decision making and how artificial intelligence is used to facilitate decision making in a group. Four group based decision making techniques are considered and these are ensemble of support vector machines which are applied to land cover mapping, incremental learning using genetic algorithm which is applied to optical character recognition, dynamically weighted mixtures of experts which are applied to platinum price prediction as well as Learn++ which is applied to wine recognition.

Modeling radiation-induced lung injury risk with an ensemble of support vector machines

Cancer recognition with bagged ensembles of support vector machines

Support Vector Machines (SVMs) ensembles have been widely used to improve classification accuracy in complicated pattern recognition tasks. In this work we propose to apply an ensemble of SVMs coupled with feature-subset selection methods to aleviate the curse of dimensionality associated with expression-based classification of DNA microarray data. We compare the single SVM classifier to SVM ensembles applying two different feature-subset selection techniques, namely random selection and k-means clustering, the base classifiers are combined using either majority vote or SVM fusion. Two real-world benchmarks datasets are used to evaluate and compare the performance. Experimental results show that the SVM ensemble of SVM base classifiers using k-means clustering for feature-subset selection and employing an SVM combiner achieve the best classification accuracy, and that feature-subset-selection methods can have considerable impact on the classification accuracy.

Analysis problems of ensemble SVM, such as. Larger scale of the training subsets, strong randomicity and high complexity(time and space), a new ensemble SVM based on RPCL clustering is putted forward. Above of all, the samples are clustered into several clusters according to their distribution with RPCL. Then a small quantity of representative instances is chosen as training sets and training SVM that adopt self-perturbation in population convergence speed. Finally Ensemble Improvement SVM is constructed by relative majority voting. We use complex targets that captured “Man-Car” data from video data and standard benchmark data to test C_PSOSVM. Experiment result illustrate that the algorithm can improve ensemble SVM classification precision and reduce time and space complexity comparing to Bagging, Adaboost.Esp complex targets, C_PSOSVM algorithm classification accuracy can reach 91.24%.KeywordsSupport Vector MachineRPCLEnsemble SVM

Bayesian network utilizes graphical model to describe dependencies among variables in probabilistic way, it is one of the most important model for uncertainty processing in Artificial Intelligence. Incremental learning of Bayesian networks has been received more attentions in recent years, in this paper a novel method is proposed to learn Bayesian network from incremental data. In this method, a novel incremental scoring function is designed to adaptively adjust the tendency of matching new and old data in the process of incremental learning. We propose an improved adaptive incremental structure learning algorithm for Bayesian network. Theoretical analysis and experimental results both demonstrate the proposed method outperforms other state-of-the-art methods.

The shapes and sounds of isolated motor unit action potentials (MUAPs) in an electromyographic (EMG) signal provide a significant source of information for diagnosis, treatment and management of neuromuscular disorders. These parameters can be analyzed qualitatively by an expert or quantitatively by using pattern recognition techniques. Due to the advantages of quantitative EMG method, developing robust automated MUAP classifiers have been explored and several systems have been developed for this purpose by now, but the accuracy of the existing methods is not high enough to be used in clinical environments. In this paper, a novel classification strategy based on ensemble of support vector machines (SVMs) classifiers in hybrid serial/parallel architecture is proposed to determine the class label (myopathic, neuropathic, or normal) for a given MUAP. The developed system employs both time domain and time-frequency domain features of the MUAPs extracted from an EMG signal using an EMG signal decomposition system. Different classification strategies including single classifier and multiple classifiers with several subsets of features were investigated. Experimental results using a set of real EMG signals showed robust performance of multi-classifier methods proposed here. Of the methods studied, the multi-classifier that uses multiple features sets and a combination of both trainable and nontrainable fusion techniques to aggregate base classifiers showed the best performance with average accuracy of 97% which is significantly higher than the average accuracy of single SVM-based classifier system (i.e., 88%).

The nodules and the multiple times larger non-nodules of the regions of interested(ROIs) in lung areas are achieved, that would lead to a serious imbalance on the sample data. Many scholars have proposed some algorithms to solve this problem. In this paper, in order to guarantee that there is no correlation among the extracted characteristics, the PCA method is adopted to optimize and reduce dimensions, and then the modified support vector machine(SVM) classifiers using the sequential minimal optimization(SMO) algorithm and the grid research method are proposed to improve the computing efficiency. Furthermore, the abundant lung CT images from the hospital partnership could confirm the experimental results. We compare the classification performance between the ensemble SVM(ESVM) classifier and the cost-sensitive SVM(CSVM) classifier to deal with this problem. Experimental results show the performance of the CSVM classifier based on grid search is satisfactory than the ESVM.