Robust command recognition using kernel learning algorithms

Flooding causes several threats with outcomes which include peril to human and animal life, damage to property, and adversity to agricultural fields. Therefore, flood prediction is of prime importance for reducing loss of life and devastation to property. To model complex nature of hydrologic processes artificial neural network (ANN) tool is effectively being utilized for modelling different nonlinear relationships, and has proved to be an appropriate method for flood prediction. Present study investigated relative accuracy of radial basis function neural network (RBFNN) and support vector machine (SVM) models combined with Firefly Algorithm (FA) in predicting river flood discharge and contrasted with that of regular ANN, RBFNN and SVM models. Monthly river flow data of Silchar and Dholai stations located in Cachar district of Assam, India are utilized for the present study. For assessing model performance, coefficient of determination (R2), mean square error (MSE) and root mean square error (RMSE) were measured. Evaluation of outcomes shows that both RBF-FA (radial basis function - firefly algorithm) and SVM-FA (support vector machine - firefly algorithm) hybrid models give more precise forecasting results than RBFNN, FFBPNN (feed forward back propagation neural network) and SVM models. Yet, it can be observed that SVM-FA model give better forecasting outputs with R2 value 0.9818 than RBF-FA model. Results also reveal that simple SVM model performs marginally better than simple ANN model.

The aim of this paper is twofold. First, we present a thorough experimental study to show the superiority of the generalization capability of the support vector machine (SVM) approach in the automatic classification of electrocardiogram (ECG) beats. Second, we propose a novel classification system based on particle swarm optimization (PSO) to improve the generalization performance of the SVM classifier. For this purpose, we have optimized the SVM classifier design by searching for the best value of the parameters that tune its discriminant function, and upstream by looking for the best subset of features that feed the classifier. The experiments were conducted on the basis of ECG data from the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database to classify five kinds of abnormal waveforms and normal beats. In particular, they were organized so as to test the sensitivity of the SVM classifier and that of two reference classifiers used for comparison, i.e., the k-nearest neighbor (kNN) classifier and the radial basis function (RBF) neural network classifier, with respect to the curse of dimensionality and the number of available training beats. The obtained results clearly confirm the superiority of the SVM approach as compared to traditional classifiers, and suggest that further substantial improvements in terms of classification accuracy can be achieved by the proposed PSO-SVM classification system. On an average, over three experiments making use of a different total number of training beats (250, 500, and 750, respectively), the PSO-SVM yielded an overall accuracy of 89.72% on 40438 test beats selected from 20 patient records against 85.98%, 83.70%, and 82.34% for the SVM, the kNN, and the RBF classifiers, respectively.

In this paper, a new approach for pedestrian detection is presented. We design an ensemble of classifiers that employ different feature representation schemes of the pedestrian images: Laplacian EigenMaps, Gabor filters, and invariant local binary patterns. Each ensemble is obtained by varying the patterns used to train the classifiers and extracting from each image two feature vectors for each feature extraction method: one for the upper part of the image and one for the lower part of the image. A different radial basis function support vector machine (SVM) classifier is trained using each feature vector; finally, these classifiers are combined by the ldquosum rule.rdquo Experiments are performed on a large data set consisting of 4000 pedestrian and more than 25 000 nonpedestrian images captured in outdoor urban environments. Experimental results confirm that the different feature representations give complementary information, which has been exploited by fusion rules, and we have shown that our method outperforms the state-of-the-art approaches among pedestrian detectors.

Classification of DNA microarrays using artificial neural networks and ABC algorithm

We identify canopy species in a Hawaiian tropical forest using supervised classification applied to airborne hyperspectral imagery acquired with the Carnegie Airborne Observatory-Alpha system. Nonparametric methods (linear and radial basis function support vector machine, artificial neural network, and k-nearest neighbor) and parametric methods (linear, quadratic, and regularized discriminant analysis) are compared for a range of species richness values and training sample sizes. We find a clear advantage in using regularized discriminant analysis, linear discriminant analysis, and support vector machines. No unique optimal classifier was found for all conditions tested, but we highlight the possibility of improving support vector machine classification with a better optimization of its free parameters. We also confirm that a combination of spectral and spatial information increases accuracy of species classification: we combine segmentation and species classification from regularized discriminant analysis to produce a map of the 17 discriminated species. Finally, we compare different methods to assess spectral separability and find a better ability of Bhattacharyya distance to assess separability within and among species. The results indicate that species mapping is tractable in tropical forests when using high-fidelity imaging spectroscopy.

Given the demand for developing the efficient Machine Learning (ML) classification models for healthcare data, and the potentiality of Bio-Inspired Optimization (BIO) algorithms to tackle the problem of high dimensional data, we investigate the range of ML classification models trained with the optimal subset of features of PD data set for efficient PD classification. We used two BIO algorithms, Genetic Algorithm (GA) and Binary Particle Swarm Optimization (BPSO), to determine the optimal subset of features of PD data set. The data set chosen for investigation comprises 756 observations (rows or records) taken over 755 attributes (columns or dimensions or features) from 252 PD patients. We employed MaxAbsolute feature scaling method to normalize the data and one hold cross-validation method to avoid biased results. Accordingly, the data is split in to training and testing set in the ratio of 70% and 30%. Subsequently, we employed GA and BPSO algorithms separately on 11 ML classifiers (Logistic Regression (LR), linear Support Vector Machine (lSVM), radial basis function Support Vector Machine (rSVM), Gaussian Naïve Bayes (GNB), Gaussian Process Classifier (GPC), k-Nearest Neighbor (kNN), Decision Tree (DT), Random Forest (RF), Multilayer Perceptron (MLP), Ada Boost (AB) and Quadratic Discriminant Analysis (QDA)), to determine the optimal subset of features (reduction of dimensionality) contributing to the highest classification accuracy. Among all the bio-inspired ML classifiers employed: GA-inspired MLP produced the maximum dimensionality reduction of 52.32% by selecting only 359 features and delivering 85.1% of the classification accuracy; GA-inspired AB delivered the maximum classification accuracy of 90.7% producing the dimensionality reduction of 41.43% by selecting only 441 features; And, BPSO-inspired GNB produced the maximum dimensionality reduction of 47.14% by selecting 396 features and delivering the classification accuracy of 79.3%; BPSOMLP delivered the maximum classification accuracy of 89% and produced 46.48% of the dimensionality reduction by selecting only 403 features.

Previous studies applying machine learning to predict severe respiratory failure in COVID-19 patients have shown inconsistent results due to variations in study populations and predictor variables. This study aimed to predict intensive care unit admission and identify key predictive factors. This retrospective cohort study included patients with COVID-19 who presented with mild respiratory failure, most of whom received oxygen via a mask or nasal cannula. Eight machine learning algorithms-XGBoost, support vector machines, neural networks, k-nearest neighbors, random forest, decision trees, logistic regression, and naïve Bayes-were applied to predict intensive care unit admission. A total of 392 patients (63.5% male, mean age, 55.0 ± 15.3 years) were included in the study. During follow-up, 80 patients (20.4%) required intensive care unit admission. Among them, 320 (81.6%) received steroid therapy, 301 (76.8%) underwent pulse steroid therapy, and 76 (19%) had been vaccinated. The multilayer perceptron, XGBoost, and radial basis function support vector machine models achieved the best overall performance based on ROC-AUC and accuracy values (ROC-AUC: 0.75, 0.70, and 0.71; accuracy: 0.79, 0.79, and 0.79, respectively). The strongest predictors of intensive care unit admission were low lymphocyte count on the first day, as well as high age, ferritin, body mass index, Charlson Comorbidity Index, and computed tomography score. Machine learning algorithms can reliably predict intensive care unit admission in COVID-19 patients with mild respiratory failure. These models identified key clinical and laboratory factors that may facilitate early risk stratification and guide treatment planning.

Given a protein that is localized in the mitochondria it is very important to know the submitochondria localization of that protein to understand its function. In this work, we propose a submitochondria localizer whose feature extraction method is based on the Chou's pseudo-amino acid composition. The pseudo-amino acid based features are obtained by combining pseudo-amino acid compositions with hundreds of amino-acid indices and amino-acid substitution matrices, then from this huge set of features a small set of 15 "artificial" features is created. The feature creation is performed by genetic programming combining one or more "original" features by means of some mathematical operators. Finally, the set of combined features are used to train a radial basis function support vector machine. This method is named GP-Loc. Moreover, we also propose a very few parameterized method, named ALL-Loc, where all the "original" features are used to train a linear support vector machine. The overall prediction accuracy obtained by GP-Loc is 89% when the jackknife cross-validation is used, this result outperforms the performance obtained in the literature (85.2%) using the same dataset. While the overall prediction accuracy obtained by ALL-Loc is 83.9%.

Surface electromyogram (sEMG) signals are widely used to control the myoelectric prosthetic arm for amputees. In this study, the authors investigated the usefulness of discrete wavelet transform (DWT) features from multiple levels of approximation and detail coefficients obtained from sEMG signals. DWT is used for de-noising as well as feature extraction in this study and further tested using Support Vector Machine (SVM) classifier and Artificial Neural Network (ANN) Classifier. The performance of SVM classifier is compared with ANN classifier. The classification accuracy of SVM classifiers was found better as compared to ANN in term of speed and robustness. In the first section of paper the authors presented the introduction related to the study. The experimental set-up for recording surface EMG signal is presented in section 2. In section 3 the experimental results are depicted and in section 4 the results are concluded.

Abstract:Bankruptcy prediction and credit scoring are the two important problems facing financial decision support. The multilayer perceptron (MLP) network has shown its applicability to these problems and its performance is usually superior to those of other traditional statistical models. Support vector machines (SVMs) are the core machine learning techniques and have been used to compare with MLP as the benchmark. However, the performance of SVMs is not fully understood in the literature because an insufficient number of data sets is considered and different kernel functions are used to train the SVMs. In this paper, four public data sets are used. In particular, three different sizes of training and testing data in each of the four data sets are considered (i.e. 3:7, 1:1 and 7:3) in order to examine and fully understand the performance of SVMs. For SVM model construction, the linear, radial basis function and polynomial kernel functions are used to construct the SVMs. Using MLP as the benchmark, the SVM classifier only performs better in one of the four data sets. On the other hand, the prediction results of the MLP and SVM classifiers are not significantly different for the three different sizes of training and testing data.

Evaluation of machine learning classifiers in keratoconus detection from orbscan II examinations

To accomplish the effective classifier and secure the accurate classification capabilities of black plastics, a comprehensive design methodology of fuzzy radial basis function neural networks is developed with the aid of principal component analysis and particle swarm optimization. Plastics recycling is the competitive method which can deal with the shortage of natural resource. To recycle and reuse the waste plastics, this study is given as the key issue to identify and classify waste plastics by resin type such as polyethylene terephthalate, polypropylene, polystyrene, etc. To complement the weak points of recognition and classification of the near-infrared radiation equipment, Raman spectroscopy is used to obtain qualitative as well as quantitative analysis of black plastics. To improve the identification performance of black plastics, an intelligent computing algorithm such as fuzzy radial basis function neural networks classifier and preprocessing algorithm as principal component analysis are applied to analyze and classify the obtained spectrum of black plastics. Finally, to optimize the structure as well as parameters of fuzzy radial basis function neural networks, particle swarm optimization technique is used. The obtained experimental results show that the proposed network architecture exhibits high classification capabilities in practical applications.

Dissolved oxygen (DO) as one of the most fundamental parameters of water quality plays a vital role in aquatic life. This study was conducted to predict DO, biological oxygen demand (BOD), and chemical oxygen demand (COD) in an intensive rainbow trout rearing system with different biomass (B). The multilayer perceptron (MLP) and the radial basis function (RBF) neural networks were employed for evaluating the impacts of food parameters (crude protein (CP), consumed feed (CF)), fish parameters (different values of B, and weight gain (WG)), and water quality parameters including temperature (T) and flow rate (Q) on variation of DO, BOD, and COD concentrations. This study's results showed that although both MLP and RBF neural networks are capable to estimate DO, BOD, and COD concentrations, RBF neural network showed better performance compared to MLP neural network. The results of sensitivity analysis indicated that the parameter CF has the highest effect on DO concentration estimation. Independent variables CF, CP, WG, and B showed the highest to the lowest rank of impacts on BOD estimation, respectively. The results also illustrated a decreasing trend of the effects on the estimation error of COD changes simulation by all independent variables, including B, T, WG, CF, CP, and Q, respectively. RBF neural network based on better stability and generalization ability with average root mean square error (RMSE) and mean absolute percentage error (MAPE) values of less than 0.12 and 3% was superior to MLP in DO, BOD, and COD concentration prediction. Moreover, CF was identified as the most effective factor in estima12tion process. Based on the present study results, there are direct relationships between DO, BOD, and COD concentrations and water quality parameters, fish parameters, and food parameters. Food parameters relative to fish and water quality parameters imposed the greatest effects. Improvement in feeding process such as application of intelligence feeding methods and change in fish diet and feeding time can considerably reduce losses in production system. Graphical abstract.

The anti-programmed cell death protein-1 (PD-1) immune checkpoint inhibitor nivolumab is currently approved for the treatment of patients with metastatic renal cell carcinoma (mRCC); approximately 25% of patients respond. We hypothesized that we could identify a biomarker of response using radiomics to train a machine learning classifier to predict nivolumab response outcomes. Patients with mRCC of different histologies treated with nivolumab in a single institution between 2013 and 2017 were retrospectively identified. Patients were labelled as responders (complete response [CR]/partial response [PR]/durable stable disease [SD]) or non-responders based on investigator tumor assessment using RECIST 1.1 criteria. For each patient, lesions were contoured from pre-treatment and first post-treatment computed tomography (CT) scans. This information was used to train a radial basis function support vector machine classifier to learn a prediction rule to distinguish responders from non-responders. The classifier was internally validated by a 10-fold nested cross-validation. Thirty-seven patients were identified; 27 (73%) met the inclusion criteria. One hundred and four lesions were contoured from these 27 patients. The median patient age was 56 years, 78% were male, 89% had clear-cell histology, 89% had prior nephrectomy, and 89% had prior systemic therapy. There were 19 responders vs. eight non-responders. The lesions selected were lymph nodes (60%), lung metastases (23%), and renal/adrenal metastases (17%). For the classifier trained on the baseline CT scans, 69% accuracy was achieved. For the classifier trained on the first post-treatment CT scans, 66% accuracy was achieved. The set of radiomic signatures was found to have limited ability to discriminate nivolumab responders from non-responders. The use of novel texture features (two-point correlation measure, two-point cluster measure, and minimum spanning tree measure) did not improve performance.

As arriving at the Earth, Interplanetary Coronal Mass Ejections (ICME) will interact with the Earth's magnetosphere and cause geomagnetic storms. The ICME event set is obtained by Richardson and Cane's Near Earth ICME list, and the input features are extracted based on interplanetary solar wind and magnetic data during ICME disturbance. A total of 483 ICME events from 1996 to 2006 are chosen in this study. 13 magnetic and kinetic features are finally selected for the training of the machine learning model. Rank of each feature's Fisher score indicates that the duration of the south-directed interplanetary magnetic field that is larger than 10nT and the increase of solar wind speed at the upstream shock or wave disturbance is closely related to the geoeffectiveness of ICME events, which is consistent with those former statistical results. The trained Radial Basis Function Support Vector Machine (RBF-SVM) can determine whether an ICME event could trigger moderate or stronger geomagnetic storms (<i>Dst</i> ≤ -50nT) effectively with an accuracy of 0.78±0.08. The results show that RBF-SVM can be used as a powerful tool in further analysis, and the better prediction of the geoeffectiveness of ICME will be obtained.