Adversarial Continual Learning to Transfer Self-Supervised Speech Representations for Voice Pathology Detection

Near infrared spectroscopy was used in discrimination of intact bovine teeth in terms of animal sex, diet, tooth type and place of origin. Discriminant Analysis (DA) models were developed and tested using a stratified random 70:30 data split to calibration and test sets. Of the discriminant techniques of Soft Independent Modelling of Class Analogy (SIMCA), Partial Least Squares – DA, Artificial Neural Networks (ANN) and Support Vector Machine (SVM), SVM and PLS-DA models performed best in most instances, with pretreatment choice impacting technique success. For test set prediction of animal sex, an accuracy of 95% was achieved using a PLS-DA model, and similar performance achieved using a SVM model. SVM, ANN and SIMCA models predicted three categories of tooth type (deciduous, permanent unerupted and erupted) with similar accuracies (89, 79 and 82%, respectively), however, permanent unerupted teeth were conflated with permanent erupted teeth. Prediction accuracy for ANN, SVM and PLS-DA models were also similar for discrimination of teeth from animals on a grain versus grass diet (PLS-DA 82%). There was considerable variation between models in prediction of geographic origin. Of the seven locations, two were discriminated with true positive rate around 70% using SVM and ANN models. Potential applications of this technology are discussed.

기업의 부도를 예측하는 것은 회계나 재무 분야에서 중요한 연구주제이다. 지금까지 기업 부도예측을 위해 여러 가지 데이터마이닝 기법들이 적용되었으나 주로 단일 모형을 사용함으로서 복잡한 분류 문제에의 적용에 한계를 갖고 있었다. 본 논문에서는 최근에 각광받고 있는 SVM (support vector machine) 모형들을 결합한 앙상블 SVM 모형 (ensemble SVM model)을 부도예측에 사용하고자 한다. 제안된 앙상블 모형은 v-조각 교차 타당성 (v-fold cross-validation)에 의해 얻어진 여러 가지 모형 중에서 성능이 좋은 상위 k개의 단일 모형으로 구성하고 과반수 투표 방식 (majority voting)을 사용하여 미지의 클래스를 분류한다. 본 논문에서 제안된 앙상블 SVM 모형의 성능을 평가하기 위해 실제 기업의 재무비율 자료와 모의실험자료를 가지고 실험하였고, 실험결과 제안된 앙상블 모형이 여러 가지 평가척도 하에서 단일 SVM 모형들보다 좋은 성능을 보임을 알 수 있었다. Corporate bankruptcy prediction has been an important topic in the accounting and finance field for a long time. Several data mining techniques have been used for bankruptcy prediction. However, there are many limits for application to real classification problem with a single model. This study proposes ensemble SVM (support vector machine) model which assembles different SVM models with each different kernel functions. Our ensemble model is made and evaluated by v-fold cross-validation approach. The k top performing models are recruited into the ensemble. The classification is then carried out using the majority voting opinion of the ensemble. In this paper, we investigate the performance of ensemble SVM classifier in terms of accuracy, error rate, sensitivity, specificity, ROC curve, and AUC to compare with single SVM classifiers based on financial ratios dataset and simulation dataset. The results confirmed the advantages of our method: It is robust while providing good performance.

Astrocytoma is the most common neuroepithelial neoplasm, and its grading greatly affects treatment and prognosis. According to relevant factors of astrocytoma, this study developed a support vector machine (SVM) model to predict the astrocytoma grades and compared the SVM prediction with the clinician's diagnostic performance. Patients were recruited from a cohort of astrocytoma patients in our hospital between January 2008 and April 2009. Among all astrocytoma patients, nine had grade I, 25 had grade II, 12 had grade III, and 60 had grade IV astrocytoma. An SVM model was constructed using radial basis kernel. The SVM model was trained with nine magnetic resonance (MR) features and one clinical parameter by fivefold cross-validation and differentiated astrocytomas of grades I-IV at two levels, respectively. The clinician also predicted the grade of astrocytoma. According to the two prediction methods above, the areas under receiving operating characteristics (ROC) curves to discriminate low- and high-grade groups, accuracies of high-grade grouping, overall accuracy, and overall kappa values were compared. For SVM, the overall accuracy was 0.821 and the overall kappa value was 0.679; for clinicians, the overall accuracy was 0.651 and the overall kappa value was 0.466. The diagnostic performance of SVM is significantly better than clinician performance, with the exception of the low-grade group. The SVM model can provide useful information to help clinicians improve diagnostic performance when predicting astrocytoma grade based on MR images.

Bus arrival time prediction is an important part of intelligent transport system, the prediction accuracy directly affects the overall level of the intelligent transport system. This paper mainly studies the hybrid bus arrival time prediction model, which combines the real-time prediction and support vector machine (SVM) model. And in the SVM model, three factors was chosen as reference, which is time, weather, holidays. This paper is based on the analysis of the characteristics of Yuxi intelligent transport system, and choosing the support vector machine (SVM) model as prediction model, which is adaptive, robustness, and fitting small sample prediction. At the same time, using the GPS technology, which solves the problem of the complexity of the road traffic and the singularity of historical data. The model of this paper effectively solves the problem of bus arrival time prediction.

To the nonlinear controlled objects that generally exist in industrial processes, a predictive control algorithm based on support vector machine (SVM) model was proposed. First, SVM model with RBF kernel function was constructed offline. Then, the future values of controlled variable were predicted and linearized online using the SVM model. Finally, generalized predictive control (GPC) was applied to realize control goal. The simulation proves that this method is effective.

Flood susceptibility mapping using a novel ensemble weights-of-evidence and support vector machine models in GIS

Automatic voice pathology detection enables objective assessment of pathologies that affect the voice production mechanism. Detection systems have been developed using the traditional pipeline approach (consisting of the feature extraction part and the detection part) and using the modern deep learning -based end-to-end approach. Due to the lack of vast amounts of training data in the study area of pathological voice, the former approach is still a valid choice. In the existing detection systems based on the traditional pipeline approach, the mel-frequency cepstral coefficient (MFCC) features can be regarded as the defacto standard feature set. In this study, automatic voice pathology detection is investigated by comparing the performance of various MFCC variants derived by considering two factors: the input and the filterbank in the cepstrum computation. For the first factor, three inputs (the voice signal, the glottal source and the vocal tract) are compared. The glottal source and the vocal tract are estimated using the quasi-closed phase glottal inverse filtering method. For the second factor, the mel-frequency and linear-frequency filterbanks are compared. Experiments were conducted separately using six databases consisting of voices produced by speakers suffering from one of four disorders (dysphonia, Parkinson’s disease, laryngitis, or heart failure) and by healthy speakers. Support vector machine (SVM) was used as the classifier. The results show that by combining mel- and linear-frequency cepstral coefficients derived from the glottal source and vocal tract, better overall detection accuracy was obtained compared to the defacto MFCC features derived from the voice signal. Furthermore, this combination provided comparable or better performance than four existing cepstral feature extraction techniques in clean and high signal-to-noise ratio (SNR) conditions.

Purpose: Accurate lymph node (LN) status evaluation for intrahepatic cholangiocarcinoma (ICC) patients is essential for surgical planning. This study aimed to develop and validate a prediction model for preoperative LN status evaluation in ICC patients.Methods and Materials: A group of 106 ICC patients, who were diagnosed between April 2011 and February 2016, was used for prediction model training. Image features were extracted from T1-weighted contrast-enhanced MR images. A support vector machine (SVM) model was built by using the most LN status-related features, which were selected using the maximum relevance minimum redundancy (mRMR) algorithm. The mRMR method ranked each feature according to its relevance to the LN status and redundancy with other features. An SVM score was calculated for each patient to reflect the LN metastasis (LNM) probability from the SVM model. Finally, a combination nomogram was constructed by incorporating the SVM score and clinical features. An independent group of 42 patients who were diagnosed from March 2016 to November 2017 was used to validate the prediction models. The model performances were evaluated on discrimination, calibration, and clinical utility.Results: The SVM model was constructed based on five selected image features. Significant differences were found between patients with LNM and non-LNM in SVM scores in both groups (the training group: 0.5466 (interquartile range (IQR), 0.4059-0.6985) vs. 0.3226 (IQR, 0.0527-0.4659), P<0.0001; the validation group: 0.5831 (IQR, 0.3641-0.8162) vs. 0.3101 (IQR, 0.1029-0.4661), P=0.0015). The combination nomogram based on the SVM score, the CA 19-9 level, and the MR-reported LNM factor showed better discrimination in separating patients with LNM and non-LNM, comparing to the SVM model alone (AUC: the training group: 0.842 vs. 0.788; the validation group: 0.870 vs. 0.787). Favorable clinical utility was observed using the decision curve analysis for the nomogram.Conclusion: The nomogram, incorporating the SVM score, CA 19-9 level and the MR-reported LNM factor, provided an individualized LN status evaluation and helped clinicians guide the surgical decisions.

A kernel-free fuzzy reduced quadratic surface [formula omitted]-support vector machine with applications

Flooding causes several threats with outcomes which include peril to human and animal life, damage to property, and adversity to agricultural fields. Therefore, flood prediction is of prime importance for reducing loss of life and devastation to property. To model complex nature of hydrologic processes artificial neural network (ANN) tool is effectively being utilized for modelling different nonlinear relationships, and has proved to be an appropriate method for flood prediction. Present study investigated relative accuracy of radial basis function neural network (RBFNN) and support vector machine (SVM) models combined with Firefly Algorithm (FA) in predicting river flood discharge and contrasted with that of regular ANN, RBFNN and SVM models. Monthly river flow data of Silchar and Dholai stations located in Cachar district of Assam, India are utilized for the present study. For assessing model performance, coefficient of determination (R2), mean square error (MSE) and root mean square error (RMSE) were measured. Evaluation of outcomes shows that both RBF-FA (radial basis function - firefly algorithm) and SVM-FA (support vector machine - firefly algorithm) hybrid models give more precise forecasting results than RBFNN, FFBPNN (feed forward back propagation neural network) and SVM models. Yet, it can be observed that SVM-FA model give better forecasting outputs with R2 value 0.9818 than RBF-FA model. Results also reveal that simple SVM model performs marginally better than simple ANN model.

This paper presents an automatic voice pathology detection using multiresolution technique, more specifically using Gabor wavelets. Gabor wavelets can extract information in various scales and orientations, and thereby can effectively encode distinguishable patterns of normal and pathological voice signals. First, the input voice is transformed to frequency domain using frame based Fourier transformation. 2D Gabor filters with different scale and orientation are applied on the Mel-filtered frequency representation. To reduce the dimension of Gabor features, principal component analysis is applied. These features are fed into a support vector machine for classification. In this investigation, we use two different well known databases, MEEI and SVD. The results show that the proposed method outperforms some of the state-of-the-art techniques used for voice pathology detection.

In this paper, we present an approach for the fast deployment and efficient scoring of Support Vector Machine (SVM) models. We developed a compiler for transforming a formal specification of a SVM and generating source code in different versions of the C/C++ language. This effectively automates the deployment of SVM models and its integration into the operational software for its use. The proposed compiler generates efficient code to deploy SVM models in CPUs (single or multi-core) and in Graphics Processing Units (GPUs) through NVIDIA's Computed Unified Device Architecture (CUDA). We also present an empirical evaluation of our compiler's targets scoring a SVM model with a linear kernel. In our experiments we score a real dataset in batch mode at different scales. The results show that our C CUDA implementation performs better as data scale increases and it is approximately 38 times faster than the single-core implementation using single precision floating-point values.

To achieve rapid and accurate identification of genetically modified (GM) and non-GM rapeseed oils, a support vector machine (SVM) model based on an improved mayfly optimization algorithm and coupled with the terahertz time-domain spectroscopy, is proposed. Two types of GM rapeseed oils and two types of non-GM rapeseed oils are selected as research subjects. Their spectral information is acquired by using the terahertz time-domain spectroscopy. The observations show that GM rapeseed oils exhibit stronger terahertz absorption characteristics than non-GM rapeseed oils. However, their absorption spectra are highly similar, making direct differentiation difficult through visual inspection alone. Therefore, SVM is used for spectral recognition. Considering that the classification performance of SVM is significantly affected by its parameters, the mayfly optimization algorithm is combined to optimize these parameters. Furthermore, adaptive inertia weight and Lévy flight strategies are introduced to enhance the global search capability and robustness of the mayfly optimization algorithm, thus addressing the issue of easily becoming trapped in local optima in the optimization process. Moreover, principal component analysis is used to reduce the dimensionality of the absorbance data in a 0.3–1.8 THz range, aiming to extract critical features, thereby enhancing modeling efficiency and reducing redundancy in spectral data. Experimental results demonstrate that the improved mayfly optimization algorithm effectively identifies the optimal parameter combination for SVM, thereby enhancing the overall performance of the identification model. The proposed SVM model, in which the improved mayfly optimization algorithm is used, can achieve a recognition accuracy of 100% for the four types of rapeseed oils, surpassing the 98.15% accuracy achieved by the SVM model with the original mayfly optimization algorithm. Thus, this study presents a rapid and effective new approach for identifying GM rapeseed oils and offers a valuable reference for identifying other genetically modified substances.

Exploring effectiveness of frequency ratio and support vector machine models in storm surge flood susceptibility assessment: A study of Sundarban Biosphere Reserve, India

In this paper, a mode decomposition analysis-based adaptive approach is proposed to provide high diagnostic performance for automated voice pathology detection systems. The aim of the study is to develop a reliable and effective system using adaptive cepstral domain features derived from the empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD), and complete empirical mode decomposition with adaptive noise (CEEMDAN) methods. The descriptive feature sets are obtained by applying mel-frequency cepstral coefficients (MFCCs) and their derivatives, linear predictive coefficients (LPCs) and linear predictive cepstral coefficients (LPCCs) techniques to each decomposition level. The class-balanced data are generated on the VOice ICar fEDerico II database samples using the synthetic minority oversampling technique (SMOTE). The ReliefF algorithm is used to select the most effective and distinctive features. A combination of selected features and a support vector machine (SVM) classifier is used to identify pathological voices. In the pathology detection approach, the results show that the cepstral features based on EMD and SVM-cubic achieves the highest performance with 99.85\% accuracy, 99.85\% F1-score and 0.997 Matthews correlation coefficient (MCC). In pathology-type classification, the cepstral features based on EEMD and SVM-quadratic approach provided the highest performance with 96.49\% accuracy, 96.46\% F1 and 0.949 MCC values. The comprehensive results of this study reveal that mode decomposition-based approaches are more successful and effective than traditional methods for detection and classification of pathological voices.