Arabic Named Entity Recognition on Social Media based on feature selection techniques usi ng SVM-RFE

Feature selection and analysis on correlated gas sensor data with recursive feature elimination

In a DNA microarray dataset, gene expression data often has a huge number of features(which are referred to as genes) versus a small size of samples. With the development of DNA microarray technology, the number of dimensions increases even faster than before, which could lead to the problem of the curse of dimensionality. To get good classification performance, it is necessary to preprocess the gene expression data. Support vector machine recursive feature elimination (SVM-RFE) is a classical method for gene selection. However, SVM-RFE suffers from high computational complexity. To remedy it, this paper enhances SVM-RFE for gene selection by incorporating feature clustering, called feature clustering SVM-RFE (FCSVM-RFE). The proposed method first performs gene selection roughly and then ranks the selected genes. First, a clustering algorithm is used to cluster genes into gene groups, in each which genes have similar expression profile. Then, a representative gene is found to represent a gene group. By doing so, we can obtain a representative gene set. Then, SVM-RFE is applied to rank these representative genes. FCSVM-RFE can reduce the computational complexity and the redundancy among genes. Experiments on seven public gene expression datasets show that FCSVM-RFE can achieve a better classification performance and lower computational complexity when compared with the state-the-art-of methods, such as SVM-RFE.

Metabolic markers are the core of metabonomic surveys. Hence selection of differential metabolites is of great importance for either biological or clinical purpose. Here, a feature selection method was developed for complex metabonomic data set. As an effective tool for metabonomics data analysis, support vector machine (SVM) was employed as the basic classifier. To find out meaningful features effectively, support vector machine recursive feature elimination (SVM-RFE) was firstly applied. Then, genetic algorithm (GA) and random forest (RF) which consider the interaction among the metabolites and independent performance of each metabolite in all samples, respectively, were used to obtain more informative metabolic difference and avoid the risk of false positive. A data set from plasma metabonomics study of rat liver diseases developed from hepatitis, cirrhosis to hepatocellular carcinoma was applied for the validation of the method. Besides the good classification results for 3 kinds of liver diseases, 31 important metabolites including lysophosphatidylethanolamine (LPE) C16:0, palmitoylcarnitine, lysophosphatidylethanolamine (LPC) C18:0 were also selected for further studies. A better complementary effect of the three feature selection methods could be seen from the current results. The combinational method also represented more differential metabolites and provided more metabolic information for a “global” understanding of diseases than any single method. Further more, this method is also suitable for other complex biological data sets.

Effects of imaging modalities, brain atlases and feature selection on prediction of Alzheimer's disease

Skin cancer is on the rise. Hence the accurate detection of cancerous lesions is of paramount importance in the treatment of this health condition. In this study, we present a computer vision framework that studies 10 skin lesion features including newly introduced morphological and texture features along with established in the literature. All features are extracted automatically from 90 lesion images. A two-class classification problem was applied to determine the most significant features of disease using three features selection methods, Support Vector Machines Recursive Feature Elimination (SVMRFE), Information Gain, and Correlation-based Feature Subset Selection. We found that the five features selected by SVMRFE provides the highest accuracy readings of 100% model, 84% leave-one-out, and 89% 10-fold cross validation (10×CV) than the other two methods. Comparing the selected features with those used by the Total Dermoscopy Score, we report consistencies, disagreements, and the contributions of the present work.

IntroductionIn the classification of Mass Spectrometry (MS) proteomics data, peak detection, feature selection, and learning classifiers are critical to classification accuracy. To better understand which methods are more accurate when classifying data, some publicly available peak detection algorithms for Matrix assisted Laser Desorption Ionization Mass Spectrometry (MALDI-MS) data were recently compared; however, the issue of different feature selection methods and different classification models as they relate to classification performance has not been addressed. With the application of intelligent computing, much progress has been made in the development of feature selection methods and learning classifiers for the analysis of high-throughput biological data. The main objective of this paper is to compare the methods of feature selection and different learning classifiers when applied to MALDI-MS data and to provide a subsequent reference for the analysis of MS proteomics data.ResultsWe compared a well-known method of feature selection, Support Vector Machine Recursive Feature Elimination (SVMRFE), and a recently developed method, Gradient based Leave-one-out Gene Selection (GLGS) that effectively performs microarray data analysis. We also compared several learning classifiers including K-Nearest Neighbor Classifier (KNNC), Naïve Bayes Classifier (NBC), Nearest Mean Scaled Classifier (NMSC), uncorrelated normal based quadratic Bayes Classifier recorded as UDC, Support Vector Machines, and a distance metric learning for Large Margin Nearest Neighbor classifier (LMNN) based on Mahanalobis distance. To compare, we conducted a comprehensive experimental study using three types of MALDI-MS data.ConclusionRegarding feature selection, SVMRFE outperformed GLGS in classification. As for the learning classifiers, when classification models derived from the best training were compared, SVMs performed the best with respect to the expected testing accuracy. However, the distance metric learning LMNN outperformed SVMs and other classifiers on evaluating the best testing. In such cases, the optimum classification model based on LMNN is worth investigating for future study.

Deep belief network-based approach for detecting Alzheimer's disease using the multi-omics data

Towards a Novel Weakly Supervised Joint Approach of Named Entity Recognition and Normalization for Noisy Text

Selecting distinguishable features from small sample data of rolling bearings has become an emerging and trending research topic in recent years. In this paper, a two-stage feature selection method based on Euclidean distance and multi-class support vector machine is proposed to remove irrelevant features and redundant features. First, the fault data are formed to a multidomain feature set. Second, the ReliefF algorithm based on Euclidean distance is used to remove irrelevant features. Third, the support vector machine recursive feature elimination (SVMRFE) is used to remove redundant features. Lastly, the KNN classifier is used to verify the effectiveness of this method. This paper uses the rolling bearing public datasets. After comparison, the results prove that the method proposed in the article is better.

Cyanobacteria have developed acclimation strategies to adapt to harsh environments, making them a model organism. Understanding the molecular mechanisms of tolerance to abiotic stresses can help elucidate how cells change their gene expression patterns in response to stress. Recent advances in sequencing techniques and bioinformatics analysis methods have led to the discovery of many genes involved in stress response in organisms. The Synechocystis sp. PCC 6803 is a suitable microorganism for studying transcriptome response under environmental stress. Therefore, for the first time, we employed two effective feature selection techniques namely and support vector machine recursive feature elimination (SVM-RFE) and LASSO (Least Absolute Shrinkage Selector Operator) to pinpoint the crucial genes responsive to environmental stresses in Synechocystis sp. PCC 6803. We applied these algorithms of machine learning to analyze the transcriptomic data of Synechocystis sp. PCC 6803 under distinct conditions, encompassing light, salt and iron stress conditions. Seven candidate genes namely sll1862, slr0650, sll0760, slr0091, ssl3044, slr1285, and slr1687 were selected by both LASSO and SVM-RFE algorithms. RNA-seq analysis was performed to validate the efficiency of our feature selection approach in selecting the most important genes. The RNA-seq analysis revealed significantly high expression for five genes namely sll1862, slr1687, ssl3044, slr1285, and slr0650 under ion stress condition. Among these five genes, ssl3044 and slr0650 could be introduced as new potential candidate genes for further confirmatory genetic studies, to determine their roles in their response to abiotic stresses.

This study proposes a product form feature (PFF) selection method based on a numerical definition-based approach (NDA) and the consumers' image perceptions (CIPs). In the proposed approach, NDA is used to generate an explicit numerical definition of the product form design and the corresponding CIPs are determined by means of a semantic differential experiment. A CIP prediction model is constructed using support vector regression (SVR) techniques. Finally, the feature selection method, namely SVR with support vector machine recursive feature elimination (SVM-RFE), is used to identify the critical form features. The validity of the feature selection method is demonstrated using a knife design for illustration purposes. The result shows that the proposed method provides product designers with a powerful tool for systematically selecting the critical form features and evaluating their respective effects on the consumers' image perceptions.

BackgroundEndometriosis (EM) is associated with immune dysregulation, while dysfunction of natural killer (NK) cells is regarded as a key mechanism underlying immune escape and the persistent growth of ectopic lesions.MethodThis study used single‐cell RNA sequencing (scRNA‐seq) on lesions from three patients with EM and on three normal endometrium samples and integrated these data with three bulk RNA‐seq datasets from GEO (GSE105765, GSE7305, and GSE6364). Seurat, Monocle, limma, least absolute shrinkage and selection operator (LASSO), and support vector machine recursive feature elimination (SVM‐RFE) were used for cell clustering, trajectory inference, differential expression analysis, and feature selection. Immune‐cell composition and pathway activity were evaluated with CIBERSORT and GSVA. Gene expression was validated by qPCR, and cell migration and invasiveness were assessed using wound healing and Transwell assays.ResultscRNA‐seq resolved 11 clusters assigned to eight major cell types. By integrating pseudotime features with bulk data, 20 differentially expressed genes (DEGs) were prioritized, and machine‐learning analyses identified three key genes: granulysin (GNLY), perforin 1 (PRF1), and ENTPD1. The three‐gene model showed good discrimination in the training set and two external validation cohorts (AUCs 0.84, 0.67, and 0.77, respectively). GNLY and PRF1 were predominantly expressed in NK cells and CD8+ T cells and correlated with activation signatures, whereas ENTPD1 was highly expressed in endometrial stromal cells and enhanced their migratory and invasive capacities. ENTPD1 may contribute to disease via adenosine signaling–mediated modulation of NK–cell function. In silico analyses also nominated candidate agents targeting this pathway, including resveratrol, ibuprofen, and danazol.ConclusionThis study highlights the central role of NK–cell dysfunction in EM pathogenesis and proposes GNLY, PRF1, and ENTPD1 as potential molecular diagnostic biomarkers. Notably, ENTPD1 appears to have dual functions, including immunomodulation and promotion of stromal cell migration, which promotes lesion formation. These findings provide a mechanistic rationale and actionable targets for earlier screening and targeted therapy in EM.

As an intermediary between residential customers and system operators, load aggregators (LA) are responsible for integrating the residential customers' demand response (DR) potential and enabling their transactions in the day-ahead market. Profit of the market trading process mainly relies on the pre-estimated achievable DR potential, which puts forwards the necessity of its accurate forecasting. Therefore, this paper proposes a probabilistic forecasting model to forecast the day-ahead achievable DR potential at the aggregated level under an incentive-based demand response (IBDR) program. Firstly, we attempt to establish the customers' DR potential, during which a home energy management system (HEMS) is introduced to implement load adjustment for electrical appliances. Secondly, several features that may affect the DR potential are extracted, among which the more relevant ones are selected through the support vector machine recursive feature elimination (SVM-RFE) method. Finally, based on these selected features, a support vector machine (SVM) method is adopted to establish the DR potential point forecasting model, and then the probabilistic forecasting model of the aggregated DR potential is established through the superimposition of the point forecasting results and the corresponding error distribution, the latter could be estimated by the non-parametric kernel density (NKDE) method. Case studies show that a good performance could be achieved by the proposed probabilistic forecasting model and the feature selection process could significantly improve the forecasting accuracy.

Towards a Novel Weakly Supervised Joint Approach of Named Entity Recognition and Normalization for Noisy Text

BackgroundEndometriosis is recognized as an estrogen-dependent inflammation disorder, estimated to affect 8%-15% of women of childbearing age. Currently, the etiology and pathogenesis of endometriosis are not completely clear. Underlying mechanism for endometriosis is still under debate and needs further exploration. The involvement of transcription factors and immune mediations may be involved in the pathophysiological process of endometriosis, but the specific mechanism remains to be explored. This study aims to investigate the underlying molecular mechanisms in endometriosis.MethodsThe gene expression profile of endometriosis was obtained from the gene expression omnibus (GEO) database. Gene set variation analysis (GSVA) and gene set enrichment analysis (GSEA) were applied to the endometriosis GSE7305 datasets. Cibersort and MCP-counter were used to explore the immune response gene sets, immune response pathway, and immune environment. Differentially expressed genes (DEGs) were identified and screened. Common biological pathways were being investigated using the kyoto encyclopedia of genes and genomes (KEGG) pathway enrichment analysis. Transcription factors were from The Human Transcription Factors. The least absolute shrinkage and selection operator (Lasso) model identified four differential expressions of transcription factors (AEBP1, HOXB6, KLF2, and RORB). Their diagnostic value was calculated by receiver operating characteristic (ROC) curve analysis and validated in the validation cohort (GSE11691, GSE23339). By constructing the interaction network of crucial transcription factors, weighted gene coexpression network analysis (WGCNA) was used to search for key module genes. Metascape was used for enrichment analysis of essential module genes and obtained HOXB6, KLF2. The HOXB6 and KLF2 were further verified as the only two intersection genes according to Support Vector Machine Recursive Feature Elimination (SVM-RFE) and random forest models. We constructed ceRNA (lncRNA-miRNA-mRNA) networks with four potential transcription factors. Finally, we performed molecular docking for goserelin and dienogest with four transcription factors (AEBP1, HOXB6, KLF2, and RORB) to screen potential drug targets.ResultsImmune and metabolic pathways were enriched in GSVA and GSEA. In single sample gene set enrichment analysis (ssGSEA), most immune infiltrating cells, immune response gene sets, and immune response pathways are differentially expressed between endometriosis and non-endometriosis. Twenty-seven transcription factors were screened from differentially expressed genes. Most of the twenty-seven transcription factors were correlated with immune infiltrating cells, immune response gene sets and immune response pathways. Furthermore, Adipocyte enhancer binding protein 1 (AEBP1), Homeobox B6 (HOXB6), Kruppel Like Factor 2 (KLF2) and RAR Related Orphan Receptor B (RORB) were selected out from twenty-seven transcription factors. ROC analysis showed that the four genes had a high diagnostic value for endometriosis. In addition, KLF2 and HOXB6 were found to play particularly important roles in multiple modules (String, WGCNA, SVM-RFE, random forest) on the gene interaction network. Using the ceRNA network, we found that NEAT1 may regulate the expressions of AEBP1, HOXB6 and RORB, while X Inactive Specific Transcript (XIST) may control the expressions of HOXB6, RORB and KLF2. Finally, we found that goserelin and dienogest may be potential drugs to regulate AEBP1, HOXB6, KLF2 and RORB through molecular docking.ConclusionsAEBP1, HOXB6, KLF2, and RORB may be potential biomarkers for endometriosis. Two of them, KLF2 and HOXB6, are critical molecules in the gene interaction network of endometriosis. Discovered by molecular docking, AEBP1, HOXB6, KLF2, and RORB are targets for goserelin and dienogest.