Transductive support vector machines for classification of microarray gene expression data

Most of the traditional gene selection approaches are borrowed from other fields such as statistics and computer science, However, they do not prioritize biologically relevant genes since the ultimate goal is to determine features that optimize model performance metrics not to build a biologically meaningful model. Therefore, there is an imminent need for new computational tools that integrate the biological knowledge about the data in the process of gene selection and machine learning. Integrative gene selection enables incorporation of biological domain knowledge from external biological resources. In this study, we propose a new computational approach named CogNet that is an integrative gene selection tool that exploits biological knowledge for grouping the genes for the computational modeling tasks of ranking and classification. In CogNet, the pathfindR serves as the biological grouping tool to allow the main algorithm to rank active-subnetwork-oriented KEGG pathway enrichment analysis results to build a biologically relevant model. CogNet provides a list of significant KEGG pathways that can classify the data with a very high accuracy. The list also provides the genes belonging to these pathways that are differentially expressed that are used as features in the classification problem. The list facilitates deep analysis and better interpretability of the role of KEGG pathways in classification of the data thus better establishing the biological relevance of these differentially expressed genes. Even though the main aim of our study is not to improve the accuracy of any existing tool, the performance of the CogNet outperforms a similar approach called maTE while obtaining similar performance compared to other similar tools including SVM-RCE. CogNet was tested on 13 gene expression datasets concerning a variety of diseases.

Chapter 14 - Review on hybrid feature selection and classification of microarray gene expression data

Machine Learning algorithms have been widely used for gene expression data classification, despite the fact that these data have often intrinsic limitations, such as high dimensionality and a small number of examples. Few studies try to characterize to which extent these aspects can influence the performance of the classification models induced. In this paper we compute different measures characterizing the complexity of gene expression data sets for cancer diagnosis. We then investigate how these measures relate to the classification performances achieved by support vector machines, a popular Machine Learning technique usually employed in the analysis of gene expression data. The results obtained indicate that some of the complexity indices utilized are indeed successful in explaining the difficulty involved in the classification of cancer gene expression data.

Though DNA microarray technology simultaneously measures the expression levels of thousands of genes, only a few underlying gene features may account for significant data variation in gene classification problems. Selection of features from huge data set is difficult and so dimension reduction of gene expression data set is essential in order to determining important features, which play key role in predicting an outcome. Rough set theory (RST) has been used recently for dimension reduction of data, however, the existing methods are inadequate to finding minimal reduct. The paper proposes a RST based technique, applied on gene expression data for dimension reduction by obtaining single reduct in one pass. The gene expression data are discretized using linguistic terms with proper semantics and represented by fuzzy sets. The discretized values are calculated using Gaussian membership function with varied mean and standard deviation in order to eliminate the ambiguity between different linguistic terms. The genes are classified using linguistic decision attribute values based on the frequency of gene expression data. Discritization and classification of gene expression data are performed simultaneously, which significantly reduces time complexity of the procedure. Thus, the proposed framework selects the most significant samples for gene classification, resulting dimension reduction. The Proposed method produces output, which exhibits no variation with experimental microarray gene information unlike other existing methods.

Classification of gene expression data is the common denominator of various biomedical recognition tasks. However, obtaining class labels for large training samples may be difficult or even impossible in many cases. Therefore, semi-supervised classification techniques are required as semi-supervised classifiers take advantage of the unlabeled data. Furthermore, gene expression data is high dimensional which gives rise to the phenomena known under the umbrella of the curse of dimensionality, one of its recently explored aspects being the presence of hubs or hubness for short. Therefore, hubness-aware classifiers were developed recently, such as Naive Hubness Bayesian k-Nearest Neighbor (NHBNN). In this paper, we propose a semi-supervised extension of NHBNN and show in experiments on publicly available gene expression data that the proposed classifier outperforms all its examined competitors.

One of the most significant research topics in bioinformatics is the classification of gene expression. Gene expression data commonly have a large number of features and a small number of samples. The gene expression data are very different from one to another, this differentiation among data and the feature's large number make the classification for gene expression data challenging. In this study, for classification we assessed the accuracy for most powerful deep learning's algorithms such as Deep Neural Network, Recurrent Neural Network, Convolutional Neural Network and improved Deep Neural Network with the preprocessing technique. The DNN was improved by adding Dropout to it by which the overfitting problem was overcame. Our results showed that the proposed improved-DNN outperforms the other algorithms among all used datasets.

Analysis of large-scale gene expression data is a research hotspot in the field of bioinformatics, which can be used to study abnormal phenomenon in plant growth process. This paper proposes a biological knowledge integration method based on parallel clustering to select gene subsets effectively. Gene ontology is utilised to obtain the biological functional similarity, and combined with gene expression data. Parallelised affinity propagation algorithm is used to cluster data since it can not only obtain more biologically meaningful subsets, but also avoid the loss of some potential value in genes from simple gene primary selection. The algorithm is verified with four typical plant datasets and compared with other well-known integration methods. Experimental results on plant stress response datasets demonstrate that the proposed method can select genes with stronger classification ability.

Rapid technological advancements in microarray analysis continue to generate enormous amounts of genomic data. However, neither hardware nor software computational capabilities have kept pace with this drastic increase. This paper presents a novel framework designed to achieve fast, robust, and accurate (biologically-significant) multi-class classification of gene expression data using distributed knowledge discovery and computational integration routines, specifically for cancer applications. The proposed paradigm consists of the following key computational steps: (a) preprocessing normalization and discretization of gene expression data, (b) partition data using two methods: overlapped windows and adaptive selection, (c) perform association rule discovery on partitioned data-spaces using FP-growth method, (d) integrate derived association rules on distributed processor nodes using a novel knowledge integration algorithm, (e) further prune rules to reduce dimensionality using parametric significance estimation, and (f) cluster remaining rules using a novel clustering algorithm for enhanced visualization and interpretation of discovered gene rule sets.

Microarray technology has transformed the biotechnological research to next level in the recent years. It provides the expression levels of various genes involved in a particular disease. Prostate cancer disease turned into life threatening cancer. The genes causing this disease are identified through the classification methods. These gene expression data have problems like high dimensional with low sample size which imposes active challenges in the existing classification algorithms. Feature selection techniques are applied in order to address the dimensionality issues. . This paper aims in analyzing the feature selection methods for classification of gene expression data of Prostate and identify the significant genes that have a major influence on the disease. The three different feature selection methods such as Filters, wrappers and embedded selectors are applied before the classification process for selecting the top ranked genes. Then, the extracted top ranked genes are applied on the classification algorithms such as SVM, k-NN, Random Forest and Artificial Neural Network. After the inclusion of feature selection technique, the classification accuracy is significantly boosted even with less number of genes. Random Forest classification algorithm outperforms other classification methods. The significant genes that has the major influence in prostate cancer disease are identified such as KLK3, GFI1, CXCR2 and TNFRSF10C.

Microarray experiments generate data sets containing valuable information on the gene expression levels of millions of genes in the form of a set of biological samples. Inference of gene regulatory networks from microarray data has become an important research area in bioinformatics. Several computational methods have been proposed to infer important relationships between transcription factors with target genes from gene expression and transcription factor data sets. The inferences from these methods are consistent with the biological literature and can help researchers design reasonable and efficient drugs to resist different diseases. This paper is a survey of different methods used for preprocessing and inferring the gene regulatory networks from a data set of gene expression.

BackgroundInterpretation of high-throughput gene expression data continues to require mathematical tools in data analysis that recognizes the shape of the data in high dimensions. Topological data analysis (TDA) has recently been successful in extracting robust features in several applications dealing with high dimensional constructs. In this work, we utilize some recent developments in TDA to curate gene expression data. Our work differs from the predecessors in two aspects: (1) Traditional TDA pipelines use topological signatures called barcodes to enhance feature vectors which are used for classification. In contrast, this work involves curating relevant features to obtain somewhat better representatives with the help of TDA. This representatives of the entire data facilitates better comprehension of the phenotype labels. (2) Most of the earlier works employ barcodes obtained using topological summaries as fingerprints for the data. Even though they are stable signatures, there exists no direct mapping between the data and said barcodes.ResultsThe topology relevant curated data that we obtain provides an improvement in shallow learning as well as deep learning based supervised classifications. We further show that the representative cycles we compute have an unsupervised inclination towards phenotype labels. This work thus shows that topological signatures are able to comprehend gene expression levels and classify cohorts accordingly.ConclusionsIn this work, we engender representative persistent cycles to discern the gene expression data. These cycles allow us to directly procure genes entailed in similar processes.

Chapter 9 - Effective dimensionality reduction model with machine learning classification for microarray gene expression data

Gene expression profiles are sequences of numbers, and the need to analyze them has now increased significantly. Gene expression data contain a large number of genes and models used for cancer classification. As the wealth of these data being produced, new prediction, classification and clustering techniques are applied to the analysis of the data. Although there are a number of proposed methods with good results, there is still limited diagnostics and a lot of problems still to be solved. To solve the difficulty, in this paper, an efficient gene expression data classification is proposed. To predict the cancer class of patients from the gene expression profile, this paper presents a novel classification framework in the manner of three steps namely, Pre-processing, feature selection and classification. In pre-processing, missing value is filled and redundant data are removed. To attain the enhanced classification outcomes, the important features are selected from the database with the help of Adaptive Salp Swarm Optimization (ASSO) algorithm. Then, the selected features are given to the multi kernel SVM (MKSVM) to classify the gene expression data namely, BRCA, KIRC, COAD, LUAD and PRAD. The performance of proposed methodology is analyzed in terms of different metrics namely, accuracy, sensitivity and specificity. The performance of proposed methodology is 4.5% better than existing method in terms of accuracy.

Bond rating is regarded as an important event for measuring financial risk of companies and for determining the investment returns of investors. As a result, it has been a popular research topic for researchers to predict companies' credit ratings by applying statistical and machine learning techniques. The statistical techniques, including multiple regression, multiple discriminant analysis (MDA), logistic models (LOGIT), and probit analysis, have been traditionally used in bond rating. However, one major drawback is that it should be based on strict assumptions. Such strict assumptions include linearity, normality, independence among predictor variables and pre-existing functional forms relating the criterion variablesand the predictor variables. Those strict assumptions of traditional statistics have limited their application to the real world. Machine learning techniques also used in bond rating prediction models include decision trees (DT), neural networks (NN), and Support Vector Machine (SVM). Especially, SVM is recognized as a new and promising classification and regression analysis method. SVM learns a separating hyperplane that can maximize the margin between two categories. SVM is simple enough to be analyzed mathematical, and leads to high performance in practical applications. SVM implements the structuralrisk minimization principle and searches to minimize an upper bound of the generalization error. In addition, the solution of SVM may be a global optimum and thus, overfitting is unlikely to occur with SVM. In addition, SVM does not require too many data sample for training since it builds prediction models by only using some representative sample near the boundaries called support vectors. A number of experimental researches have indicated that SVM has been successfully applied in a variety of pattern recognition fields. However, there are three major drawbacks that can be potential causes for degrading SVM's performance. First, SVM is originally proposed for solving binary-class classification problems. Methods for combining SVMs for multi-class classification such as One-Against-One, One-Against-All have been proposed, but they do not improve the performance in multi-class classification problem as much as SVM for binary-class classification. Second, approximation algorithms (e.g. decomposition methods, sequential minimal optimization algorithm) could be used for effective multi-class computation to reduce computation time, but it could deteriorate classification performance. Third, the difficulty in multi-class prediction problems is in data imbalance problem that can occur when the number of instances in one class greatly outnumbers the number of instances in the other class. Such data sets often cause a default classifier to be built due to skewed boundary and thus the reduction in the classification accuracy of such a classifier. SVM ensemble learning is one of machine learning methods to cope with the above drawbacks. Ensemble learning is a method for improving the performance of classification and prediction algorithms. AdaBoost is one of the widely used ensemble learning techniques. It constructs a composite classifier by sequentially training classifiers while increasing weight on the misclassified observations through iterations. The observations that are incorrectly predicted by previous classifiers are chosen more often than examples that are correctly predicted. Thus Boosting attempts to produce new classifiers that are better able to predict examples for which the current ensemble's performance is poor. In this way, it can reinforce the training of the misclassified observations of the minority class. This paper proposes a multiclass Geometric Mean-based Boosting (MGM-Boost) to resolve multiclass prediction problem. Since MGM-Boost introduces the notion of geometric mean into AdaBoost, it can perform learning process considering the geometric mean-based accuracy and errors of multiclass. This study applies MGM-Boost to the real-world bond rating case for Korean companies to examine the feasibility of MGM-Boost. 10-fold cross validations for threetimes with different random seeds are performed in order to ensure that the comparison among three different classifiers does not happen by chance. For each of 10-fold cross validation, the entire data set is first partitioned into tenequal-sized sets, and then each set is in turn used as the test set while the classifier trains on the other nine sets. That is, cross-validated folds have been tested independently of each algorithm. Through these steps, we have obtained the results for classifiers on each of the 30 experiments. In the comparison of arithmetic mean-based prediction accuracy between individual classifiers, MGM-Boost (52.95%) shows higher prediction accuracy than both AdaBoost (51.69%) and SVM (49.47%). MGM-Boost (28.12%) also shows the higher prediction accuracy than AdaBoost (24.65%) and SVM (15.42%)in terms of geometric mean-based prediction accuracy. T-test is used to examine whether the performance of each classifiers for 30 folds is significantly different. The results indicate that performance of MGM-Boost is significantly different from AdaBoost and SVM classifiers at 1% level. These results mean that MGM-Boost can provide robust and stable solutions to multi-classproblems such as bond rating.

Integration of feature vector selection and support vector machine for classification of imbalanced data