Gaussian Processes for Natural Language Processing

We have analyzed 17 immunological parameters in 63 schizophrenia patients and 36 healthy volunteers. The parameters of humoral immunity, systemic level of the key cytokines of adaptive immunity, anti-inflammatory and pro-inflammatory cytokines, and other inflammatory markers were determined by enzyme immunoassay. Applied methods of machine learning covered the main group of approaches to supervised learning such as linear models (logistic regression), quadratic discriminant analysis (QDA), support vector machine (linear SVM, RBF SVM), k-nearest neighbors algorithm, Gaussian processes, naive Bayes classifier, decision trees, and ensemble models (AdaBoost, random forest, XGBoost). The importance of features for prediction from the best fold has been analyzed for the machine learning methods, which demonstrated the best quality. The most significant features were selected using 70% quantile threshold. The AdaBoost ensemble model with ROC AUC of 0.71±0.15 and average accuracy (ACC) of 0.78±0.11 has demonstrated the best quality on a 10-fold cross validation test sample. Within the frameworks of the present investigation, the AdaBoost model has shown a good quality of classification between the patients with schizophrenia and healthy volunteers (ROC AUC over 0.70) at a high stability of the results (σ less than 0.2). The most important immunological parameters have been established for differentiation between the patients and healthy volunteers: the level of some systemic inflammatory markers, activation of humoral immunity, pro-inflammatory cytokines, immunoregulatory cytokines and proteins, Th1 and Th2 immunity cytokines. It was for the first time that the possibility of differentiating schizophrenia patients from healthy volunteers was shown with the accuracy of more than 70% with the help of machine learning using only immune parameters.The results of this investigation confirm a high importance of the immune system in the pathogenesis of schizophrenia.

Breast cancer is a frequent cancer that develops when normal cells in the breast transform into malignant cells. Breast cancer can arise from glandular tissue, muscular tissue, or fatty tissue in the breast. Many variables contribute to the risk of breast cancer, including genetics, environmental exposure, food, and lifestyle. Breast cancer should be detected early through breast self-examination, regular clinical evaluation, and mammography to identify any abnormal changes, In recent years, early detection of breast cancer in women has emerged as a beacon of hope and a pivotal point in the treatment of this dangerous disease, and its timely identification has become paramount. Modern advancements in technology, especially artificial intelligence algorithms, have played a vital role in developing systems that facilitate automated disease detection, diagnosis, rapid response, and a reduced risk of fatalities. This paper delves into a comparative study of various machine learning (ML) techniques, namely logistic regression (LR), support vector machines (SVM), linear SVM, Gaussian Naive Bayes (GNB), and artificial neural networks (ANNs). The evaluation metrics used in this study are accuracy and elapsed time. The results show that Gaussian Naive Bayes achieved the highest accuracy of 94.07% in just 0.005495 seconds, outperforming SVM (91.85%), linear SVM (90.19%), logistic regression (87.04%), and ANN (37.04%). These findings highlight the potential of Gaussian Naive Bayes in aiding the early detection of breast cancer, leading to more effective and timely interventions, ultimately improving patient outcomes. Keywords: Breast Cancer, Machine learning (ML), Logistic Regression (LR), Support Vector Machine (SVM), Linear SVM, Gaussian Naive Bayes (GNB) and Artificial Neural Networks (ANNs).

This study examined records of 2566 consecutive COVID-19 patients at five Massachusetts hospitals and sought to predict level-of-care requirements based on clinical and laboratory data. Several classification methods were applied and compared against standard pneumonia severity scores. The need for hospitalization, ICU care, and mechanical ventilation were predicted with a validation accuracy of 88%, 87%, and 86%, respectively. Pneumonia severity scores achieve respective accuracies of 73% and 74% for ICU care and ventilation. When predictions are limited to patients with more complex disease, the accuracy of the ICU and ventilation prediction models achieved accuracy of 83% and 82%, respectively. Vital signs, age, BMI, dyspnea, and comorbidities were the most important predictors of hospitalization. Opacities on chest imaging, age, admission vital signs and symptoms, male gender, admission laboratory results, and diabetes were the most important risk factors for ICU admission and mechanical ventilation. The factors identified collectively form a signature of the novel COVID-19 disease.

Pressure gradient (PG) in liquid-liquid flow is one of the key components to design an energy-efficient transportation system for wellbores. This study aims to develop five robust machine learning (ML) algorithms and their fusions for a wide range of flow patterns (FP) regimes. The MLs include Support Vector Machine (SVM), Gaussian Process (GP), Random Forest (RF), Artificial Neural Network (ANN), k-Nearest Neighbor (kNN), and fusions of these five MLs. A total of eleven hundred experimental data points for nine FPs (two stratified and seven dispersed patterns) in horizontal wellbores are used to develop the MLs. The MLs' performance is evaluated using the metrics including mean absolute percentage error (MAPE), median absolute percentage error (MdAPE), coefficient of variation of root mean squared error (CV-RMSE), and adjusted coefficient of determination. The evaluation metrics are cross-validated using a repeated train-test split strategy. Seven important predictor variables are identified using a supervised feature selection approach: oil and water velocities, FP, input diameter, oil and water density, and oil viscosity. The results show that the high PG prediction accuracy can be achieved using GP compared to other MLs except for the ML-fusions (p < 0.05). A Friedman's test and Wilcoxon Sign-Rank post hoc analysis with Bonferroni correction show that PG prediction errors using GP are significantly lower than using the ANN model (p < 0.05). The values are 18.44 % and 23.9 % for CV-RMSE, 11.6 % and 10.06 % for MAPE, and 7.5 % and 6.75 % for MdAPE, using ANN and GP, respectively. While the previous studies mostly used ANN to demonstrate the capability of MLs to predict PG over the mechanistic or correlation-based models, the present research has shown that GP is even better than ANN using a wide range of FPs and a large data set. • Machine-learning algorithms are developed to predict the pressure gradient. • The Gaussian Process model produces significantly lower prediction error. • The median absolute percentage error using Gaussian Process is 6.75 %. • More than 95 % variation of pressure gradient can be explained using seven variables.

Machine learning framework for predicting failure mode and shear capacity of ultra high performance concrete beams

Recently there has been a rapidly growing demand for faster machine learning (ML) processing in data centers and migration of ML inference applications to edge devices. These developments have prompted both industry and academia to explore custom accelerators to optimize ML executions for performance and power. However, identifying which accelerator is best equipped for performing a particular ML task is challenging, especially given the growing range of ML tasks, the number of target environments, and the limited number of integrated modeling tools. To tackle this issue, it is of paramount importance to provide the computer architecture research community with a common framework capable of performing a comprehensive, uniform, and fair comparison across different accelerator designs targeting a particular ML task. To this aim, we propose a new framework named TFLITE-SOC (System On Chip) that integrates a lightweight system modeling library (SystemC) for fast design space exploration of custom ML accelerators into the build/execution environment of Tensorflow Lite (TFLite), a highly popular ML framework for ML inference. Using this approach, we are able to model and evaluate new accelerators developed in SystemC by leveraging the language's hierarchical design capabilities, resulting in faster design prototyping. Furthermore, any accelerator designed using TFLITE-SOC can be benchmarked for inference with any DNN model compatible with TFLite, which enables end-to-end DNN processing and detailed (i.e., per DNN layer) performance analysis. In addition to providing rapid prototyping, integrated benchmarking, and a range of platform configurations, TFLITE-SOC offers comprehensive performance analysis of accelerator occupancy and execution time breakdown as well as a rich set of modules that can be used by new accelerators to implement scaling up studies and optimized memory transfer protocols. We present our framework and demonstrate its utility by considering the design space of a TPU-like systolic array and describing possible directions for optimization. Using a compression technique, we implement an optimization targeting reducing the memory traffic between DRAM and on-device buffers. Compared to the baseline accelerator, our optimized design shows up to 1.26x speedup on accelerated operations and up to 1.19x speedup on end-to-end DNN execution.

QSPR modeling of bioconcentration factor of nonionic compounds using Gaussian processes and theoretical descriptors derived from electrostatic potentials on molecular surface

Purpose. The goal of this paper is to build a simulation environment that allows for the prediction of patient-specific tissue response by drawing samples from a generative model with a probability distribution. We propose a Gaussian Process (GP) regression approach to learn distributions over strain energy density functions including elastography, linear and hyperelastic models reported in the literature. Methods. We gather a total of 73 models characterising elastic properties of brain white matter, grey matter and abnormalities and express them as strain energy density functions. A multi-output GP is used to quantify means and confidence intervals across each anatomical region and model. We sample the GP distribution and use nonlinear optimisation to fit a Neo-Hookean meta-model to guarantee stable strain energy functions. We validate the Neo-Hookean meta-model by fitting known strain energy density functions from the literature and report optimisation cost. We also validate the ability of the GP to approximate elastic properties of tissue given a reference deformed state using simulation. Results. The GP was able to capture confidence intervals of varying strain ranges; the GP parameters and optimisation costs indicated a higher variability of hyperelastic models compared to elastography and linear models. Although one term is insufficient to fully capture hyperelastic models with higher number of terms, the resulting meta model is stable for real-time simulation within a wider range of stretches captured during mechanical characterisation of soft tissue. We demonstrated that our approach was able to approximate known elastic properties of tissue with a root-mean-squared error of 0.6 mm of node displacements when drawing six samples from a distribution of hyperelastic white matter. Conclusion. In this initial proof-of-concept, we demonstrated a GP-based approach to estimate the elastic behaviour of brain tissue through simulation by sampling a generative model comprising elastic models found in the literature.

We can state undoubtedly that Bangla language is rich enough to work with and implement various Natural Language Processing (NLP) tasks. Though it needs proper attention, hardly NLP field has been explored with it. In this age of digitalization, large amount of Bangla news contents are generated in online platforms. Some of the contents are inappropriate for the children or aged people. With the motivation to filter out news contents easily, the aim of this work is to perform document level sentiment analysis (SA) on Bangla online news. In this respect, the dataset is created by collecting news from online Bangla newspaper archive. Further, the documents are manually annotated into positive and negative classes. Composite process technique of “Pipeline” class including Count Vectorizer, transformer (TF-IDF) and machine learning (ML) classifiers are employed to extract features and to train the dataset. Six supervised ML classifiers (i.e. Multinomial Naive Bayes (MNB), K-Nearest Neighbor (K-NN), Random Forest (RF), (C4.5) Decision Tree (DT), Logistic Regression (LR) and Linear Support Vector Machine (LSVM)) are used to analyze the best classifier for the proposed model. There has been very few works on SA of Bangla news. So, this work is a small attempt to contribute in this field. This model showed remarkable efficiency through better results in both the validation process of percentage split method and 10-fold cross validation. Among all six classifiers, RF has outperformed others by 99% accuracy. Even though LSVM has shown lowest accuracy of 80%, it is also considered as good output. However, this work has also exhibited surpassing outcome for recent and critical Bangla news indicating proper feature extraction to build up the model.

Machine learning techniques have long been the foundations of speech processing. Bayesian classiflcation, decision trees, unsupervised clustering, the EM algorithm, maximum entropy, etc. are all part of existing speech recognition systems. The success of statistical speech recognition has led to the rise of statistical and empirical methods in natural language processing. Indeed, many of the machine learning techniques used in language processing, from statistical part-of-speech tagging to the noisy channel model for machine translation have roots in work conducted in the speech fleld. However, advances in learning theory and algorithmic machine learning approaches in recent years have led to signiflcant changes in the direction and emphasis of the statistical and learning centered research in natural language processing and made a mark on natural language and speech processing. Approaches such as memory based learning, a range of linear classiflers such as Boosting, SVMs and SNoW and others have been successfully applied to a broad range of natural language problems, and these now inspire new research in speech retrieval and recognition. We have seen an increasingly close collaboration between voice and language processing researchers in some of the shared tasks such as spontaneous speech recognition and understanding, voice data information extraction, and machine translation. The purpose of this special issue was to invite speech and language researchers to communicate with each other, and with the machine learning community on the latest machine learning advances in their work. The call for papers was met with great enthusiasm from the speech and natural language community. Thirty six submissions were received; each paper was reviewed by at least three reviewers. Only ten papers were selected re∞ecting not only some of the best work on machine learning in the areas of natural language and spoken language processing but also what we view as a collection of papers that represent current trends in these areas of research both from the perspective of

Gaussian processes (GPs) are natural generalisations of multivariate Gaussian random variables to infinite (countably or continuous) index sets. GPs have been applied in a large number of fields to a diverse range of ends, and very many deep theoretical analyses of various properties are available. This paper gives an introduction to Gaussian processes on a fairly elementary level with special emphasis on characteristics relevant in machine learning. It draws explicit connections to branches such as spline smoothing models and support vector machines in which similar ideas have been investigated. Gaussian process models are routinely used to solve hard machine learning problems. They are attractive because of their flexible non-parametric nature and computational simplicity. Treated within a Bayesian framework, very powerful statistical methods can be implemented which offer valid estimates of uncertainties in our predictions and generic model selection procedures cast as nonlinear optimization problems. Their main drawback of heavy computational scaling has recently been alleviated by the introduction of generic sparse approximations.13,78,31 The mathematical literature on GPs is large and often uses deep concepts which are not required to fully understand most machine learning applications. In this tutorial paper, we aim to present characteristics of GPs relevant to machine learning and to show up precise connections to other "kernel machines" popular in the community. Our focus is on a simple presentation, but references to more detailed sources are provided.

The rapid growth of diverse clinical data, such as electronic health records (EHRs), lab results, and medical imaging, has opened new possibilities for data-driven decision-making in healthcare. However, issues with data quality, model interpretability, and workflow integration have hindered the safe and effective use of machine learning (ML) in clinical settings. This paper presents a clear multimodal ML framework for real-time clinical decision-making. It combines structured EHR data, lab tests, and imagingderived features to aid in diagnosis, risk prediction, and personalized treatment planning. The framework integrates supervised learning models, including Random Forest, Gradient Boosting Machines, Support Vector Machines, and Logistic Regression, along with unsupervised techniques like k-means clustering and Principal Component Analysis. This setup allows for both predictive modelling and patient grouping. We use strong preprocessing, feature selection, and cross-validation to manage missing data, reduce overfitting, and improve generalization. Model performance is measured using metrics such as accuracy, precision, recall, F1-score, and AUC-ROC, with Random Forest and Gradient Boosting showing the best results overall. To meet the important need for transparency, we include SHAP (Shapley Additive explanations) to provide explanations of model outputs, both globally and at the patient level. This helps clinicians understand the main factors behind predictions and builds trust in the system’s recommendations. The proposed framework is made for easy integration into current clinical workflows and allows for near real-time updates as new patient data come in. Overall, this work shows that a clear, multimodal ML framework can improve clinical decision-making and sets the stage for future evaluations and broader use in healthcare.

Abstract: A significant challenge in women’s health is posed by Polycystic Ovary Syndrome (PCOS) because it is a difficult disorder to comprehend and exhibits various symptoms. Thisresearch project suggests the creation of a computerized prediction scheme for PCOS using machine learning algorithms and bioinformatics tools. The aim of this system is to give personalized risk assessment to women thus enabling early detection, and proactive management of PCOS. It combines other intelligible probabilities about PCOS with the use of user provided health data with Machine Learning models such as Random Forest, Logistic Regression, Support Vector Machine, Naive Bayes, Radial SVM, Linear SVM and KNeighbours Classifier. Additionally, it provides intuitive predictions regarding PCOS likelihood through ML models, which are based on Random Forest, Logistic Regression, Support Vector Machine (SVM), Naive Bayes (NB), Radial SVM (RSVM), Linear SVM (LSVM) and KNeighbours Classifier (KNC). By way of thorough assessment as well as comparison within these models the system intends to improve precision together with reliability during prediction of PCOS. The major objective is therefore to enable timely intervention along with individualized healthcare strategies that will promote better health outcomes for all women.

Optimization and comparison of models for core temperature prediction of mother rabbits using infrared thermography

The rapid proliferation of misinformation across online platforms poses a challenge that calls for advanced real-time detection and verification mechanisms. Most existing methods depend on some form of user inspection or centralized system which tends to be slow, biased, and subjective. In this paper, we address these gaps by integrating Natural Language Processing (NLP), Machine Learning (ML), and blockchain technology in a single novel framework. The system functions through three primary processes: event detection, trust evaluation, and validation through blockchain. In the primary step, NLP models examine data streams like news articles, tweets, and forum posts to capture major events across diverse areas including politics, finance, healthcare, and natural disasters. The second step applies ML algorithms to evaluate the identified events based on source credibility, narrative reliability, and factual consistency analysis. In the last stage, the verification process is facilitated through the use of blockchain technology which assures transparency, immutability, decentralization, and security by recording verified events alongside their trust scores on a blockchain ledger. This multi-disciplinary approach not only enhances accuracy and boosts accountability but also streamlines real-time processing while tackling the challenges of trusted event detection and verification. By applying NLP, ML, and blockchain, this paper proposes a new paradigm of trust enhancement for digital information.