A Robust Wi-Fi Fingerprint Positioning Algorithm Using Stacked Denoising Autoencoder and Multi-Layer Perceptron

Due to high costs, resources and managemant associated with readmission into Intensive Care Units (ICU), it has been a center of clinical research. Previous research successfully identified several common risk factors and proposed a variety of frameworks to predict ICU readmissions, whereas, some studies reported that many risk factors were too specific and/or had limited focus. This study aims to investigate and analyze if the relevance of ICU readmission risk factors may have changed overtime. We used MIMIC-III database with 42,307 ICU stays of 31,749 patients from a US hospital, related to medical services provided from 2001 to 2012. The dataset was initially split into two chronological subsets (2001–2008 and 2008–2012), and then split again into train (70%) and test (30%) datasets. The training datasets were rebalanced through undersampling technique. To identify if the most relevant risk factors changes over time, 13 variables (12 features and one class) were selected and a three-step machine learning approach was executed: (i) Numerical Analysis, to identify overall quantitative changes; (ii) Feature Correlation Value Analysis, to rank the most important risk factors in each subset and compare them to identify any significant changes; and (iii) Classifier Performance Analysis, to identify changes in the risk factors prediction capability, based on the three machine learning algorithms - Multilayer Perceptron, Random Forest and Support Vector Machine. When considering readmission rates, some changes were observed for patients using private insurance (variability of +3.0%) and first admitted in ICU through Medical Intensive Care Unit (−3.1%). Regarding the feature analysis, the two most relevant variables were the same in both datasets, having similar correlation value. When applying the machine learning algorithms in test datasets, the model presented similar results for both periods, achieving the best accuracy of 86.4%, and Area Under ROC Curve (AUC) of 0.642. The difference in AUC values between the first and the second periods varied up to 0.05 (better in the first dataset) and in accuracy up to 4% (better in the second period). Overall results indicate that the most relevant risk factors were stable over the years, with some minor changes. Further research is required to incorporate other readmission risk factors, such as social determinants and mental health and well-being.

A major objective of this project was to apply GE’s commercial machine learning and data analytics toolsets to large-scale, real-world, anonymized Phasor Measurement Unit (PMU) datasets in order to extract signatures, correlated and/or causal factors, and precursor patterns associated with significant power system phenomena. The project had a particular emphasis on extraction of insights relevant to asset health monitoring, real-time load modeling and cybersecurity monitoring. Additionally, the team was directed to undertake a comprehensive data quality analysis for the provided datasets and encouraged to estimate the ‘machine-learning readiness’ of the datasets by documenting any major obstacles to the application of commercial machine learning algorithms. To accomplish the aforementioned objectives, the project team’s work centered around the identification of key event signatures and application of the identified event signatures for event detection and event classification. The industry-validated, semi-supervised machine learning strategy employed for event signature identification involved several major tasks, including data-preprocessing, generation of an overabundance of features, normal data identification, normality modeling, and event signature identification through a methodical, quantitative ranking of features in order of relevance to each studied event type. Throughout the project, data quality issues and mitigation techniques were investigated. In this report, insights are provided regarding the readiness of the provided synchrophasor datasets for application of machine learning and data analytics. The methodologies employed for this technical strategy are summarized in this report. With regards to data preprocessing and feature generation, the provided Training and Test Datasets were ingested into GE’s big data environment. Subsequently, the team applied bad data cleansing and data imputation scripts, event detection scripts, and application programming interfaces (APIs) to the datasets for convenient data access. The project team completed development and validation of dozens of physics-based, statistics-based and transformation-based feature functions used for the extraction of over 60 synchrophasor features. Using a new parallel feature generation technology developed on this project, over 60 features have been rapidly generated for the full two years’ worth of Training and Test Dataset data associated with both the Eastern and Western interconnects. Even accommodating for temporal down-sampling inherent to the feature extraction procedure, this parallel feature generation activity resulted in a massive feature set with a storage requirement approximately equal to that of the raw training dataset itself. With regards to normal data identification and normality modeling, a normality model was built using the feature data extracted from the Training Dataset and iteratively refined subsequent to incremental adjustments and expansions of the Training Dataset feature data. With respect to event characterization and signature identification, an event signature identification pipeline was developed and used in conjunction with the normality model to identify over 15 event signatures for key event categories within the Training Dataset. The identified event signatures were used to characterize hundreds of key events in terms of relative severity, duration, and location of the event. An investigation was undertaken to identify correlated and causal factors involved in transformer events. A separate investigation into temporal trends in ring-down analysis results was undertaken to determine possible associations between system dynamics and various other factors such as loading, season or year. To validate the identified event signatures, additional work was undertaken to develop signature-based anomaly detection and classification tools suitable for convenient application to the synchrophasor datasets. The anomaly detection and classification tools, suitable for online application, were then applied to the entirety of the Eastern Interconnect Training and Test Datasets. Performance of the event detection and classification tools was evaluated upon receipt of the Test Dataset event logs (i.e., the labels for events contained in the Test Dataset), and promising results were obtained despite several challenges (documented herein) associated with application of supervised or semi-supervised machine learning methods to large-scale, anonymized datasets. Finally, the detection and classification tools were used to detect, classify, and characterize thousands of new events not included in the original event logs provided by the DOE within both the Training and Test Datasets.

Machine learning models play a vital role in the prediction task in several fields of study. In this work, we utilize the ability of machine learning algorithms to predict the occurrence of extreme events in a nonlinear mechanical system. Extreme events are rare events that occur ubiquitously in nature. We consider four machine learning models, namely Logistic Regression, Support Vector Machine, Random Forest and Multi-Layer Perceptron in our prediction task. We train these four machine learning models using training set data and compute the performance of each model using the test set data. We show that the Multi-Layer Perceptron model performs better among the four models in the prediction of extreme events in the considered system. The persistent behaviour of the considered machine learning models is cross-checked with randomly shuffled training set and test set data.

Rating is one of the most frequently used metrics in the television industry to evaluate television programs or channels. This research is an attempt to develop a prediction model of television program ratings using rating data gathered from UseeTV (interned-based television service from Telkom Indonesia). The machine learning methods (Random Forest and Extreme Gradient Boosting) were tried out utilizing a set of rating data from 20 television programs collected from January 2018 to August 2019 (train dataset) and evaluated using September 2019 rating data (test dataset). Research results show that Random Forest gives a better result than Extreme Gradient Boosting based on evaluation metrics: Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Mean Absolute Percentage Error (MAPE). On the training dataset, prediction using Random Forest produced lower RMSE and MAE scores than Extreme Gradient Boosting in all programs, while on the testing dataset, Random Forest produced lower RMSE and MAE scores in 16 programs compared with Extreme Gradient Boosting. According to MAPE score, Random Forest produced more good quality prediction (4 programs in the training dataset, 16 programs in the testing dataset) than Extreme Gradient Boosting method (1 program in the training dataset, 12 programs in the testing dataset) both in training and testing dataset.

In recent years, Recommender System (RS) research work has covered a wide variety of Artificial Intelligence techniques, ranging from traditional Matrix Factorization (MF) to complex Deep Neural Networks (DNN). Traditional Collaborative Filtering (CF) recommendation methods such as MF, have limited learning capabilities as it only considers the linear combination between user and item vectors. For learning non-linear relationships, methods like Neural Collaborative Filtering (NCF) incorporate DNN into CF methods. Though, CF methods still suffer from cold start and data sparsity. This paper proposes an improved hybrid-based RS, namely Neural Matrix Factorization++ (NeuMF++), for effectively learning user and item features to improve recommendation accuracy and alleviate cold start and data sparsity. NeuMF++ is proposed by incorporating effective latent representation into NeuMF via Stacked Denoising Autoencoders (SDAE). NeuMF++ can also be seen as the fusion of GMF++ and MLP++. NeuMF is an NCF framework which associates with GMF (Generalized Matrix Factorization) and MLP (Multilayer Perceptrons). NeuMF achieves state-of-the-art results due to the integration of GMF linearity and MLP non-linearity. Concurrently, incorporating latent representations has shown tremendous improvement in GMF and MLP, which result in GMF++ and MLP++. Latent representation obtained through the SDAEs' latent space allows NeuMF++ to effectively learn user and item features, significantly enhancing its learning capability. However, sharing feature extractions among GMF++ and MLP++ in NeuMF++ might hinder its performance. Hence, allowing GMF++ and MLP++ to learn separate features provides more flexibility and greatly improves its performance. Experiments performed on a real-world dataset have demonstrated that NeuMF++ achieves an outstanding result of a test root-mean-square error of 0.8681. In future work, we can extend NeuMF++ by introducing other auxiliary information like text or images. Different neural network building blocks can also be integrated into NeuMF++ to form a more robust recommendation model.

BackgroundCerebral arteriovenous malformation (AVM) is a cerebrovascular disorder posing a risk for intracranial hemorrhage. However, there are few reliable quantitative indices to predict hemorrhage risk accurately. This study aimed to...

IFN-signaling gene (ISG) expression scores are potential markers of inflammation with significance from cancer to genetic syndromes. In Aicardi Goutières Syndrome (AGS), a disorder of abnormal DNA and RNA metabolism, this score has potential as a diagnostic biomarker, although the approach to ISG calculation has not been standardized or validated. To optimize ISG calculation and validate ISG as a diagnostic biomarker, mRNA levels of 36 type I IFN response genes were quantified from 997 samples (including 334 AGS), and samples were randomized into training and test data sets. An independent validation cohort (n = 122) was also collected. ISGs were calculated using all potential combinations up to 6 genes. A 4-gene approach (IFI44L, IFI27, USP18, IFI6) was the best-performing model (AUC of 0.8872 [training data set], 0.9245 [test data set]). The majority of top-performing gene combinations included IFI44L. Performance of IFI44L alone was 0.8762 (training data set) and 0.9580 (test data set) by AUC. The top approaches were able to discriminate individuals with genetic interferonopathy from control samples. This study validates the context of use for the ISG score as a diagnostic biomarker and underscores the importance of IFI44L in diagnosis of genetic interferonopathies.

The process of extracting meaningful rules from big and complex data is called data mining. Data mining has an increasing popularity in every field today. Data units are established in customer-oriented industries such as marketing, finance and telecommunication to work on the customer churn and acquisition, in particular. Among the data mining methods, classification algorithms are used in studies conducted for customer acquisition to predict the potential customers of the company in question in the related industry. In this study, bank marketing data set in UCI Machine Learning Data Set was used by creating models with the same classification algorithms in different data mining programs. Accuracy, precision and f- measure criteria were used to test performances of the classification models. When creating the classification models, the test and training data sets were randomly divided by the holdout method to evaluate the performance of the data set. The data set was divided into training and test data sets with the 60-40%, 75­25% and 80-20% separation ratios. Data mining programs used for these processes are the R, Knime, RapidMiner and WEKA. And, classification algorithms commonly used in these platforms are the k-nearest neighbor (k-nn), Naive Bayes, and C4.5 decision tree.

The role of pertinently diversified and balanced training as well as testing data sets in achieving the true performance of classifiers in predicting the antifreeze proteins

Prediction of Axillary Lymph Node Metastasis in Breast Cancer using Intra-peritumoral Textural Transition Analysis based on Dynamic Contrast-enhanced Magnetic Resonance Imaging

Purpose:To predict voxel‐level dose distribution and enable effective evaluation of cord dose sparing in spine SBRT.Methods:We present an active optical flow model (AOFM) to statistically describe cord dose variations and train a predictive model to represent correlations between AOFM and PTV contours. Thirty clinically accepted spine SBRT plans are evenly divided into training and testing datasets. The development of predictive model consists of 1) collecting a sequence of dose maps including PTV and OAR (spinal cord) as well as a set of associated PTV contours adjacent to OAR from the training dataset, 2) classifying data into five groups based on PTV's locations relative to OAR, two “Top”s, “Left”, “Right”, and “Bottom”, 3) randomly selecting a dose map as the reference in each group and applying rigid registration and optical flow deformation to match all other maps to the reference, 4) building AOFM by importing optical flow vectors and dose values into the principal component analysis (PCA), 5) applying another PCA to features of PTV and OAR contours to generate an active shape model (ASM), and 6) computing a linear regression model of correlations between AOFM and ASM.When predicting dose distribution of a new case in the testing dataset, the PTV is first assigned to a group based on its contour characteristics. Contour features are then transformed into ASM's principal coordinates of the selected group. Finally, voxel‐level dose distribution is determined by mapping from the ASM space to the AOFM space using the predictive model.Results:The DVHs predicted by the AOFM‐based model and those in clinical plans are comparable in training and testing datasets. At 2% volume the dose difference between predicted and clinical plans is 4.2±4.4% and 3.3±3.5% in the training and testing datasets, respectively.Conclusion:The AOFM is effective in predicting voxel‐level dose distribution for spine SBRT.Partially supported by NIH/NCI under grant #R21CA161389 and a master research grant by Varian Medical System.

Objective: To compare the performance of multiple machine learning algorithms in predicting recurrence after resection of early-stage hepatocellular carcinoma(HCC). Methods: Clinical data of 882 early-stage HCC patients who were admitted to the First Affiliated Hospital of Nanjing Medical University from May 2009 to December 2019 and treated with curative surgical resection were retrospectively collected. There were 701 males and 181 females,with an age of (57.3±10.5)years(range:21 to 86 years). All patients were randomly assigned in a 2∶1 ratio, the training dataset consisted of 588 patients and the test dataset consisted of 294 patients. The construction of machine learning-based prediction models included random survival forest(RSF),gradient boosting machine,elastic net regression and Cox regression model. The prediction accuracy of the model was measured by the concordance index(C-index). The prediction error of the model was measured by the integrated Brier score. Model fit was assessed by the calibration plot. The performance of machine learning models with that of rival model and HCC staging systems was compared. All models were validated in the independent test dataset. Results: Median recurrence-free survival was 61.7 months in the training dataset while median recurrence-free survival was 61.9 months in the validation dataset, there was no significant difference between two datasets in terms of recurrence-free survival(χ²=0.029,P=0.865). The RSF model consisted of 5 commonly used clinicopathological characteristics, including albumin-bilirubin grade,serum alpha fetoprotein,tumor number,type of hepatectomy and microvascular invasion. In both training and test datasets,the RSF model provided the best prediction accuracy,with respective C-index of 0.758(95%CI:0.725 to 0.791) and 0.749(95%CI:0.700 to 0.797),and the lowest prediction error,with respective integrated Brier score of 0.171 and 0.151. The prediction accuracy of RSF model for recurrence after resection of early-stage HCC was superior to that of other machine learning models,rival model(ERASL model) as well as HCC staging systems(BCLC,CNLC and TNM staging),with statistically significant difference(P<0.01). Calibration curves demonstrated good agreement between RSF model-predicted probabilities and observed outcomes.All patients could be stratified into low-risk,intermediate-risk or high-risk group based on RSF model;statistically significant differences among three risk groups were observed in both training and test datasets(all P<0.01). The risk stratification of RSF model was superior to that of TNM staging. Conclusion: The proposed RSF model assembled with 5 commonly used clinicopathological characteristics in this study can predict the recurrence risk with favorable accuracy that may facilitate clinical decision-support for patients with early-stage HCC.

Prediction of Recurrence using a Stacked Denoising Autoencoder and Multifaceted Feature Analysis of Pretreatment MRI in Patients with Nasopharyngeal Carcinoma.

Introduction: Brain is a major site of metastasis for lung cancer, and effective therapy for developed brain metastasis (BM) is limited. Prophylactic cranial irradiation (PCI) has been shown to reduce BM rate and improve survival in small cell lung cancer, but this result was not replicated in unselected non-small cell lung cancer (NSCLC) and had the risk of inducing neurocognitive dysfunctions. We aimed to develop a radiomics BM prediction model for BM risk stratification in NSCLC patients. Methods: 256 NSCLC patients with no BM at baseline brain magnetic resonance imaging (MRI) were selected; 128 patients developed BM within three years after diagnosis and 128 remained BM-free. For radiomics analysis, both the BM and non-BM groups were randomly distributed into training and testing datasets at an 70%:30% ratio. Both brain MRI (representing the soil) and chest computed tomography (CT, representing the seed) radiomic features were extracted to develop the BM prediction models. We first developed the radiomic models using the training dataset (89 non-BM and 90 BM cases) and subsequently validated the models in the testing dataset (39 non-BM and 38 BM cases). A radiomics BM score (RadBM score) was generated, and BM-free survival were compared between RadBM score-high and RadBM score-low groups. Results: The radiomics model developed from baseline brain MRI features alone can predict BM development in NSCLC patients. A fusion model integrating brain MRI features with primary tumor CT features (seed-and-soil model) provided synergetic effect and was more efficient in predicting BM (areas under the receiver operating characteristic curve 0.84 (95% confidence interval: 0.80−0.89) and 0.80 (95% confidence interval: 0.71−0.88) in the training and testing datasets, respectively). BM-free survival was significantly shorter in the RadBM score-high group versus the RadBM score-low group (Log-rank, p < 0.001). Hazard ratios for BM were 1.056 (95% confidence interval: 1.044−1.068) per 0.01 increment in RadBM score. Cumulative BM rates at three years were 75.8% and 24.2% for the RadBM score-high and RadBM score-low groups, respectively. Only 1.2% (7/565) of the BM lesions were located within the hippocampal avoidance region. Conclusion: The results demonstrated that intrinsic features of a non-metastatic brain exert a significant impact on BM development, which is first-in-class in metastasis prediction studies. A radiomics BM prediction model utilizing both primary tumor and pre-metastatic brain features might provide a useful tool for individualized PCI administration in NSCLC patients more prone to develop BM.

The P53-mutated Hepatocellular Carcinoma (HCC) is an aggressive variant associated with vascular endothelial growth factor (VEGF) overexpression and increased microvascular density. This study aimed to develop an MRI-based deep learning model for predicting P53-mutated HCC. A total of 312 HCC patients who underwent gadolinium-enhanced MRI and were pathologically confirmed between January 2018 and December 2023 were retrospectively enrolled. Participants were randomly divided into training and test dataset at an 8:2 ratio. We developed an EfficientNetV2-based deep learning model, constructing arterial phase (AP) model, portal venous phase (VP), T2-weighted imaging (T2WI), hepatobiliary phase (HBP) single-sequence model, and combined models to predict P53 mutation status. Model performance was evaluated using the area under the curve (AUC), accuracy, sensitivity, specificity, precision, and F1 score as metrics. Differences in AUC values were compared using Delong's test. A total of 312 pathologically confirmed HCC patients (age: 56 ± 9 years; male = 240) were included, with a training dataset (n = 249) and test dataset (n = 63).Among single-sequence models, the HBP model demonstrated superior diagnostic performance (AUC = 0.715) compared to T2WI, AP, and VP models. The multiphase combined model (T2WI + AP + VP) significantly outperformed single-sequence models, achieving AUCs of 0.982 (95% CI: 0.959-1.000) in the training dataset and 0.914 (95% CI: 0.819-1.000) in the test dataset. However, incorporating the HBP sequence into the combined model (T2WI + AP + VP + HBP) did not further improve diagnostic performance (P > 0.05). The combined model incorporating AP, VP, T2WI, and HBP sequences demonstrated numerically highest performance in predicting P53-mutated HCC.