On the Integration of Deep Learning and Fuzzy Methods for Aspect-based Sentiment Analysis

PurposeTo differentiate complicated appendicitis (CA) from uncomplicated appendicitis (UA) in children, we developed and validated an artificial intelligence (AI) model using a multimodal approach integrating ultrasound images and clinical data.MethodsA retrospective analysis was performed on 372 pathologically confirmed pediatric appendicitis cases (230 male, 142 female) from three centers, all with preoperative abdominal ultrasound. Deep learning (DL) features and radiomic features were extracted from appendiceal ultrasound images using deep transfer learning (DTL) and conventional radiomic methods, respectively. We selected 12 radiomic features, 9 DL features, and 3 clinical features—namely, white blood cell count (WBC), neutrophil count (NEU), and C-reactive protein (CRP)—for building the machine learning classification model. Based on these features, four distinct models were constructed: the Rad model (radiomic features only), the DL model (DL features only), the DTL model (combined radiomic and DL features), and the Combine model (integrating all three feature types: radiomic, DL, and clinical features). Model performance was evaluated using receiver operating characteristic (ROC) curves, decision curve analysis (DCA), and the DeLong test. Finally, the combined model was compared to the performance of clinicians with varying levels of experience.ResultsThe combined model demonstrated consistently favorable performance across all cohorts (AUC: 0.940, 0.895, 0.866, and 0.783 for training and validation sets, respectively). The model's accuracy (0.862) and positive predictive value (0.896) were comparable to senior surgeons (0.741, 0.970) and superior to junior surgeons (0.672, 0.865) in the internal validation cohort. DCA confirmed the clinical utility of the combined model over conventional strategies.ConclusionOur ultrasound-based AI model provides reliable differentiation between CA and UA in children, offering potential value as a diagnostic support tool for clinical decision making.

Rationale and ObjectivesAccurate prediction of microvascular invasion (MVI) in hepatocellular carcinoma (HCC) is crucial for guiding treatment. This study evaluates and compares the performance of clinicoradiologic, traditional radiomics, deep learning radiomics, feature fusion, and decision fusion models based on multi-region MR habitat imaging using six machine learning classifiers. Materials and MethodsWe retrospectively included 300 HCC patients. The intratumoral and peritumoral regions were segmented into distinct habitats, from which radiomics and deep learning features were extracted using arterial phase MR images. To reduce feature dimensionality, we applied intra-class correlation coefficient (ICC) analysis, Pearson correlation coefficient (PCC) filtering, and recursive feature elimination (RFE). Based on the selected optimal features, prediction models were constructed using decision tree (DT), K-nearest neighbors (KNN), logistic regression (LR), random forest (RF), support vector machine (SVM), and XGBoost (XGB) classifiers. Additionally, fusion models were developed utilizing both feature fusion and decision fusion strategies. The performance of these models was validated using the area under the receiver operating characteristic curve (ROC AUC), calibration curves, and decision curve analysis. ResultsThe decision fusion model (VOI-Peri10-1) using LR and integrating clinicoradiologic, radiomics, and deep learning features achieved the highest AUC of 0.808 (95% confidence interval [CI]: 0.807–0.912) in the test cohort, with good calibration (Hosmer-Lemeshow test, P > 0.050) and clinical net benefit. ConclusionThe LR-based decision fusion model integrating clinicoradiologic, radiomics, and deep learning features shows promise for preoperative prediction of MVI in HCC, aiding in patient outcome predictions and personalized treatment planning.

An integrated model combined intra- and peritumoral regions for predicting chemoradiation response of non small cell lung cancers based on radiomics and deep learning

Radiation-induced acute rectal injury (RARI) is a common early toxicity after radiotherapy for cervical cancer (CC) and remains difficult to predict before treatment, which can adversely affect life quality of patients. We aimed to develop a combined dual-radiomics and deep learning (DL) model to improve the prediction of RARI in CC patients treated with radiotherapy. This retrospective study included 200 CC patients from one hospital, randomly divided into training (n=160), internal validation (n=40) cohorts and external validation (n=40) from another hospital. Patients were classified as RARI (CTCAE v5.0 grade≥2) or Non-RARI (grade<2). Radiomic and dosiomic features were extracted from CT images and dose distributions, and DL features were learned using 3D CNNs. The performance of radiomics, dosiomics, DL and hybrid features models for RARI prediction was compared using the receiver operating characteristic (ROC) curve with measurement of the area under the curve (AUC). For radiomics combining dosiomics, XGBoost achieved the best performance with AUCs of 0.786 and 0.755 in internal and external validation cohorts, respectively. For DL, Resnet_with_CBAM achieved the best performance in the input of combining CT and dose distribution with AUCs of 0.786 and 0.773 in internal and external validation cohorts, respectively. Nomogram integrating radiomics, dosiomics, DL features, and clinical factor improved the AUC to 0.810, 0.803 in internal and external validation cohorts, respectively. The nomogram integrating radiomics, dosiomics, DL, and clinical factors can improve the predictive performance for RARI in CC patients followed by radiotherapy.

Deep learning and transformer-based feature fusion of conventional MRI for differentiating spinal osteolytic bone metastases and multiple myeloma.

BackgroundThe subjective assessment of Breast Imaging Reporting and Data System (BI-RADS) 4A lesions leads to a high number of unnecessary biopsies, highlighting the need for more objective and accurate diagnostic tools. This study aimed to construct and validate a novel multimodal framework that integrates deep learning (DL), radiomics, and clinical and breast ultrasound (US) features to distinguish between benign and malignant breast lesions classified as BI-RADS 4A.MethodsA total of 935 patients with pathologically confirmed BI-RADS 4A lesions were retrospectively enrolled and randomly divided into a training cohort (n=654) and an internal validation cohort (n=281). An additional 488 patients were enrolled as the external validation cohort. DL and radiomics models were developed with the light gradient boosting machine (LightGBM) algorithm, a machine learning technique known for its efficiency in handling high-dimensional data. Univariate and multivariate logistic regression (LR) analyses identified significant clinical and US features. After handcrafted radiomics features, DL features, and clinical/breast US features were combined, dimensionality reduction and feature selection were performed. The integrated model was developed via LightGBM, and the SHapley Additive Explanations (SHAP) approach was applied to rank feature contributions.ResultsThe integrated model achieved robust discrimination between benign and malignant BI-RADS 4A lesions, with an area under the curve (AUC) of 0.938, 0.870, and 0.861 for the training cohort, internal validation cohort, and external validation cohort, respectively. Furthermore, in the external validation cohort, the integrated model significantly outperformed the handcrafted radiomics model (AUC =0.719; P<0.001) and the DL model (AUC =0.763; P=0.011). Decision curve analysis confirmed that the integrated model was the most clinically useful across the three cohorts.ConclusionsThe integrated model demonstrated high accuracy in differentiating between benign and malignant BI-RADS 4A lesions, exhibiting the ability to significantly reduce unnecessary biopsies while maintaining diagnostic accuracy.

BackgroundIdentifying predictive markers for immunotherapy in non-small cell lung cancer (NSCLC) is critical for personalized treatment. This study aimed to construct a predictive model that integrates clinical features, enhanced computed tomography (CT)-radiomics, and deep learning (DL) features for the assessment of durable clinical benefit (DCB) from immunotherapy in patients with advanced NSCLC and to provide biological interpretability to predictions by integrating radiogenomic data.MethodsWe conducted a retrospective analysis of 201 advanced NSCLC patients who underwent immunotherapy with CT images, with data supplemented from The Cancer Imaging Archive (TCIA). Radiomics features (RFs) were extracted from enhanced CT images, and DL features were derived using a pre-trained ResNet-34 model. DCB-related signatures were constructed using the least absolute shrinkage and selection operator (LASSO) algorithm, and fusion nomogram models were developed by integrating significant clinical variables, radiomics, and DL features. Shapley additive explanations were employed to quantify the impact of radiomics-DL features on model predictions. Gene set enrichment and biological correlation analyses based on transcriptomic TCIA data were performed to explore the biological significance of radiomics-DL score.ResultsStatistically significant clinical predictors included initial efficacy, brain metastases, programmed death-ligand 1 (PD-L1) expression, and hemoglobin levels. The fusion nomogram model demonstrated the highest predictive accuracy for DCB, with area under the curve (AUC) values of 0.843 in the train cohort and 0.894 in the test cohort, surpassing individual feature sets. Biological exploration revealed associations between radiomics-DL score and biological characteristics, including immune responses and immunoregulation.ConclusionsThis integrated approach shows the potential of combining clinical, radiomics and deep learning features (DLFs) as a noninvasive biomarker for predicting immunotherapy efficacy in NSCLC, assisting in patient selection and clinical decision-making. Radiotranscriptomic analysis may reveal key cellular and immune patterns associated with radiomics-DL signature.

Fault diagnosis is important for the maintenance of rotating machinery. The detection of faults and fault patterns is a challenging part of machinery fault diagnosis. To tackle this problem, a model for deep statistical feature learning from vibration measurements of rotating machinery is presented in this paper. Vibration sensor signals collected from rotating mechanical systems are represented in the time, frequency, and time-frequency domains, each of which is then used to produce a statistical feature set. For learning statistical features, real-value Gaussian-Bernoulli restricted Boltzmann machines (GRBMs) are stacked to develop a Gaussian-Bernoulli deep Boltzmann machine (GDBM). The suggested approach is applied as a deep statistical feature learning tool for both gearbox and bearing systems. The fault classification performances in experiments using this approach are 95.17% for the gearbox, and 91.75% for the bearing system. The proposed approach is compared to such standard methods as a support vector machine, GRBM and a combination model. In experiments, the best fault classification rate was detected using the proposed model. The results show that deep learning with statistical feature extraction has an essential improvement potential for diagnosing rotating machinery faults.

The deep convolutional neural network has been extensively applied for clinical computer-aided diagnosis. In this study, we combine deep learning feature extraction and eXtreme gradient boosting (XGBoost) classifier for predicting the risk of esophageal varices (EV). First, the quantitative deep learning features and radiomics features of the regions of interest which includes spleen, liver and esophageal are extracted and concatenated. Then, XGBoost and the Least Absolute Shrinkage and Selection Operator (LASSO) are applied for the optimal predictive features selection and prediction of EV risk. XGBoost is used to assess the significance of the extracted features and LASSO is used to select the distinctive features. Finally, random forest, XGBoost and support vector machine classification methods are applied for predicting the low-risk and high-risk of esophageal varices. We collected computed tomography images of cirrhotic patients in two hospitals as the independent training and validation sets. Experimental results show that the features of esophageal are more distinctive than that of other organs. Moreover, the combination of deep learning and radiomics features based on XGBoost algorithm has outperforming classification performance in predicting the severity of EV disease compared to existing approaches.KeywordsEsophageal varicesDeep learningRadiomicsXGBoost

Non-small cell lung cancer is the most common type of lung cancer, and the most common genetic markers for it are mutation of the epidermal growth factor receptor gene (EGFR) and the Kirsten rat sarcoma (KRAS) gene. The objective of this paper was to predict the EGFR and KRAS mutation status, given CT features, by using machine learning models. Features extracted from 144 CT scans of the tumor area included statistical, shape, pathological, and deep learning features. The ResNet-34 neural network was used to extract deep learning features. All features were fed into machine learning models (random forest, logistic regression, support vector machine) and evaluated with 10-fold cross validation, confusion matrices, and the area under the ROC curves. P-values were calculated through t-testing and Mann-Whitley rank-sum testing, proving a significant statistical difference between mutated and non mutated genes. Between predicting EGFR and KRAS mutations, all machine learning models performed better in predicting EGFR mutations. In predicting EGFR mutation, the logistic regression (AUC =0.85) and support vector machine (AUC =0.84) machine learning models performed best. In predicting KRAS mutations, the machine learning models performed sub-optimally, with the best performance from the support vector machine (AUC =0.73). By calculating permutation feature importance, it can be seen that the inclusion of deep learning features aided in the machine learning models' performance.Overall, machine learning algorithms, if optimized and provided with more data, could prove useful in predicting EGFR and KRAS mutation status in NSCLC patients, saving time and money.

The purpose of this study was to explore whether the Nomogram, which was constructed by combining the Deep learning and Radiomic features of T2-weighted MR images with Clinical factors (NDRC), could accurately predict placenta invasion. This retrospective study included 72 pregnant women with pathologically confirmed placenta invasion and 40 pregnant women with normal placenta. After 24 gestational weeks, all participants underwent magnetic resonance imaging. The uterus and placenta regions were segmented in magnetic resonance images on sagittal T2WI. Ninety-three radiomics features were extracted from the placenta region, and 128 deep features were extracted from the uterus region using a deep neural network. The least absolute shrinkage and selection operator (LASSO) algorithm was used to filter these 221 features and to form the combined signature. Then the combined signature (CS) and clinical factors were combined to construct a nomogram. The accuracy, sensitivity, specificity and AUC of the nomogram were compared with four machine learning methods. The model NDRC was trained on the dataset of 78 pregnant women in the training cohort. Finally, the model NDRC was compared with four machine learning methods on the independent validation cohort of 34 pregnant women. The results showed that the prediction accuracy, sensitivity, specificity and AUC of the NDRC model were 0.941, 0.952, 0.923 and 0.985 respectively, which outperforms the traditional machine learning methods which rely on radiomics features and deep learning features alone.

To explore and compare the potential value of radiomics models based on contrast-enhanced computed tomography (CT) for noninvasive preoperative prediction of lymphovascular invasion (LVI) in laryngeal squamous cell carcinoma (LSCC). This multicenter diagnostic study retrospectively enrolled patients with LSCC from three tertiary hospitals who underwent surgical treatment. Standardized preprocessing was performed on the CT images, followed by region-of-interest segmentation and extraction of traditional radiomics features and deep learning (DL) features. Features were selected using least absolute shrinkage and selection operator (LASSO) regression. Traditional radiomics models and deep learning radiomics (DLR) models were established using logistic regression, random forest, and multilayer perceptron algorithms, respectively. A transformer-based hybrid model was developed by integrating radiomics and DL features. The predictive performance of the three types of models was evaluated and compared using the area under the curve (AUC), decision curve analysis (DCA), sample probability distribution histograms, confusion matrices, calibration curves, net reclassification index (NRI), and integrated discrimination improvement (IDI). A total of 1024 patients were allocated to the training set (center1, n =291), internal validation set ( n =126), and external test sets (Center 2, n =437; Center 3, n =170). Three radiomics models and three DLR models were constructed, and the optimal performance was observed in the DLR_ Random Forest model (AUC: 0.812-0.867). The transformer hybrid model demonstrated superior predictive performance, with AUC values of 0.881, 0.843, 0.833, and 0.836 in the training, internal validation, and external test sets, respectively. DCA indicated a higher net benefit for the Transformer model, along with an improved NRI and IDI. Radiomics models based on CT images exhibit potential for noninvasive prediction of LVI in LSCC, with the transformer hybrid model achieving the highest diagnostic performance. This approach may provide clinicians with a preoperative decision support tool to optimize treatment strategies for patients with LSCC.

The plethora of online reviews available on the internet has great insights about various products or entities. However, selecting or recommending a product by sifting through these reviews is a tedious and time consuming task. Sentiment analysis of such reviews helps understand the pros or cons of the product. In recent years researchers and industry people have leveraged such reviews to rank or recommend the products to new users. Ranking or recommending products using text reviews is a challenging task. In this study, we propose a framework to get a ranking of products using aspect-based sentiment analysis (ABSA). ABSA is a fine-grained sentiment analysis task that is useful for extracting opinions about the different aspects of a product. To facilitate automated ABSA, a novel approach for aspect sentiment classification is proposed in this study. Further to rank the products based on aspect-specific performance, a framework is developed using Multi-criteria decision-making (MCDM) techniques. A case study is performed in the automobile domain to rank various cars using the ABSA approach. To validate the effectiveness of the proposed approach, the ranking results are compared with the numeric ratings available for various aspects of the car. The experimental results show that the ranking obtained by the proposed approach matches the numerical ratings. Therefore, the car selection problem or recommendation of cars in the automobile domain can be effectively handled using the proposed framework.

Peritumoral Radiomics for Identification of Telomerase Reverse Transcriptase Promoter Mutation in Patients With Glioblastoma Based on Preoperative MRI.

Chapter 3 - Sensor-enabled biomedical decision support system using deep learning and fuzzy logic