An experimental study of sentiment classification using deep-based models with various word embedding techniques

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Many researchers in various disciplines have focused on extracting meaningful information from social media platforms in recent years. Identification of behaviors and emotions from user posts is examined under the heading of sentiment analysis (SA) studies using the natural language processing (NLP) techniques. In this study, a novel TCNN-Bi-LSTM model using the two-stage convolutional neural network (TCNN) and bidirectional long short-term memory (Bi-LSTM) architectures was proposed. While TCNN layers enable the extraction of strong local features, the output of these layers feeds the Bi-LSTM model that remembers forward-looking information and capture long-term dependencies. In this study, first, preprocessing steps were applied to the raw dataset. Thus, strong features were extracted from the obtained quality dataset using the FastText word embedding technique that pre-trained with location-based and sub-word information features. The experimental results of the proposed method are promising compared to the baseline deep learning and machine learning models. Also, experimental results show that while the FastText data embedding technique achieves the best performance compared to other word embedding techniques in all deep learning classification models, it has not had the same outstanding success in machine learning models. This study aims to investigate the sentiments of tweets about the COVID-19 vaccines and comments on these tweets among Twitter users by using the power of Twitter data. A new dataset collected from Twitter was constructed to be used in experimental results. This study will facilitate detecting inappropriate, incomplete, and erroneous information about vaccination. The results of this study will enable society to broaden its perspective on the administered vaccines. It can also assist the government and healthcare agencies in planning and implementing the vaccination's promotion on time to achieve the herd immunity provided by the vaccination.

User reviews on gaming platforms such as Steam have become a crucial source of information for potential players before making purchasing decisions. Due to the varied nature of user opinions, sentiment analysis is essential for processing and interpreting these reviews. This study investigates the application of sentiment analysis to RPG game reviews on Steam, aiming to assist users by summarizing reviews through sentiment results and providing insights into the general perception of a game. To achieve this, the study applies sentiment analysis using Word2Vec and Support Vector Machine (SVM). It focuses on evaluating the impact of lemmatization during preprocessing and analyzing the performance of Word2Vec in sentiment classification. Word2Vec transforms review text into vector representations that capture semantic relationships, enhancing the model’s ability to understand context. Meanwhile, SVM is chosen as the classifier for its effectiveness in distinguishing between positive and negative reviews and handling high-dimensional data. The system developed uses Word2Vec with 300-dimensional vectors combined with an SVM Polynomial classifier, resulting in the best performance among the tested models. The final model achieves a macro-average F1-score of 88.6%, indicating a strong capability in accurately classifying sentiments in user reviews. These results highlight the potential of combining word embedding and machine learning techniques for analyzing sentiment in gaming platforms. Keywords: sentiment analysis, Word2Vec, SVM, Steam, RPG

PurposeThe first transmission of coronavirus to humans started in Wuhan city of China, took the shape of a pandemic called Corona Virus Disease 2019 (COVID-19), and posed a principal threat to the entire world. The researchers are trying to inculcate artificial intelligence (Machine learning or deep learning models) for the efficient detection of COVID-19. This research explores all the existing machine learning (ML) or deep learning (DL) models, used for COVID-19 detection which may help the researcher to explore in different directions. The main purpose of this review article is to present a compact overview of the application of artificial intelligence to the research experts, helping them to explore the future scopes of improvement.MethodsThe researchers have used various machine learning, deep learning, and a combination of machine and deep learning models for extracting significant features and classifying various health conditions in COVID-19 patients. For this purpose, the researchers have utilized different image modalities such as CT-Scan, X-Ray, etc. This study has collected over 200 research papers from various repositories like Google Scholar, PubMed, Web of Science, etc. These research papers were passed through various levels of scrutiny and finally, 50 research articles were selected.ResultsIn those listed articles, the ML / DL models showed an accuracy of 99% and above while performing the classification of COVID-19. This study has also presented various clinical applications of various research. This study specifies the importance of various machine and deep learning models in the field of medical diagnosis and research.ConclusionIn conclusion, it is evident that ML/DL models have made significant progress in recent years, but there are still limitations that need to be addressed. Overfitting is one such limitation that can lead to incorrect predictions and overburdening of the models. The research community must continue to work towards finding ways to overcome these limitations and make machine and deep learning models even more effective and efficient. Through this ongoing research and development, we can expect even greater advances in the future.

Sentiment Analysis of Self Driving Car Dataset: A comparative study of Deep Learning approaches

Social media platforms provide valuable insights into mental health trends by capturing user-generated discussions on conditions such as depression, anxiety, and suicidal ideation. Machine learning (ML) and deep learning (DL) models have been increasingly applied to classify mental health conditions from textual data, but selecting the most effective model involves trade-offs in accuracy, interpretability, and computational efficiency. This study evaluates multiple ML models, including logistic regression, random forest, and LightGBM, alongside DL architectures such as ALBERT and Gated Recurrent Units (GRUs), for both binary and multi-class classification of mental health conditions. Our findings indicate that ML and DL models achieve comparable classification performance on medium-sized datasets, with ML models offering greater interpretability through variable importance scores, while DL models are more robust to complex linguistic patterns. Additionally, ML models require explicit feature engineering, whereas DL models learn hierarchical representations directly from text. Logistic regression provides the advantage of capturing both positive and negative associations between features and mental health conditions, whereas tree-based models prioritize decision-making power through split-based feature selection. This study offers empirical insights into the advantages and limitations of different modeling approaches and provides recommendations for selecting appropriate methods based on dataset size, interpretability needs, and computational constraints.

The increasing development of technology has led to the increase of digital data in various fields, such as medication-related texts. Sentiment Analysis (SA) in medication is essential to give clinicians insights into patients’ feedback about the treatment procedure. Therefore, this study intends to develop Artificial Intelligence (AI) models to predict patients’ sentiments. This study used a large medication review dataset to perform a SA of medications. Three scenarios were considered for classification, including two, three, and ten classes. The Word2Vec algorithm and pre-trained word embeddings, including the general and clinical domains, were utilized in model development. Seven Machine Learning (ML) and Deep Learning (DL) models were developed for various scenarios. The best hyperparameters for all models were fine-tuned. Moreover, two ensemble learning models were developed from the proposed ML and DL models. For the first time, a technique was implemented to interpret the results for explainability and interpretability. The results showed that the developed deep ensemble model (DL_ENS), using PubMed and PMC, as pre-trained word embedding representation, achieved the best results, with accuracy and F1-Score of 92.96% and 92.27% in two classes, 92.18% and 88.50 in three classes, and 90.31% and 67.07% in ten classes, respectively. Combining DL models and developing a DL_ENS with clinical domain pre-trained word embedding representation can accurately predict classes and scores of patients’ sentiments about medications compared to previous studies on the same dataset. Due to the transparency in decision-making, our DL_ENS model can be used as an auxiliary tool to help clinicians prescribe medications.

Evaluation of multispectral imaging for freeze damage assessment in strawberries using AI-based computer vision technology

Moving target defenses (MTDs) are widely used as an active defense strategy for thwarting cyberattacks on cyber-physical systems by increasing diversity of software and network paths. Recently, machine Learning (ML) and deep Learning (DL) models have been demonstrated to defeat some of the cyber defenses by learning attack detection patterns and defense strategies. It raises concerns about the susceptibility of MTD to ML and DL methods. Here, in this article, we analyze the effectiveness of ML and DL models when it comes to deciphering MTD methods and ultimately evade MTD-based protections in real-time systems. Specifically, we consider a MTD algorithm that periodically randomizes address assignments within the MIL-STD-1553 protocol—a military standard serial data bus. Two ML and DL-based tasks are performed on MIL-STD-1553 protocol to measure the effectiveness of the learning models in deciphering the MTD algorithm: 1) determining whether there is an address assignments change i.e., whether the given system employs a MTD protocol and if it does 2) predicting the future address assignments. The supervised learning models (random forest and k-nearest neighbors) effectively detected the address assignment changes and classified whether the given system is equipped with a specified MTD protocol. On the other hand, the unsupervised learning model (K-means) was significantly less effective. The DL model (long short-term memory) was able to predict the future addresses with varied effectiveness based on MTD algorithm's settings.

Sentiment analysis is a subfield of Natural Language Processing (NLP) which tries to process a text to extract opinions or attitudes towards topics or entities. Recently, the use of deep learning methods for sentiment analysis has received noticeable attention from researchers. Generally, different deep learning methods have shown superb performance in sentiment analysis problem. However, deep learning models are different in nature and have different strengths and limitations. For example, convolutional neural networks are useful for extracting local structures from data, while recurrent models are able to learn order dependence in sequential data. In order to combine the advantages of different deep models, in this paper we have proposed a novel approach for aspect-based sentiment analysis which utilizes deep ensemble learning. In the proposed method, we first build four deep learning models, namely CNN, LSTM, BiLSTM and GRU. Then the outputs of these models are combined using stacking ensemble approach where we have used logistic regression as meta-learner. The results of applying the proposed method on the real datasets show that our method has increased the accuracy of aspect-based prediction by 5% to 20% compared to the basic deep learning methods.

Artificial intelligence (AI)-based approaches are crucial in computer-aided diagnosis (CAD) for various medical applications. Their ability to quickly and accurately learn from complex data is remarkable. Deep learning (DL) models have shown promising results in accurately classifying Alzheimer's disease (AD) and its related cognitive states, Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI), along with the healthy conditions known as Cognitively Normal (CN). This offers valuable insights into disease progression and diagnosis. However, certain traditional machine learning (ML) classifiers perform equally well or even better than DL models, requiring less training data. This is particularly valuable in CAD in situations with limited labeled datasets. In this paper, we propose an ensemble classifier based on ML models for magnetic resonance imaging (MRI) data, which achieved an impressive accuracy of 96.52%. This represents a 3-5% improvement over the best individual classifier. We evaluated popular ML classifiers for AD classification under both data-scarce and data-rich conditions using the Alzheimer's Disease Neuroimaging Initiative and Open Access Series of Imaging Studies datasets. By comparing the results to state-of-the-art CNN-centric DL algorithms, we gain insights into the strengths and weaknesses of each approach. This work will help users to select the most suitable algorithm for AD classification based on data availability.

Background Artificial intelligence (AI) has revolutionized diagnostic radiology by improving accuracy, efficiency, and clinical decision-making. While numerous systematic reviews and meta-analyses have evaluated the performance of AI-based techniques, particularly traditional machine learning (ML) and deep learning (DL) models, a comprehensive synthesis of this evidence is lacking. An umbrella review is necessary to integrate and compare findings across various imaging applications, offering the highest level of evidence to inform clinical practice and policy. Objective This umbrella review aims to compare the diagnostic performance of traditional machine learning and deep learning methods in radiology by synthesizing evidence from existing systematic reviews and meta-analyses. Methods A systematic literature search was conducted in PubMed, Scopus, Web of Science, and Cochrane Library for systematic reviews and meta-analyses published between 2018 and 2024. Only peer-reviewed reviews evaluating diagnostic applications of AI in radiology were included. Methodological quality was assessed using the AMSTAR 2 tool, and risk of bias was evaluated using ROBIS. Results Seven systematic reviews and meta-analyses were included. Across multiple imaging domains—such as breast cancer screening, spinal stenosis, and tumor grading—deep learning consistently outperformed traditional ML in diagnostic accuracy and sensitivity. Evidence quality was rated moderate to high, though variability in reporting and a lack of external validation were noted. Explainability features in DL models were underutilized and poorly evaluated. Conclusion This umbrella review confirms the superior diagnostic performance of deep learning methods over traditional ML in radiology. Future research should prioritize model transparency, real-world validation, and standardization in clinical implementation.

This article investigates the identification of hate speech on social media using machine learning and deep learning techniques. The research uses metrics such as F-measure, AUC-ROC, precision, accuracy, and recall assessing the effectiveness of various tactics. The findings indicate that deep learning models, particularly the bidirectional long short-term memory (BiLSTM) architecture, consistently outperform other methods in categorization tasks. The research emphasizes the importance of sophisticated neural network designs in identifying the intricacies of hostile and offensive content online. The study offers insights for promoting early identification and prevention of cyberbullying, improving secure and inclusive online environments. Future research may explore real-time detection systems, hybrid approaches, or the integration of complementary components to enhance and improve innovative technology in tackling this significant social issue. A sample tweet was annotated by specialists who categorize tweets as hate speech, offensive language, or neutral. The researchers applied shallow learning methodologies and integrated word embeddings like Word2Vec and GloVe to enhance the efficacy of deep learning models. The results indicate that BiLSTM surpasses shallow learning methods in detecting hate speech on Twitter, highlighting the efficacy of deep learning approaches in recognizing and tracking hate speech on social media platforms. When comparing different deep learning and machine learning models on different datasets, the results reveal that deep learning techniques are usually more effective. A reasonably high level of accuracy is achieved by KNN and SVM among classical algorithms, whereas Naïve Bayes performs the poorest. While deep learning approaches provide better results, tree-based models such as Random Forest and Decision Trees offer more consistent accuracy. Models based on neural networks, such as LSTM, CNN, and BI-LSTM, perform well, with LSTM-based methods excelling in particular. The most successful strategy for classification problems is the model presented, which obtains the greatest accuracy, precision, recall, F1-score of 95%. The research aids in the development of advanced tools and methodologies to mitigate hate speech on social media and foster positive online interactions. Future research may investigate alternative deep learning architectures, such as transformers, to enhance hate speech detection efficacy. The advancement of interpretable AI methodologies for identifying hate speech and delivering transparent forecasts might enhance user confidence and facilitate better content moderation decisions.

Sentiment analysis is a type of natural language processing that categorizes text as positive or negative. It has been used in several industries in recent decades. Analyzing people’s opinions on a subject is a difficult task, because everyone’s perception is different. Sentiment analysis can be used to classify the information about people, services, and products. Every minute, a vast amount of data is uploaded to websites, blogs, and social media platforms. In this data era, new technologies and algorithms are required to extract useful information from online content. Customer expectations, market trends, and people’s attitudes are determined by sentiment analysis. It aids in the expansion of a business and making of critical production decisions. While industries utilize social media to interact with customers, businessmen use customer feedback and reviews to better their services and products. Machine learning and Deep learning models are well suited for text processing. Convolutional neural networks and Recurrent neural networks are two deep learning methods that are utilized to solve numerous challenges in the text processing sector. CNN can get the important features from the input text with pooling operation, but it is complex to get contextual data. RNN can get the contextual detail but the sequence of input words will differ. This study discusses the comparison of Convolution neural networks with LSTM algorithms.

Metabolic dysfunction-associated steatotic liver disease (MASLD) can progress to metabolic dysfunction-associated steatohepatitis (MASH) and liver fibrosis, contributing to a heavier global health burden. Non-invasive diagnostic tools developed using machine learning (ML) and deep learning (DL), two representative artificial intelligence algorithms, are increasingly being explored for MASH and its related fibrosis assessment. This study aimed to compare the diagnostic performance of different ML and DL models and identify the top-performing models for diagnosing MASH and associated liver fibrosis. A systematic review and meta-analysis were conducted across PubMed, Web of Science, Embase and Cochrane Library from inception to May 18, 2025. Pooled area under the receiver operator characteristic curve (AUROC) values with 95 % confidence interval (CI) were calculated. Accuracy, specificity, sensitivity, positive predictive values, and negative predictive values were also recorded. Of 4,314 studies initially identified, 106 met the inclusion criteria, with 35 studies (ML: n=28; DL: n=7) providing data for analysis. Logistic Regression and Neural Network are the most commonly algorithms applied in ML and DL, respectively. The pooled AUROCs for diagnosing MASH were 0.833 (95 %CI: 0.806-0.860) for ML models and 0.841 (95 %CI: 0.782-0.900) for DL models. Light Gradient Boosting Machine (LightGBM) and ResNet50 were the best-performing models for diagnosing MASH within ML and DL algorithms, respectively, achieving corresponding AUROCs of 0.920 (95 %CI: 0.916-0.924) and 0.960 (95 %CI: 0.951-0.969). For fibrosis diagnosis, ML models had a pooled AUROC of 0.826 (95 %CI: 0.792-0.860), with Categorical Boosting (CatBoost) achieving the highest AUROC of 0.960 (95 %CI: 0.950-0.970). DL models yielded the pooled AUROC of 0.875 (95 %CI: 0.816-0.934) for fibrosis diagnosis. Both ML and DL models demonstrated strong diagnostic performance for MASH and liver fibrosis, with DL achieving marginally higher AUROCs. AI-driven approaches show promise in MASLD management.