- Research Article
26
- 10.1016/j.patrec.2024.01.001
A multi-aspect framework for explainable sentiment analysis
- Jan 07, 2024
- Pattern Recognition Letters
- Jothi Prakash V + 1 more +1
A multi-aspect framework for explainable sentiment analysis
ABSTRACT Summarization of online reviews by customers is a popular practice for evaluation of products or services. As the reviews accumulate, the large size and the unstructured nature of the reviews hinder manual summarization. Automatic categorization of the reviews as a whole into only positive and negative group cannot represent a clear picture. An aspect based automatic summarization technique can provide better visualization. However, automatic extraction of proper aspects from the huge reviews of any product is not very easy. There are some research works in this direction, but any definite method is yet to come. In this work, a two-step Latent Dirichlet Allocation (LDA) technique, which is popularly used for topic modelling has been developed for efficient aspect extraction. The method has been evaluated by simulation experiments on Amazon product reviews and Yelp restaurant and hotel reviews. The results have been found quite matching with human annotated results.
A multi-aspect framework for explainable sentiment analysis
A multi-aspect framework for explainable sentiment analysis
LO040: Do combined electrocardiogram rhythm and point of care ultrasound findings predict outcome during cardiac arrest? The second Sonography in Hypotension and Cardiac Arrest in the Emergency Department (SHOC-ED 2) Study
Introduction: Survival to hospital discharge is better for PEA than asystole in out-of-hospital cardiac arrest. Point of care ultrasound (PoCUS) is widely used in cardiac arrest, although not mandated by ACLS guidelines. This study examines if initial PoCUS findings combined with cardiac rhythm are predictive of outcomes including return of spontaneous circulation (ROSC), survival to hospital admission (SHA), and hospital discharge (SHD). Methods: A database review was completed for patients arriving to a tertiary ED in asystole or PEA arrest from 2010 to 2014. Patients under 19y or with a previous DNR were excluded. Patients were grouped into those with cardiac activity on PoCUS and PEA on ECG (Positive group); those with no cardiac activity recorded on PoCUS and asystole on ECG (Negative group); and those with a mix of positive and negative findings (Indeterminate group). Data was analyzed for the frequency of ROSC, SHA, and SHD. Results: 186 patients met the study criteria, with 14 (8%) in the positive group, 134 (72%) in the negative group, and 38 (20%) in the indeterminate group. The positive group had significantly better initial outcomes than the negative group: ROSC: 78% (95% CI 49-95%) vs 17% (11-25%); OR 17.70 (4.57-168.5; p < 0.0001) and SHA: 29% (8-58%) vs 7% (3-12%); OR 5.56 (1.45-21.28; p = 0.022), and then the combined negative and indeterminate groups: ROSC: 22% (16-29%), OR 12.93 (3.43-48.73; p < 0.0001; SHA: 8% (5-13%); OR 4.51 (1.25-16.27; p = 0.033). There was no difference between the positive group and either the negative or combined groups for final outcome of SHD: 0% (0-23%) vs 1% (0-5%); OR 1.83 (0.08-39.97; p = 1.00; and vs 1% (0-5%); OR 1.67 (0.08-33.96; p = 1.00). The negative group had worse initial outcomes than the combined positive and indeterminate groups: ROSC 17% (11-25%) vs. 50% (36-64%) OR 0.21 (0.10-0.42; p < 0.0001); SHA 6% (3-12%) vs. 8% (5-13%) OR 0.34 (0.13-0.92; p = 0.0490). There was no difference in SHD: 1% (0-5%) vs. 1% (0-5%) OR 0.77 (0.07-8.71; p = 1.00). Conclusion: Our results suggest that although finding positive cardiac activity on ECG (PEA) and also on PoCUS is associated with greater ROSC and SHA, it does not identify patients with a final outcome of SHD.
Read moreExploring Latent Dirichlet Allocation (LDA) in Topic Modeling: Theory, Applications, and Future Directions
In an era dominated by an unprecedented deluge of textual information, the need for effective methods to make sense of large datasets is more pressing than ever. This article takes a pragmatic approach to unraveling the intricacies of topic modeling, with a specific focus on the widely used Latent Dirichlet Allocation (LDA) algorithm. The initial segment of the article lays the groundwork by exploring the practical relevance of topic modeling in real-world scenarios. It addresses the everyday challenges faced by researchers and professionals dealing with vast amounts of unstructured text, emphasizing the potential of topic modeling to distill meaningful insights from seemingly chaotic data. Moving beyond theoretical abstraction, the article then delves into the mechanics of Latent Dirichlet Allocation. Developed in 2003 by Blei, Ng, and Jordan, LDA provides a probabilistic framework to identify latent topics within documents. The article takes a step-by-step approach to demystify LDA, offering a practical understanding of its components and the Bayesian principles governing its operation. A significant portion of the article is dedicated to the practical implementation of LDA. It provides insights into preprocessing steps, parameter tuning, and model evaluation, offering readers a hands-on guide to applying LDA in their own projects. Real-world examples and case studies showcase how LDA can be a valuable tool for tasks such as document clustering, topic summarization, and sentiment analysis. However, the journey through LDA is not without challenges, and the article candidly addresses these hurdles. Topics such as determining the optimal number of topics, the sensitivity of results to parameter settings, and the interpretability of outcomes are discussed. This realistic appraisal adds depth to the article, helping readers navigate the nuances and potential pitfalls of employing LDA in practice. Beyond the technical intricacies, the article explores the broad spectrum of applications where LDA has proven its efficacy. From text mining and information retrieval to social network analysis and healthcare informatics, LDA has left an indelible mark on diverse domains. Through practical examples, the article illustrates how LDA can be adapted to different contexts, showcasing its versatility as a tool for uncovering latent patterns. Keywords: Topic Modeling, Latent Dirichlet Allocation, Text Mining, Natural Language Processing, Document Clustering, Bayesian Inference.
Read moreImportance of nutrient balance in severe congenital diaphragmatic hernia: A retrospective case–control study
Importance of nutrient balance in severe congenital diaphragmatic hernia: A retrospective case–control study
Neural Networks with Emotion Associations, Topic Modeling and Supervised Term Weighting for Sentiment Analysis.
Automated sentiment analysis is becoming increasingly recognized due to the growing importance of social media and e-commerce platform review websites. Deep neural networks outperform traditional lexicon-based and machine learning methods by effectively exploiting contextual word embeddings to generate dense document representation. However, this representation model is not fully adequate to capture topical semantics and the sentiment polarity of words. To overcome these problems, a novel sentiment analysis model is proposed that utilizes richer document representations of word-emotion associations and topic models, which is the main computational novelty of this study. The sentiment analysis model integrates word embeddings with lexicon-based sentiment and emotion indicators, including negations and emoticons, and to further improve its performance, a topic modeling component is utilized together with a bag-of-words model based on a supervised term weighting scheme. The effectiveness of the proposed model is evaluated using large datasets of Amazon product reviews and hotel reviews. Experimental results prove that the proposed document representation is valid for the sentiment analysis of product and hotel reviews, irrespective of their class imbalance. The results also show that the proposed model improves on existing machine learning methods.
Read moreThe clinical value of the 99Tcm-MIBI imaging in predicting the prognosis of malignant lymphoma
To predict the chemotherapy response in Malignant lymphoma (ML) using 99Tcm-MIBI imaging, and to evaluate whether 99Tcm-MIBI scintigraphy parameters may have a precise predictive value in the expression of MDR1 and multidrug resistance-related-protein genes. Twenty-three patients with histologically proved Malignant lymphoma underwent 99Tcm-MIBI scintigraphy before chemotherapy. Tumor-to-background [corrected] (T/B) ratios of both early (10 min) and late images (1 h) and the percentage rate of washout (WR%) were measured; The mRNA expressions of MDR1 and MRP were measured by semi-quantitative reverse transcriptase polymerase chain reaction (RT-PCR); therapeutic reaction was evaluated by clinical and radiologic methods after completing 6 - 8 cycle chemotherapy with/without involved field radiotherapy for large tumors. The WR% (16 +/- 6) of both MDR1 and MRP simultaneously negative expression group was significance lower than both simultaneously positive expression group (33 +/- 5), and also lower than either MDR1 or MRP positive expression group (28 +/- 6) (both P < 0.01); There was no significant difference between the both simultaneously positive expression group and either MDR1 or MRP positive expression group (P = 0.26). The early images, late images T/B ratios and WR% of MDR1 positive group were 3.0 +/- 1.1, 2.5 +/- 0.8 and 17 +/- 7 respectively; MDR1 negative group were 3.4 +/- 1.0, 2.3 +/- 0.7 and 32 +/- 6 respectively. There were no significant difference between the MDR1 positive group and MDR1 negative group in either early images or late images T/B ratios (P > 0.05), but the WR% was significant different between them (P < 0.01). The early images, late images T/B ratios and WR% of MRP positive group were 3.1 +/- 1.2, 2.5 +/- 0.8 and 19 +/- 8 respectively; MRP negative group were 3.3 +/- 1.0, 2.3 +/- 0.7 and 31 +/- 6 respectively. The WR% of MRP positive group was significantly higher than that of MRP negative group (P = 0.003); T/B ratios of both early and late images were all significantly different between them (P = 0.72, P = 0.60). Both levels of MDR1 and WR% were significantly positively correlated with therapeutic response (both P < 0.05), but there was no significant correlation between levels of MRP and therapeutic response (P = 0.052). As a untraumatic imagology instrument, 99Tcm-MIBI can accurately reflect the expression and functional status of MDR1 and MRP, and can predict the therapeutic response of ML, thus could be used for individualized treatment planning. 99Tcm-MIBI would be benefit to ML patients.
Read moreCross Domain Sentiment Analysis Using Different Machine Learning Techniques
Sentiment analysis is the field of study that focuses on finding effectively the conduct of subjective text by analyzing people’s opinions, sentiments, evaluations, attitudes and emotions towards entities. The analysis of data and extracting the opinion word from the data is a challenging task especially when it involves reviews from completely different domains. We perform cross domain sentiment analysis on Amazon product reviews (books, dvd, kitchen appliances, electronics) and TripAdvisor hotel reviews, effectively classify the reviews to positive and negative polarities by applying various preprocessing techniques like Tokenization, POS Tagging, Lemmatization and Stemming which can enhance the performance of sentiment analysis in terms of accuracy and time to train the classifier. Various methods proposed for document-level sentiment classification like Naive Bayes, k-Nearest Neighbor, Support Vector Machines and Decision Tree are analysed in this work. Cross domain sentiment classification is useful because many times we might not have training corpus of specific domains for which we need to classify the data and also cross domain is favoured by lower computation cost and time. Despite poor performance in accuracy, the time consumed for sentiment classification when multiple testing datasets of different domains are present is far less in case of cross domain as compared to single domain. This work aims to define methods to overcome the problem of lower accuracy in cross-domain sentiment classification using different techniques and taking the benefit of being a faster method.
Read moreAnalisis Sentimen Web Novel Menggunakan Metode Latent Dirichlet Allocation (LDA)
Web novels have gained popularity in recent years as a form of literature that is published and consumed online via specialized platforms. User generated comments and reviews play an important role in the web novel platform, providing valuable insight into reader sentiment and feedback. Manually analyzing sentiment from a large number ofcomments would be very time consuming, an efficient automated approach was required. This study uses the Latent Dirichlet Allocation (LDA) method to identify sentiment patterns (positive, negative, neutral) in user comments on web novels and analyze their distribution as a whole. LDA, originally designed for topic modeling, has proven effective in sentiment analysis, helping to group comments into relevant topics and uncover general sentiments related to each topic. This study aims to use the LDA method to identify sentiment patterns (positive, negative, or neutral) in user comments on web novels and analyze the distribution of sentiment as a whole. The results show the effectiveness of LDA in sentiment analysis, achieving quite good results, with 72% accuracy, 80% precision, 72% recall, and 65% F1 score.
Read moreA new approach for sentiment and geopolitical stance analysis of Reddit comments on the Israel-Palestine conflict
The paper focuses on the persistent conflict between Israel and Palestine. of world discussion, with such sites as Reddit containing a great deal medium for public expression. This study uses natural language processing (NLP) including valence aware dictionary and sentiment reasoner (VADER) for sentimental analysis and latent Dirichlet allocation (LDA) for topic modelling of geopolitical positions in comments of 400,000 posts belonging to the topics subreddits. A sentiment analysis using VADER shows that negative sentiments observed and indicate that such sentiments prevail throughout fear of aggression, human suffering, and threat. media biases. LDA analysis for topic modelling. The process of LDA reveals such important topics as humanitarian ones. media discourses, polemizing and appeals for calm. Furthermore, the study which divides comments into geopolitical attitudes – support for or yet, Israelis, supporters of Palestine, opponents of both, and neutrals, offering a contingency comprehensive conception of public perspectives. The results emphasize the effectiveness of large-scale. Of the big data pre-processing techniques, NLP can be used to understand geopolitics and its intricate dynamics. educate policy makers, researchers, and media planners.
Read moreHVEGF siRNA inhibits initial growth of A549 tumor cells in nude mice and angiogenesis on CAM assay
To investigate the effect of small interfering RNA (siRNA) targeting human vascular endothelial growth factor (hVEGF) on A549 cell growth in nude mice and angiogenesis on chorioallantoic membrane (CAM) assay. Three pairs of hVEGF siRNA-plasmid and non-silencing-plasmid were constructed, and transfected into A549 cells through lipofectamine 2000, respectively. The most effective pair of hVEGF siRNA-plasmid was selected by ELISA and real-time RT-PCR. A549 cells transfected with selected hVEGF siRNA- plasmid, A549 cells transfected with non-silencing-plasmid and A549 cells without transfection were inoculated into nude mice, respectively. Chick embryos were randomly divided into four groups and CAM was treated by different solutions for 48 h: culture media DMEM as negative control group,un-transfected A549 cell culture supernatants as positive control group, hVEGF siRNA A549 cell culture supernatants as hVEGF siRNA group and nonsilencing siRNA A549 cell culture supernatants as non-silencing siRNA group. The CAMs were harvested on d12 for microscopic assays. Compared with control group, hVEGF siRNA-plasmid induced 48% reduction in hVEGF secretion by A549 cells accompanied by 70% reduction in hVEGF mRNA. Compared with non-silencing siRNA group, the mean tumor volume of murine xenograft was reduced by 58% in hVEGF siRNA group; time for xenografts growing to 50 mm(3)was delayed by 5.4 d. hVEGF contents in xenograft were reduced by 54%; but mean doubling time of tumors and the growth rate of tumors were not significantly reduced. In CAM assays, hVEGF content was zero in negative group, and in hVEGF siRNA group that was 40%-44% of non-silencing siRNA group or positive group; vessels branch points of CAM in hVEGF siRNA group or non-silencing siRNA group or positive group were increased by 45%-55% compared with negative group; total vessel length of CAM in hVEGF siRNA group was increased by 53% compared with negative group, while in non-silencing siRNA group or positive group that was increased by 97% or 99%. Compared with negative control group, the proliferation of microvessels was increased when cell culture supernatant with hVEGF was added in hVEGF siRNA group, significant proliferated vessels were observed in non-silencing siRNA group or positive group. A plasmid-mediated hVEGF siRNA has been constructed and verified, which can effectively downregulate the expression of hVEGF in human A549 cells, resulting in the inhibition of angiogenesis. hVEGF siRNA can delay initial growth of A549 tumor xenograft but not reduce the growth rate.
Read moreLeukemia Burden in Peripheral Blood Has Negative Impact on CD19-CART Cell Culture and Its Clinical Efficacy in Patients with Refractory or Relapsed B Cell Acute Lymphoblastic Leukemia
Leukemia Burden in Peripheral Blood Has Negative Impact on CD19-CART Cell Culture and Its Clinical Efficacy in Patients with Refractory or Relapsed B Cell Acute Lymphoblastic Leukemia
Read moreTopic Modeling and Sentiment Analysis of Yelp Restaurant Reviews
The use of online consumer reviews (OCRs) websites like Yelp or TripAdvisor has increasingly gained popularity over the years. However, many products or services now have a large number of online reviews, which makes it difficult for consumers to decide which reviews to pay attention to, or for businesses to identify which critical areas to improve on. The use of text mining and sentiment mining techniques is deemed important to automatically process the content of online reviews and help improve review usefulness. Applying a four-phase research model, our study demonstrated data extraction and cleaning, topic modeling using Latent Dirichlet allocation (LDA) to extract five topics (Price, Time, Food, Service, and Location), sentiment analysis using Python TextBlob to aggregate consumer sentiment per topic from a Yelp restaurant reviews dataset, and model performance evaluation. We proposed that the design of recommender systems for OCRs or business decision-making systems can be faster, simpler, and more useful by integrating automatic topics extraction and sentiment analysis.
Read moreAn Optimized Customers Sentiment Analysis Model Using Pastoralist Optimization Algorithm (POA) and Deep Learning
Users usually express their sentiment online which influences purchased products and services. The computational study of people's feelings and thoughts on entities is known as sentiment analysis. The Long Short-Term Memory (LSTM) model is one of the most common deep learning models for solving sentiment analysis problems. However, they possess some drawbacks such as longer training time, more memory for training, easily over fits, and sensitivity to randomly generated parameters. Hence, there is a need to optimize the LSTM parameters for enhanced sentiment analysis. This paper proposes an optimized LSTM approach using a newly developed novel Pastoralist Optimization Algorithm (POA) for enhanced sentiment analysis. The model was used to analyze sentiments of customers retrieved from Amazon product reviews. The performance of the developed POA-LSTM model shows an optimal accuracy, precision, recall and F1 measure of 77.36%, 85.06%, 76.29%, and 80.44% respectively, when compared with LSTM model with 71.62%, 78.26%, 74.23%, and 76.19% respectively. It was also observed that POA with 20 pastoralist population size performs better than other models with 10, 15, 25 and 30 population size.
Read moreSentiment Analysis Using Part-of-Speech-Based Feature Extraction and Game-Theoretic Rough Sets
Sentiment analysis, one of the most trending natural language processing tasks, is used to mine opinions or sentiments from a given text. Two significant challenges of sentiment analysis are 1) complexity in data pre-processing caused by the high dimensionality of textual data; 2) uncertainty in classifying sentiment polarities due to the ambiguity of natural languages. To address these issues, we propose a model using part-of-speech-based feature extraction to reduce dimensionality and game-theoretic rough sets (GTRS) to establish a balance between the accuracy and coverage trade-off. We evaluate this model with three different sizes of datasets (Yelp reviews, IMDB movie reviews, and Amazon product reviews). The experiment results show that the proposed model outperforms Pawlak’s rough set model and 0.5-probabilistic rough set model. In comparison with four traditional binary classification models (i.e., SVM, naïve Bayes, decision tree, and KNN), the proposed model also achieves higher accuracy rates. This research suggests that the proposed model is promising to deal with the complexity and uncertainty in sentiment analysis tasks.
Read moreUnveiling User Sentiment: Aspect-Based Analysis and Topic Modeling of Ride-Hailing and Google Play App Reviews
Background: Mobile app usage is increasing in the digital age, with Ride-Hailing app becoming the primary example of this trend. To obtain valuable understanding of how people perceive and interact with mobile app, user reviews on platforms such as Google Play are usually analyzed. This analysis can assist developers to identify areas for improvement in both Ride-hailing and Google Play App. A promising method that can be used to analyze user perception in this instance is Aspect-Based Sentiment Analysis (ABSA). Objective: This research aimed to apply ABSA to user reviews using Bidirectional Encoder Representations from Transformers (BERT) models. In this context, aspect identification and topic modeling were performed by using Latent Dirichlet Allocation (LDA). The model extracted topics from the reviews and used Generative Artificial Intelligence (GenAI) to define the aspects of the topics to further enhance the analysis. For consistency and accuracy, the method included sentiment annotation by a human annotator. Methods: A total of two datasets were used in this research, with the first collected by scraping user reviews of Ride-Hailing App while the second was obtained from Kaggle, and to identify relevant topics, modeling was performed using LDA. These topics were then categorized into aspects using GenAI, covering areas, such as customer experience, service, payment, app features, task management, and event management. Subsequently, sentiment labeling was conducted using human annotators to provide a reliable baseline. BERT model was then used to classify sentiment with aspect hints, and the evaluation included calculations of accuracy, precision, recall, and F1-score. Results: The results showed that BERT model achieved the highest accuracy of 97% in sentiment analysis across all datasets. Conclusion: This research provided valuable understanding of user experience and established a strong ABSA framework for analyzing user reviews using LDA, Aspect Annotation, GenAI, and BERT sentiment models. Future research could expand this method to other app categories and incorporate real-time ABSA for continuous monitoring and dynamic feedback. Keywords: User Reviews, Aspect-Based Sentiment Analysis (ABSA), Sentiment Analysis, Topic Modeling, Generative Artificial Intelligence (GenAI)
Read more