Sentiment analysis and prediction of polarity vaccines based on Twitter data using deep NLP techniques

Since it is one of the world's most significant financial markets, the foreign exchange (Forex) market has attracted a large number of investors. Accurately anticipating the forex trend has remained a popular but difficult issue to aid Forex traders' trading decisions. It is always a question of how precise a Forex prediction can be because of the market's tremendous complexity. The fast advancement of machine learning in recent decades has allowed artificial neural networks to be effectively adapted to several areas, including the Forex market. As a result, a slew of research articles aimed at improving the accuracy of currency forecasting has been released. The Long Short-Term Memory (LSTM) neural network, which is a special kind of artificial neural network developed exclusively for time series data analysis, is frequently used. Due to its high learning capacity, the LSTM neural network is increasingly being utilized to predict advanced Forex trading based on previous data. This model, on the other hand, can be improved by stacking it. The goal of this study is to choose a dataset using the Hurst exponent, then use a two-layer stacked Long Short-Term Memory (TLS-LSTM) neural network to forecast the trend and conduct a correlation analysis. The Hurst exponent (h) was used to determine the predictability of the Australian Dollar and United States Dollar (AUD/USD) dataset. TLS-LSTM algorithm is presented to improve the accuracy of Forex trend prediction of Australian Dollar and United States Dollar (AUD/USD). A correlation study was performed between the AUD/USD, the Euro and the Australian Dollar (EUR/AUD), and the Australian Dollar and the Japanese Yen (AUD/JPY) to see how AUD/USD movement affects EUR/AUD and AUD/JPY. The model was compared with Single-Layer Long Short-Term (SL-LSTM), Multilayer Perceptron (MLP), and Complete Ensemble Empirical Mode Decomposition with Adaptive Noise–Improved Firefly Algorithm Long Short-Term Memory. Based on the evaluation metrics Mean Square Error (MSE), Root Mean Square Error, and Mean Absolute Error, the suggested TLS-LSTM, whose data selection is based on the Hurst exponent (h) value of 0.6026, outperforms SL-LSTM, MLP, and CEEMDAN-IFALSTM. The correlation analysis conducted shows both positive and negative relations between AUD/USD, EUR/AUD, and AUD/JPY which means that a change in AUD/USD will affect EUR/AUD and AUD/JPY as recorded depending on the magnitude of the correlation coefficient (r).

Poly-linear regression with augmented long short term memory neural network: Predicting time series data

The COVID-19 pandemic has had a devastating effect on many people, creating severe anxiety, fear, and complicated feelings or emotions. After the initiation of vaccinations against coronavirus, people's feelings have become more diverse and complex. Our aim is to understand and unravel their sentiments in this research using deep learning techniques. Social media is currently the best way to express feelings and emotions, and with the help of Twitter, one can have a better idea of what is trending and going on in people's minds. Our motivation for this research was to understand the diverse sentiments of people regarding the vaccination process. In this research, the timeline of the collected tweets was from December 21 to July21. The tweets contained information about the most common vaccines available recently from across the world. The sentiments of people regarding vaccines of all sorts were assessed using the natural language processing (NLP) tool, Valence Aware Dictionary for sEntiment Reasoner (VADER). Initializing the polarities of the obtained sentiments into three groups (positive, negative, and neutral) helped us visualize the overall scenario; our findings included 33.96% positive, 17.55% negative, and 48.49% neutral responses. In addition, we included our analysis of the timeline of the tweets in this research, as sentiments fluctuated over time. A recurrent neural network- (RNN-) oriented architecture, including long short-term memory (LSTM) and bidirectional LSTM (Bi-LSTM), was used to assess the performance of the predictive models, with LSTM achieving an accuracy of 90.59% and Bi-LSTM achieving 90.83%. Other performance metrics such as precision,, F1-score, and a confusion matrix were also used to validate our models and findings more effectively. This study improves understanding of the public's opinion on COVID-19 vaccines and supports the aim of eradicating coronavirus from the world.

Language models based on Long Short-Term Memory (LSTM) neural networks have been widely applied to automatic speech recognition, natural language processing research. However, current LSTMs are trained by employing the cross-entropy loss function, which only considers the target category without considering the competing categories during the training processes. Thus, current training methods cannot fully exploit the discriminative information provided by the data labels. To tackle this problem, we propose a Large Margin Long Short-Term Memory Neural Network (LMLSTM) model in this paper. Our model employs the large margin discriminative principle as a heuristic term to navigate the convergence process during training. Our model has improved the discriminative ability of the original LSTM while maintaining the capability when generating sequential data. Our proposed large margin term was tested on the Penn Treebank corpus language modelling task. Experimental results demonstrate that the proposed LMLSTM model outperforms current LSTM models in terms of accuracy and perplexity without increasing the depth.

<span lang="EN-US">In the realm of natural language processing (NLP), a diverse array of language models has emerged, catering to a wide spectrum of tasks, ranging from speaker recognition and auto-correction to sentiment analysis and stock prediction. The significance of language models in enabling the execution of these NLP tasks cannot be overstated. This study proposes an approach to enhance accuracy by leveraging a hybrid language model, combining the strengths of long short-term memory (LSTM) and gated recurrent unit (GRU). LSTM excels in preserving long-term dependencies in data, while GRU's simpler gating mechanism expedites the training process. The research endeavors to evaluate four variations of this hybrid model: LSTM, GRU, <a name="_Hlk158992630"></a>bidirectional long short-term memory (Bi-LSTM), and a combination of LSTM with GRU. These models are subjected to rigorous testing on two distinct datasets: one focused on IBM stock price prediction, and the other on Jigsaw toxic comment classification (sentiment analysis). This work represents a significant stride towards democratizing NLP capabilities, ensuring that even in resource-constrained settings, NLP models can exhibit improved performance. The anticipated implications of these findings span a wide spectrum of real-world applications and hold the potential to stimulate further research in the field of NLP. </span>

In the realm of water resource management, meticulous monitoring and control methodologies are quintessential to the refinement of wastewater treatment processes. This research elucidates an avant-garde methodology for forecasting the Chemical Oxygen Demand (COD), an instrumental indicator of water quality, by harnessing the capabilities of long short-term memory (LSTM) neural networks in conjunction with Internet of Things (IoT) paradigms. The efficacy of the LSTM model is juxtaposed with that of an advanced Deep Belief Network (DBN), as well as contemporary models like a Convolutional Neural Network–Long Short-Term Memory (CNN-LSTM) hybrid model and a Transformer-based model, employing data sourced from a wastewater treatment facility located in Changsha. The empirical findings show that notwithstanding the comparable training durations used, the LSTM model exhibits a preeminent error rate of merely 7%, thus surpassing the DBN model (which has an error rate of 35%), the CNN-LSTM model (registering a 22% error rate), and the Transformer-based model (with a 17% error rate) in its predictive precision. This research underscores the potential of integrating an astute wastewater control system with IoT and LSTM models, thereby hinting at prospective enhancements in the sustainability and operational efficacy of wastewater treatment installations.

This study constructs a model suitable for studying the performance of a Japanese speech recognition translation system based on a long short-term memory (LSTM) neural network. The impact of the matrix on the accuracy and recognition ratio of the speech recognition system is considered. This study provides a general introduction to the LSTM neural network, gives an overview of a Japanese speech recognition translation system, and presents experimental data to evaluate its performance. Then, the LSTM neural network is recommended for studying the Japanese speech translation recognition system, and a suitable model is established to conduct experiments on the system. By comparing example analyses, the experimental results show that the optimized PLSTM (Part-Aware Long Short-Term Memory) achieved an 8.09% improvement over an unoptimized LSTM network while maintaining recognition accuracy.

Natural language processing (NLP) has made great progress in recent years. However, there is a lack of relevant research on natural language processing of conversational situations, and many natural language processing methods for conversational situations have the problem of unbalanced information processing. In this paper, a weighted fusion Long Short-Term Memory (LSTM) neural network is proposed. The information of the two sides of the dialogue is processed step by step and weighted together to comprehensively consider the roles of the two sides in the context. Finally, a sentiment analysis model for the conversation environment is implemented, and the advantages of LSTM model are verified through comparative experiments.

Economy and carbon emissions optimization of different countries or areas in the world using an improved Attention mechanism based long short term memory neural network

The article examines the application of the Principal Component Analysis (PCA) and machine learning method, the Long Short-Term Memory (LSTM), in the prediction of the yield curve for Poland. The PCA was applied to decompose the yield curve, forecast its components using the LSTM, and obtain the yield curve predictions upon recomposition. The results from the PCA-LSTM model were compared to predictions generated directly by the LSTM model, simple autoregression and random walk, which serves as a benchmark. Overall, LSTM predictions are the most accurate with PCA-LSTM being a close second, nonetheless PCA-LSTM is more accurate in short-term forecasting of interest rates at long maturities. Both methods outperform the benchmark, while autoregression usually underperforms. For these reasons, the PCA-LSTM as well as the LSTM can be useful in interest rate management or building trading strategies. The PCA-LSTM has the advantage that it can focus on particular components of the yield curve, such as variability of the yield curve’s level or steepness.

An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

Abstract: This research is driven by the challenges faced by Universitas Lancang Kuning (UNILAK) in attracting applicants amidst intense competition, especially after the government's policy opened independent pathways to State Universities (PTN) from 2022-2023, which impacted private university applicant numbers. To address this and support strategic planning, this study aims to predict the trend of prospective students applying to all study programs at UNILAK for the period 2025-2027. Two time series models were employed: ARIMA (AutoRegressive Integrated Moving Average) and LSTM (Long Short-Term Memory). Applicant data from 2019 to 2024 was used to build the model. The Augmented Dickey-Fuller (ADF) test confirmed the data's stationarity with a p-value of 0.0. ACF and PACF analyses determined the ARIMA parameters as p=1, d=1, q=1. The LSTM model was trained to capture more complex data patterns. ARIMA predictions for 2025, 2026, and 2027 are 3298.66, 3362.33, and 3371.30, respectively. LSTM predictions for the same years are 3335.64, 3476.52, and 3518.42. Evaluation using Root Mean Squared Error (RMSE) showed ARIMA (RMSE=588.72) to be more accurate than LSTM (RMSE=653.96). Nevertheless, LSTM provided a more optimistic prediction. This study concludes that ARIMA is better suited for short-term planning, while LSTM can be used for more ambitious long-term strategies. Keywords: arima; LSTM; applicants; prediction; university Abstrak: Penelitian ini didorong oleh tantangan Universitas Lancang Kuning (UNILAK) dalam menarik pendaftar di tengah persaingan ketat, khususnya setelah kebijakan pemerintah membuka jalur mandiri ke Perguruan Tinggi Negeri (PTN) sejak 2022-2023, yang menyebabkan penurunan jumlah pendaftar di universitas swasta. Untuk mendukung perencanaan strategis, studi ini bertujuan memprediksi tren jumlah calon mahasiswa yang mendaftar ke seluruh program studi di UNILAK untuk periode 2025-2027.Dua model deret waktu digunakan: ARIMA (AutoRegressive Integrated Moving Average) dan LSTM (Long Short-Term Memory). Data jumlah pendaftar dari 2019 hingga 2024 digunakan untuk membangun model. Uji Augmented Dickey-Fuller (ADF) menunjukkan data stasioner dengan p-value 0,0. Analisis ACF dan PACF menentukan parameter ARIMA sebagai p=1, d=1, q=1. Model LSTM dilatih untuk menangkap pola data yang lebih kompleks.Prediksi ARIMA untuk 2025, 2026, dan 2027 adalah 3298.66, 3362.33, dan 3371.30. Prediksi LSTM untuk tahun yang sama adalah 3335.64, 3476.52, dan 3518.42. Evaluasi menggunakan Root Mean Squared Error (RMSE) menunjukkan ARIMA (RMSE=588.72) lebih akurat daripada LSTM (RMSE=653.96). Meskipun demikian, LSTM memberikan prediksi yang lebih optimis. Studi ini menyimpulkan ARIMA lebih cocok untuk perencanaan jangka pendek, sementara LSTM dapat digunakan untuk strategi jangka panjang yang ambisius. Kata kunci: arima; LSTM; pendaftar; prediksi; universitas

Purpose This study aims to enhance cryptocurrency price and trend prediction by applying advanced machine learning (ML) techniques. Given the market’s high volatility and complexity, the research identifies effective models for different conditions, providing insights for investors and risk management. Design/methodology/approach This study proposes a six-stage framework for cryptocurrency price prediction, integrating advanced ML techniques. Data from ten cryptocurrencies are processed, extracting 37 key features, including return, the Fear and Greed Index and various technical indicators. The model employs Deep Q-Networks (DQN), Long Short-Term Memory (LSTM) and multiple regression methods such as linear regression, support vector regression, ridge, LASSO, decision tree, Random Forest, multi-layer perceptron, stochastic gradient descent, elastic net and Bayesian regression. Model performance is evaluated using trading strategies and metrics like accuracy, sensitivity, recall, MSE, MAE and F1-score. Findings The results indicate that complex models like DQN and LSTM excel in volatile markets due to their ability to capture intricate price patterns, whereas simpler models such as linear regression and ridge regression perform better in stable conditions. The multi-layered parallel design enhances computational efficiency, enabling independent asset evaluation. These findings highlight the potential of artificial intelligence in improving prediction accuracy and supporting informed investment decisions. Originality/value This research introduces a novel six-stage ML framework incorporating diverse predictive models and key features for cryptocurrency forecasting. The multi-layered parallel approach enhances computational efficiency, setting this study apart from existing research. The comparative analysis of models offers valuable guidance for investors, traders and financial analysts navigating volatile cryptocurrency markets.

With the rapid development of Internet technology and social media, people are accustomed to making comments on the Internet. Sentiment analysis, as an efficient technique, has been used by researchers in the tasks of analysing the sentiment polarity under these comments. To better achieve this target, the fundamental challenge is how to extract the feature and build a proper mechanism to learn them. A lot of word embedding based deep learning models for sentiment analysis are proposed in the literature. And the semi-supervised learning methods make it possible to use both labelled and unlabelled data for this kind of task. Furthermore, the attention mechanism proposed in recent years has achieved great accomplishments for natural language processing (NLP) tasks since it helps to capture the important information of the documents. In this paper, inspired by these works, we proposed a long short term memory (LSTM) based semi-supervised attention framework for sentiment analysis tasks, which is composed of an unsupervised attention based LSTM encoder-decoder and an attention based supervised LSTM model attached by a Softmax layer. The unsupervised part worked for attaining the high dimensional representation of the documents, and the supervised part extracted feature and enhanced the important parts for classification. Experimental study on commonly used datasets has demonstrated its ability for sentiment analysis tasks.

The airfoil inverse design is a crucial engineering challenge in the field of aerospace. The feature extraction capability of deep learning provides a new approach to address airfoil inverse design problems. This paper investigates the application of the long short-term memory (LSTM) neural network to airfoil inverse design under given local pressure coefficients (Cp) and friction coefficients (Cf). The database contains 625 samples for National Advisory Committee for Aeronautics airfoils at Mach numbers (Ma) from 0.2 to 0.5. Primarily, the mean relative error (MRE) for prediction is less than 0.94% when the sequence length parameter (λ) is set to 20%, suggesting the high precision of the LSTM model in airfoil inverse design. Then, the effects of the predicted location are analyzed in the present model. Subsequently, several sub-LSTM models are integrated, inspired by the Mixture of Experts approach. This multi-position long and short-term memory model (MP-LSTM) is aimed at addressing incomplete geometric predictions and fully utilizing the upstream and downstream information in the aerodynamic sequence, further reducing the MRE by 23%–0.724%. Finally, the MP-LSTM model is proven to reduce prediction errors up to 64% and 72% compared with previous convolutional neural network and conditional generative adversarial network models, respectively. This study presents an accurate local prediction model in airfoil inverse design rather than other global models, which is more flexible for further airfoil optimization.