Predicting CO2 trapping in deep saline aquifers using optimized long short-term memory.

The Swarm intelligence algorithm is a very prevalent field in which some scholars have made outstanding achievements. As a representative, Slime mould algorithm (SMA) is widely used because of its superior initial performance. Therefore, this paper focuses on the improvement of the SMA and the mitigation of its stagnation problems. For this aim, the structure of SMA is adjusted to develop the efficiency of the original method. As a stochastic optimizer, SMA mainly stimulates the behavior of slime mold in nature. For the harmony of the exploration and exploitation of SMA, the paper proposed an enhanced algorithm of SMA called ECSMA, in which two mechanisms are embedded into the structure: elite strategy, and chaotic stochastic strategy. The details of the original SMA and the two introduced strategies are given in this paper. Then, the advantages of the improved SMA through mechanism comparison, balance-diversity analysis, and contrasts with other counterparts are validated. The experimental results demonstrate that both mechanisms have a significant enhancing effect on SMA. Also, SMA is applied to four structural design issues of the welded beam design problem, PV design problem, I-beam design problem, and cantilever beam design problem with excellent results.

In the realm of power systems, short-term electric load forecasting is pivotal for ensuring supply–demand balance, optimizing generation planning, reducing operational costs, and maintaining grid stability. Short-term load curves are characteristically coarse, revealing high-frequency data upon decomposition that exhibit pronounced non-linearity and significant noise, complicating efforts to enhance forecasting precision. To address these challenges, this study introduces an innovative model. This model employs complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) to bifurcate the original load data into low- and high-frequency components. For the smoother low-frequency data, a temporal convolutional network (TCN) is utilized, whereas the high-frequency components, which encapsulate detailed load history information yet suffer from a lower fitting accuracy, are processed using an enhanced soft thresholding TCN (SF-TCN) optimized with the slime mould algorithm (SMA). Experimental tests of this methodology on load forecasts for the forthcoming 24 h across all seasons have demonstrated its superior forecasting accuracy compared to that of non-decomposed models, such as support vector regression (SVR), recurrent neural network (RNN), gated recurrent unit (GRU), long short-term memory (LSTM), convolutional neural network-LSTM (CNN-LSTM), TCN, Informer, and decomposed models, including CEEMDAN-TCN and CEEMDAN-TCN-SMA.

Most Graph Neural Networks (GNNs) follow the message-passing scheme. Residual connection is an effective strategy to tackle GNNs' over-smoothing issue and performance reduction issue on non-homophilic networks. Unfortunately, the coarse-grained residual connection still suffers from class-imbalanced over-smoothing issue, due to the fixed and linear combination of topology and attribute in node representation learning. To make the combination flexible to capture complicated relationship, this paper reveals that the residual connection needs to be node-dependent, layer-dependent, and related to both topology and attribute. To alleviate the difficulty in specifying complicated relationship, this paper presents a novel perspective on GNNs, i.e., the representations of one node in different layers can be seen as a sequence of states. From this perspective, existing residual connections are not flexible enough for sequence modeling. Therefore, a novel node-dependent residual connection, i.e., Long Short-Term Graph Memory Network (LSTGM) is proposed to employ Long Short-Term Memory (LSTM), to model the sequence of node representation. To make the graph topology fully employed, LSTGM innovatively enhances the updated memory and three gates with graph topology. A speedup version is also proposed for effective training. Experimental evaluations on real-world datasets demonstrate their effectiveness in preventing over-smoothing issue and handling networks with heterophily.

The research study is to predict human activity recognition and analyze their strength in machine learning (ML) processes to achieve precision and also to determine performance of human activities. The framework to classify the Novel Long Short Term Memory (LSTM) and Decision Tree (DT) to perform all measures. This research study used the Novel Long Short Term Memory and Decision Tree to perform the required actions to accurately identify body movements in adjacent film sequence. Recent study findings and a threshold of 0.05%, as well as 95% confidence interval and standard parameter estimates, were castoff in a study 47 samples divided into two groups calculated using the G-power of 80%. Since the novel Long Short Term Memory (LSTM) algorithm and local invariant methods have achieved an accuracy of 93.83% in predicting the activity analysis, this research needs to obtain improved accuracy to perform activity prediction by using the Decision Tree algorithm. When applied to human activity analysis, the Novel Long Short Term Memory technique was shown to have an accuracy of 90.12 percent, with a 95% confidence interval including the value 0.045 (p 0.05). Researchers found that when comparing two algorithms for analyzing human behaviour, Long Short Term Memory (LSTM) performed much better than Decision Tree (DT).

An optimized neuro-fuzzy system using advance nature-inspired Aquila and Salp swarm algorithms for smart predictive residual and solubility carbon trapping efficiency in underground storage formations

Online leakage current classification using convolutional neural network long short-term memory for high voltage insulators on web-based service

Long short-term memory - Fully connected (LSTM-FC) neural network for PM2.5 concentration prediction

Abstract: This research is driven by the challenges faced by Universitas Lancang Kuning (UNILAK) in attracting applicants amidst intense competition, especially after the government's policy opened independent pathways to State Universities (PTN) from 2022-2023, which impacted private university applicant numbers. To address this and support strategic planning, this study aims to predict the trend of prospective students applying to all study programs at UNILAK for the period 2025-2027. Two time series models were employed: ARIMA (AutoRegressive Integrated Moving Average) and LSTM (Long Short-Term Memory). Applicant data from 2019 to 2024 was used to build the model. The Augmented Dickey-Fuller (ADF) test confirmed the data's stationarity with a p-value of 0.0. ACF and PACF analyses determined the ARIMA parameters as p=1, d=1, q=1. The LSTM model was trained to capture more complex data patterns. ARIMA predictions for 2025, 2026, and 2027 are 3298.66, 3362.33, and 3371.30, respectively. LSTM predictions for the same years are 3335.64, 3476.52, and 3518.42. Evaluation using Root Mean Squared Error (RMSE) showed ARIMA (RMSE=588.72) to be more accurate than LSTM (RMSE=653.96). Nevertheless, LSTM provided a more optimistic prediction. This study concludes that ARIMA is better suited for short-term planning, while LSTM can be used for more ambitious long-term strategies. Keywords: arima; LSTM; applicants; prediction; university Abstrak: Penelitian ini didorong oleh tantangan Universitas Lancang Kuning (UNILAK) dalam menarik pendaftar di tengah persaingan ketat, khususnya setelah kebijakan pemerintah membuka jalur mandiri ke Perguruan Tinggi Negeri (PTN) sejak 2022-2023, yang menyebabkan penurunan jumlah pendaftar di universitas swasta. Untuk mendukung perencanaan strategis, studi ini bertujuan memprediksi tren jumlah calon mahasiswa yang mendaftar ke seluruh program studi di UNILAK untuk periode 2025-2027.Dua model deret waktu digunakan: ARIMA (AutoRegressive Integrated Moving Average) dan LSTM (Long Short-Term Memory). Data jumlah pendaftar dari 2019 hingga 2024 digunakan untuk membangun model. Uji Augmented Dickey-Fuller (ADF) menunjukkan data stasioner dengan p-value 0,0. Analisis ACF dan PACF menentukan parameter ARIMA sebagai p=1, d=1, q=1. Model LSTM dilatih untuk menangkap pola data yang lebih kompleks.Prediksi ARIMA untuk 2025, 2026, dan 2027 adalah 3298.66, 3362.33, dan 3371.30. Prediksi LSTM untuk tahun yang sama adalah 3335.64, 3476.52, dan 3518.42. Evaluasi menggunakan Root Mean Squared Error (RMSE) menunjukkan ARIMA (RMSE=588.72) lebih akurat daripada LSTM (RMSE=653.96). Meskipun demikian, LSTM memberikan prediksi yang lebih optimis. Studi ini menyimpulkan ARIMA lebih cocok untuk perencanaan jangka pendek, sementara LSTM dapat digunakan untuk strategi jangka panjang yang ambisius. Kata kunci: arima; LSTM; pendaftar; prediksi; universitas

The slime mould algorithm (SMA), as an emerging and promising swarm intelligence algorithm, has been studied in various fields. However, SMA suffers from issues such as easily getting trapped in local optima and slow convergence, which pose challenges when applied to practical problems. Therefore, this study proposes an improved SMA, named HESMA, by incorporating the covariance matrix adaptation evolution strategy (CMA-ES) and storing the best position of each individual (SBP). On one hand, CMA-ES enhances the algorithm’s local exploration capability, addressing the issue of the algorithm being unable to explore the vicinity of the optimal solution. On the other hand, SBP enhances the convergence speed of the algorithm and prevents it from diverging to other inferior solutions. Finally, to validate the effectiveness of our proposed algorithm, this study conducted experiments on 30 IEEE CEC 2017 benchmark functions and compared HESMA with 12 conventional metaheuristic algorithms. The results demonstrated that HESMA indeed achieved improvements over SMA. Furthermore, to highlight the performance of HESMA further, this study compared it with 13 advanced algorithms, and the results showed that HESMA outperformed these advanced algorithms significantly. Next, this study applied HESMA to five engineering optimization problems, and the experimental results revealed that HESMA exhibited significant advantages in solving real-world engineering optimization problems. These findings further support the effectiveness and practicality of our algorithm in addressing complex engineering design challenges.

Research on sentiment analysis in recent years has increased. However, in sentiment analysis research there are still few ideas about the handling of negation, one of which is in the Indonesian sentence. This results in sentences that contain elements of the word negation have not found the exact polarity.The purpose of this research is to analyze the effect of the negation word in Indonesian. Based on positive, neutral and negative classes, using attention-based Long Short Term Memory and word2vec feature extraction method with continuous bag-of-word (CBOW) architecture. The dataset used is data from Twitter. Model performance is seen in the accuracy value.The use of word2vec with CBOW architecture and the addition of layer attention to the Long Short Term Memory (LSTM) and Bidirectional Long Short Term Memory (BiLSTM) methods obtained an accuracy of 78.16% and for BiLSTM resulted in an accuracy of 79.68%. whereas in the FSW algorithm is 73.50% and FWL 73.79%. It can be concluded that attention based BiLSTM has the highest accuracy, but the addition of layer attention in the Long Short Term Memory method is not too significant for negation handling. because the addition of the attention layer cannot determine the words that you want to pay attention to.

Simple SummaryForecasting dengue cases often face challenges from (1) time-effectiveness due to time-consuming satellite data downloading and processing, (2) weak spatial representation due to data dependence on administrative unit-based statistics or weather station-based observations, and (3) stagnant accuracy without historical dengue cases. With the advance of the geospatial big data cloud computing in Google Earth Engine and deep learning, this study proposed an efficient framework of dengue prediction at an epidemiological week basis using geospatial big data analysis in Google Earth Engine and Long Short Term Memory modeling. We focused on the dengue epidemics in the Federal District of Brazil during 2007–2019. Based on Google Earth Engine and epidemiological calendar, we computed the weekly composite for each dengue driving factor, and spatially aggregated the pixel values into dengue transmission areas to generate the time series of driving factors. A multi-step-ahead Long Short Term Memory modeling was used, and the time-differenced natural log-transformed dengue cases and the time series of driving factors were considered as outcomes and explantary factors, respectively, with two modeling scenarios (with and without historical cases). The performance is better when historical cases were used, and the 5-weeks-ahead forecast has the best performance.Timely and accurate forecasts of dengue cases are of great importance for guiding disease prevention strategies, but still face challenges from (1) time-effectiveness due to time-consuming satellite data downloading and processing, (2) weak spatial representation capability due to data dependence on administrative unit-based statistics or weather station-based observations, and (3) stagnant accuracy without the application of historical case information. Geospatial big data, cloud computing platforms (e.g., Google Earth Engine, GEE), and emerging deep learning algorithms (e.g., long short term memory, LSTM) provide new opportunities for advancing these efforts. Here, we focused on the dengue epidemics in the urban agglomeration of the Federal District of Brazil (FDB) during 2007–2019. A new framework was proposed using geospatial big data analysis in the Google Earth Engine (GEE) platform and long short term memory (LSTM) modeling for dengue case forecasts over an epidemiological week basis. We first defined a buffer zone around an impervious area as the main area of dengue transmission by considering the impervious area as a human-dominated area and used the maximum distance of the flight range of Aedes aegypti and Aedes albopictus as a buffer distance. Those zones were used as units for further attribution analyses of dengue epidemics by aggregating the pixel values into the zones. The near weekly composite of potential driving factors was generated in GEE using the epidemiological weeks during 2007–2019, from the relevant geospatial data with daily or sub-daily temporal resolution. A multi-step-ahead LSTM model was used, and the time-differenced natural log-transformed dengue cases were used as outcomes. Two modeling scenarios (with and without historical dengue cases) were set to examine the potential of historical information on dengue forecasts. The results indicate that the performance was better when historical dengue cases were used and the 5-weeks-ahead forecast had the best performance, and the peak of a large outbreak in 2019 was accurately forecasted. The proposed framework in this study suggests the potential of the GEE platform, the LSTM algorithm, as well as historical information for dengue risk forecasting, which can easily be extensively applied to other regions or globally for timely and practical dengue forecasts.

The objective of this research is to develop a Deep Learning model to forecast the stock price, by using the variant of Long Short-Term Memory. This model predicts the close price of the stock for the future selected date, choosing as inputs the following data: open, high, low, adj close and close prices. This model shows a comparative analysis between three different LSTM networks: Long Short-Term Memory (LSTM), Stacked Long Short-Term Memory (Stacked LSTM), and Stacked Bi-directional Long Short-Term Memory (Stacked Bidirectional LSTM) concluding which one is the best and implementing the model using that variant. We have used the historical stock prices data from yahoo’s financial website over 5 years, by choosing multiple datasets: Apple, Amazon, Google, Meta, Microsoft and Tesla (daily values). In order to get effective in the forecasting model, we have tested the network with different iterations and epochs. The model represents Multiple Graphs for data visualization in different comparisons. We have estimated the effectiveness of our proposed model by using the following performance indicators: the Mean Square Error (MSE), the Root Mean Square Error (RMSE), and the R-Squared of the model. The experimental results clearly show that our Stacked Bi-LSTM model has the highest accuracy values when comparing with the LSTM and Stacked LSTM Models. Hence, we can conclude that our Stacked Bi-LSTM Model is suitable for accurate prediction of the stock market time series. Key Words: stock price prediction, Machine Learning, stacked LSTM, Bi-directional LSTM, Deep Learning, Data pre-processing techniques, Data normalization, Data Visualization, Training and Testing Set, Financial Time Series, Future prediction

Software effort estimation (SEE) is an important process for predicting the effort required to develop or maintain software projects. It is considered one of the difficult challenges for software engineering because the more accurate the estimation, the greater the chances of success in developing software projects to complete and deliver them within the specified scheduling and budget. The diversity in software projects led to the use of many techniques to estimate the effort. The main objective of the research is to find the best technique to get the estimated effort as close to the real effort, using Machine learning Algorithms, artificial neural network Long Short-Term Memory(LSTM) and the artificial neural network Stacked Long Short-Term Memory (Stacked_LSTM), with six data sets are China, Kitchenham, Kemerer, Cocomo 81, Albrecht, Decharnais, and comparing the performance of the two machine learning algorithms performance, Neuralnet and Lasso from previous research, used the same data sets and using the same evaluation metrics, which are: the root mean square error (RMSE), mean absolute error (MAE) and R_Squared. The results demonstrated the superiority of the Stacked _LSTM algorithm by all metrics with the dataset of China, Kemerer and Albrecht, while in the data sets, Descharnais and Kitchenham, the LSTM algorithm outperformed the rest of the methods. While in the Cocomo 81 dataset, Neuralnet algorithm outperformed the rest of the techniques used, but the best rating was obtained. It is for Stacked _LSTM algorithm with China data.

Gender classification by computer is essential for applications in many domains, such as human-computer interaction or biometric system applications. Generally, gender classification by computer can be done by using a face photo, fingerprint, or voice. However, researchers have demonstrated the potential of the electrocardiogram (ECG) as a biometric recognition and gender classification. In facilitating the process of gender classification based on ECG signals, a method is needed, namely Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (Bi-LSTM). Researchers use these two methods because of the ability of these two methods to deal with sequential problems such as ECG signals. The inputs used in both methods generally use one-dimensional data with a generally large number of signal features. The dataset used in this study has a total of 10,000 features. This research was conducted on changing the input shape to determine its effect on classification performance in the LSTM and Bi-LSTM methods. Each method will be tested with input with 11 different shapes. The best accuracy results obtained are 79.03% with an input shape size of 100×100 in the LSTM method. Moreover, the best accuracy in the Bi-LSTM method with input shapes of 250×40 is 74.19%. The main contribution of this study is to share the impact of various input shape sizes to enhance the performance of gender classification based on ECG signals using LSTM and Bi-LSTM methods. Additionally, this study contributes for selecting an appropriate method between LSTM and Bi-LSTM on ECG signals for gender classification.

CO2 storage in saline aquifers: A simulation on quantifying the impact of permeability heterogeneity