IoT and Ensemble Long-Short-Term-Memory-Based Evapotranspiration Forecasting for Riyadh.

Many countries around the globe, including Tanzania, are investing in renewable energy, partly because of the need to increase electric power generation and meet the ever-increasing electricity demands, and partly because of the need to combat global climate change caused by carbon emissions from fossil fuel-based electricity production. Kishapu Solar Project, located in Kishapu District, Shinyanga Region, Tanzania, is one of the renewable energy projects with a planned generation of 150 MW of electric power once completed, using solar photovoltaic technology. Accurate forecasting of solar radiation is important in managing and maintaining solar energy plants. Inaccurate forecasting of solar radiation can lead to poor harvest of solar energy and poor management of solar energy plants, which directly impacts electricity contribution to the national electricity grid. Long Short-Term Memory (LSTM) and its variant, PeepHole LSTM, are examples of Deep Learning models that can be used to predict solar radiation. The purpose of PeepHole LSTM is to introduce “peephole” connections in the LSTM model, which allow LSTM gates to directly inspect memory cell state and hence have richer information to process. However, there is still a research gap on the impact of “peephole” connections on the prediction performance of the LSTM model, especially in the context of forecasting solar radiation in Kishapu District, where the Kishapu Solar Project is located. The purpose of this study is to fill this research gap by developing both LSTM and PeepHole LSTM models and comparing their performances in forecasting solar radiation in Kishapu District. The 14-year Kishapu District daily solar radiation (Downward Shortwave Radiation) dataset was first pre-processed by scaling (normalizing) it using Standard Scaler and then split into training set (the first 70%), validation set (the next 15%) and test set (the last 15%) before being utilized to train and test the developed LSTM and PeepHole LSTM models. Both LSTM and PeepHole LSTM models used the previous 5 days' solar radiation values as inputs to predict the output (next day (6th day) solar radiation value). The trained and better-performing model between the two was finally saved in .h5 format and integrated with a Gradio based Web Application to provide a user interface for officials in Kishapu District and at Kishapu Solar Project to predict daily solar radiation. The findings from performance evaluation revealed that the LSTM model outperformed the PeepHole LSTM model in predicting solar radiation by achieving test Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) scores of 26.22 W/m2 and 36.65 W/m2, respectively, compared to MAE and RMSE scores of 30.84 W/m2 and 41.88 W/m2, respectively, achieved by the PeepHole LSTM model, concluding that “peephole” connections reduce the performance of the LSTM model rather than increasing it when used to forecast solar radiation in Kishapu District. This study’s recommendation to Artificial Intelligence (AI) software developers and researchers is to use the LSTM rather than the PeepHole LSTM Deep Learning model when forecasting solar radiation in Kishapu District and in locations with similar climatic conditions

Abstract: This research is driven by the challenges faced by Universitas Lancang Kuning (UNILAK) in attracting applicants amidst intense competition, especially after the government's policy opened independent pathways to State Universities (PTN) from 2022-2023, which impacted private university applicant numbers. To address this and support strategic planning, this study aims to predict the trend of prospective students applying to all study programs at UNILAK for the period 2025-2027. Two time series models were employed: ARIMA (AutoRegressive Integrated Moving Average) and LSTM (Long Short-Term Memory). Applicant data from 2019 to 2024 was used to build the model. The Augmented Dickey-Fuller (ADF) test confirmed the data's stationarity with a p-value of 0.0. ACF and PACF analyses determined the ARIMA parameters as p=1, d=1, q=1. The LSTM model was trained to capture more complex data patterns. ARIMA predictions for 2025, 2026, and 2027 are 3298.66, 3362.33, and 3371.30, respectively. LSTM predictions for the same years are 3335.64, 3476.52, and 3518.42. Evaluation using Root Mean Squared Error (RMSE) showed ARIMA (RMSE=588.72) to be more accurate than LSTM (RMSE=653.96). Nevertheless, LSTM provided a more optimistic prediction. This study concludes that ARIMA is better suited for short-term planning, while LSTM can be used for more ambitious long-term strategies. Keywords: arima; LSTM; applicants; prediction; university Abstrak: Penelitian ini didorong oleh tantangan Universitas Lancang Kuning (UNILAK) dalam menarik pendaftar di tengah persaingan ketat, khususnya setelah kebijakan pemerintah membuka jalur mandiri ke Perguruan Tinggi Negeri (PTN) sejak 2022-2023, yang menyebabkan penurunan jumlah pendaftar di universitas swasta. Untuk mendukung perencanaan strategis, studi ini bertujuan memprediksi tren jumlah calon mahasiswa yang mendaftar ke seluruh program studi di UNILAK untuk periode 2025-2027.Dua model deret waktu digunakan: ARIMA (AutoRegressive Integrated Moving Average) dan LSTM (Long Short-Term Memory). Data jumlah pendaftar dari 2019 hingga 2024 digunakan untuk membangun model. Uji Augmented Dickey-Fuller (ADF) menunjukkan data stasioner dengan p-value 0,0. Analisis ACF dan PACF menentukan parameter ARIMA sebagai p=1, d=1, q=1. Model LSTM dilatih untuk menangkap pola data yang lebih kompleks.Prediksi ARIMA untuk 2025, 2026, dan 2027 adalah 3298.66, 3362.33, dan 3371.30. Prediksi LSTM untuk tahun yang sama adalah 3335.64, 3476.52, dan 3518.42. Evaluasi menggunakan Root Mean Squared Error (RMSE) menunjukkan ARIMA (RMSE=588.72) lebih akurat daripada LSTM (RMSE=653.96). Meskipun demikian, LSTM memberikan prediksi yang lebih optimis. Studi ini menyimpulkan ARIMA lebih cocok untuk perencanaan jangka pendek, sementara LSTM dapat digunakan untuk strategi jangka panjang yang ambisius. Kata kunci: arima; LSTM; pendaftar; prediksi; universitas

The effective integration of photovoltaic (PV) systems into the grid which facilitates better planning and resource allocation depends on accurate day-ahead solar power forecasts. This paper proposes a Long Short-Term Memory (LSTM) model for forecasting solar power generation one day in advance with the algorithm inspired by Ant Colony Optimization (ACO). A year's worth of real-time data for a 4.5 kW PV system is used to train and test the model with input characteristics including temperature, PV power production and solar irradiation. Over the course of three seasons—summer, winter, and monsoon—the performance of the ACO-optimized LSTM model is contrasted with that of a simple LSTM model and an LSTM model enhanced by particle swarm optimization (PSO). This encompasses metrics like R-squared (R²) values, Mean Absolute Error (MAE) and Root Mean Square Error (RMSE). The PSO-optimized LSTM model (MAE of 0.31 kW, RMSE of 0.38 kW and R² of 0.88) and the baseline LSTM model (MAE of 0.35 kW, RMSE of 0.42 kW and R² of 0.85) couldn't match the ACO-optimized LSTM model's summertime MAE of 0.27 kW, RMSE of 0.33 kW and R² of 0.92. Similar trends also surfaced throughout the monsoon and winter seasons, with the ACO-optimized model consistently outperforming the others. In the winter, for instance, it obtained an R² of 0.93, an RMSE of 0.26 kW and an MAE of 0.22 kW. With regard to hyper parameter optimization and overall performance, these findings demonstrate the ACO-optimized LSTM model's superiority over the baseline and PSO-optimized LSTM models highlighting its improved prediction precision for all seasons. The effectiveness of ACO in bolstering solar power forecast models is confirmed by this study and provides a solid basis for deep learning model improvement in practical PV applications.

The objective of this research is to develop a Deep Learning model to forecast the stock price, by using the variant of Long Short-Term Memory. This model predicts the close price of the stock for the future selected date, choosing as inputs the following data: open, high, low, adj close and close prices. This model shows a comparative analysis between three different LSTM networks: Long Short-Term Memory (LSTM), Stacked Long Short-Term Memory (Stacked LSTM), and Stacked Bi-directional Long Short-Term Memory (Stacked Bidirectional LSTM) concluding which one is the best and implementing the model using that variant. We have used the historical stock prices data from yahoo’s financial website over 5 years, by choosing multiple datasets: Apple, Amazon, Google, Meta, Microsoft and Tesla (daily values). In order to get effective in the forecasting model, we have tested the network with different iterations and epochs. The model represents Multiple Graphs for data visualization in different comparisons. We have estimated the effectiveness of our proposed model by using the following performance indicators: the Mean Square Error (MSE), the Root Mean Square Error (RMSE), and the R-Squared of the model. The experimental results clearly show that our Stacked Bi-LSTM model has the highest accuracy values when comparing with the LSTM and Stacked LSTM Models. Hence, we can conclude that our Stacked Bi-LSTM Model is suitable for accurate prediction of the stock market time series. Key Words: stock price prediction, Machine Learning, stacked LSTM, Bi-directional LSTM, Deep Learning, Data pre-processing techniques, Data normalization, Data Visualization, Training and Testing Set, Financial Time Series, Future prediction

Deep Learning is a promising domain. It has different applications in different areas of life, and its application on the stock market is widely used due to its efficiency. Long Short-Term Memory (LSTM) proved its efficiency in dealing with time series data due to the unique hidden unit structure. This paper integrated LSTM with Attention Mechanism and sentiment analysis to forecast the closing price of two stocks, namely APPL and TSLA, from the NASDAQ stock market. We compared our hybrid model with LSTM, LSTM with sentiment analysis, and LSTM with Attention Mechanism. Three benchmarks are used to measure the performance of the models, the first one is Mean Square Error (MSE), the second one is Root Mean Square Error (RMSE), and the third one is Mean Absolute Error (MAE). The results show that the hybridization is more accurate compared to only LSTM model.

The long short-term memory (LSTM) model is widely used in multiple areas, mainly for speech recognition, natural language processing and activity recognition. In the last few years, we started to see many variants of LSTM for recurrent neural networks since its inception in 1997. However, there weren’t many studies that have addressed the LSTM’s gating mechanism. In this paper, we propose a novel LSTM framework where we modify the architecture of the LSTM unit by adding a new layer that we call the “outlier gate”. The latter controls the flow of information that goes into the LSTM cell. This added signal allows us to avoid both the carry-over effect that the outliers have on the forecasted point and a bias in the estimates of our LSTM model – caused by unusual or non-repetitive events. The proposed architecture led us to an end-to-end trainable model that we applied in this paper to a financial time-series forecasting problem. Our results demonstrate that the new proposed LSTM architecture achieves better performance than the state-of-the-art original LSTM model.

A CNN encoder decoder LSTM model for sustainable wind power predictive analytics

Wearable electroencephalography (EEG) devices for seizure detection accuracy and reliability are deep learning (DL) applications in the field of epilepsy diagnosis. In this study, we sought to increase the accuracy of seizure detection using advanced DL algorithms on the Children’s Hospital Boston - Massachusetts Institute of Technology (CHB-MIT) EEG database. First, a fully convolutional network (FCN) was trained and assessed using accuracy and recall/precision metrics, and the early stopping technique was used to avoid overfitting. To assess the performance, the FCN was evaluated in terms of various metrics, including accuracy, precision, recall, F1-score, and receiver operating characteristic (ROC)-area under the curve (AUC). In addition, two-dimensional (2D) convolutional neural networks (CNNs) and long short-term memory (LSTM) models were used to model the database, and their performance was thoroughly measured using different metrics, graphs, and confusion matrices. Using LSTM variants, such as standard LSTM, bidirectional LSTM, stacked LSTM, and LSTM attention mechanisms, hybrid convolutional LSTM (ConvLSTM) models were trained and compared. The comparison was conducted based on the training and validation accuracy and loss, as well as the graphs resulting from the precision–recall curves. Apart from DL approaches, EEG signal analysis using time–frequency techniques, such as wavelet transform and short-time Fourier transform, has also been investigated. These methods assisted in the analysis of the time–frequency features of EEG signals in combination with DL models. This study demonstrates that the performance of wearable EEG devices can be augmented using a combination of DL and seizure signal processing techniques. The FCN achieved an accuracy of 92%, with a recall for seizures of 33%, an F1-score of 0.03, and strong ROC-AUC results. The 2D CNN achieved 96% accuracy, a seizure recall of 70%, an F1-score of 0.12, and an ROC-AUC score of 78%. The baseline LSTM struggled with effectiveness at 53% accuracy with a seizure recall of 18%. In contrast, the LSTM model, which incorporated synthetic minority oversampling technique (SMOTE) balancing, was able to reach improvements of up to 89% accuracy, with a precision of 91%, a recall of 86%, an F1-score of 0.89, and a strong ROC curve performance. Among the models, the LSTM with SMOTE was the best performer, with 89% accuracy, 91% precision, 86% recall, and an F1-score of 0.89. These results provide evidence that applying techniques for data balancing in combination with certain DL network architectures significantly improves the detection of seizures using wearable EEG devices worn on the body. We believe that real-time monitoring and high-performance systems are feasible using optimized DL frameworks. The analysis of the performance of different models allows for the understanding of the possibilities of optimizing the architectures of DL algorithms for the modern diagnosis of epilepsy in real time. The source code used to carry out the experiments is publicly available at CHB-MIT EEG Dataset Python Scripts (https://www.kaggle.com/code/adnankust/adnaneeg1).

<span lang="EN-US">Multi-target vehicle detection in urban traffic faces challenges such as poor lighting, small object sizes, and diverse vehicle types, impacting traffic flow prediction accuracy. This study introduces an optimized long short-term memory (LSTM) model using the Komodo Mlipir algorithm (KMA) to enhance prediction accuracy. Traffic video data are processed with YOLO for vehicle classification and object counting. The LSTM model, trained to capture traffic patterns, employs parameters optimized by KMA, including learning rate, neuron count, and epochs. KMA integrates mutation and crossover strategies to enable adaptive selection in global and local searches. The model's performance was evaluated on an urban traffic dataset with uniform configurations for population size and key LSTM parameters, ensuring consistent evaluation. Results showed LSTM-KMA achieved a root mean square error (RMSE) of 14.5319, outperforming LSTM (16.6827), LSTM-improved dung beetle optimization (IDBO) (15.0946), and LSTM-particle swarm optimization (PSO) (15.0368). Its mean absolute error (MAE), at 8.7041, also surpassed LSTM (9.9903), LSTM-IDBO (9.0328), and LSTM-PSO (9.0015). LSTM-KMA effectively tackles multi-target detection challenges, improving prediction accuracy and transportation system efficiency. This reliable solution supports real-time urban traffic management, addressing the demands of dynamic urban environments.</span>

Cryptocurrencies have gained immense popularity in recent years as an emerging asset class, and their prices are known to be highly volatile. Predicting cryptocurrency prices is a difficult task due to their complex nature and the absence of a central authority. In this paper, our proposal is to employ Long Short-Term Memory (LSTM) networks, a type of deep learning technique to forecast the prices of cryptocurrencies. We use historical price data and technical indicators as inputs to the LSTM model, which learns the underlying patterns and trends in the data. To improve the accuracy of the predictions, we also incorporate a Change Point Detection (CPD) technique using the Pruned Exact Linear Time (PELT) algorithm. This method allows us to detect significant changes in cryptocurrency prices and adjust the LSTM model accordingly, leading to better predictions. We evaluate our approach predominantly on Bitcoin cryptocurrency, but the model can be implemented on other cryptocurrencies provided there are valid historical price data. Our experimental results show that our proposed model outperforms the baseline LSTM algorithm, achieving higher accuracy and better performance in terms of Mean Absolute Error (MAE), Mean Square Error (MSE), and Root Mean Square Error (RMSE). Our research findings suggest that combining deep learning techniques such as LSTM with change point detection techniques such as PELT can improve cryptocurrency price prediction accuracy and have practical implications for investors, traders, and financial analysts.

Compressive strength is an important mechanical property of high-strength concrete (HSC), but testing methods are usually uneconomical, time-consuming, and labor-intensive. To this end, in this paper, a long short-term memory (LSTM) model was proposed to predict the HSC compressive strength using 324 data sets with five input independent variables, namely water, cement, fine aggregate, coarse aggregate, and superplasticizer. The prediction results were compared with those of the conventional support vector regression (SVR) model using four metrics, root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and correlation coefficient (R2). The results showed that the prediction accuracy and reliability of LSTM were higher with R2 = 0.997, RMSE = 0.508, MAE = 0.08, and MAPE = 0.653 compared to the evaluation metrics R2 = 0.973, RMSE = 1.595, MAE = 0.312, MAPE = 2.469 of the SVR model. The LSTM model is recommended for the pre-estimation of HSC compressive strength under a given mix ratio before the laboratory compression test. Additionally, the Shapley additive explanations (SHAP)-based approach was performed to analyze the relative importance and contribution of the input variables to the output compressive strength.

The smart buildings’ load forecasting is necessary for efficient energy management, and it is easily possible because of the data availability based on widespread use of Internet of Things (IoT) devices and automation systems. The information of buildings’ occupancy is directly associated with energy consumption. Therefore, we present a hybrid model consisting of a Long Short-Term Memory (LSTM) network, Extreme Gradient Boosting (XgBoost), Random Forest (RF) and Linear Regression (LR) for commercial and academic buildings’ load forecasting. The correlation between occupants’ count and total load of the building is calculated using Pearson Correlation Coefficient (PCC). The comparative analysis of the proposed approach with LSTM, XgBoost, RF and Gated Recurrent Unit (GRU) is also performed. Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Square Error (MSE) and Normalized Root Mean Square Error (NRMSE) are used as performance indicators for evaluating performance. Findings indicate that the proposed hybrid approach outperforms other models. The RMSE and MAE of 2.99 and 2.18, respectively, are recorded by the proposed model for commercial building dataset while for academic building the RMSE and MAE are 4.48 and 2.85, respectively. Occupancy and load consumption have a positive correlation as evident from PCC analysis. Therefore, we have scheduled the forecasted load based on occupancy patterns for two different cases. Cost is reduced by 17.42% and 33.40% in case 1 and case 2, respectively. Moreover, the performance of the proposed hybrid approach is compared with different techniques presented in literature for buildings load forecasting.

An accurate electrical Short-term Load Forecasting (STLF) is an eminent factor in the power generation, electrical load dispatching and energy planning for the power supply companies, specifically in developing countries. This paper proposes a novel temporal feature selection-based Long Short-term Memory (LSTM) model developed by the combination of standard Artificial Neural Network (ANN) layer and LSTM for electrical short term load forecasting. The LSTM model has excellent capability of predicting the stochastic nature of an hour ahead electrical loads. The standard ANN layer consisting 11 neurons is used as an input to LSTM cells. Such a combination of ANN layer with LSTM was never proposed before. The proposed model accommodates variations in weather as well as temporal inputs like humidity, holidays, and date-time features in the hourly load data of the power supply company situated in Johor, Malaysia. This paper gives the insights of hyper parameter tuning to capture the more generalized electrical load patterns in the dataset without compromising the time complexity of the proposed model. The proposed approach was compared with five existing approaches, namely: ANN, LSTM model 1, LSTM model 2, LSTM model 3 and Convolutional Neural Network-LSTM (CNN-LSTM) using hourly load dataset of Johor. The experimental results demonstrate that the proposed approach outperformed the existing approaches in terms of root mean square error, mean absolute percentage error and Diebold-Mariano statistical inference test within 95% confidence interval.

Abstract. The information available on the internet nowadays is diverse and moves very quickly. Information is becoming easier to obtain by the general public with the numerous online media outlets, including news portals that provide up-to-date information insights. Various news portals earn revenue from advertising using pay-per-click methods that encourage article writers to use clickbait techniques to attract visitors. However, the negative effects of clickbait include a decrease in journalism quality and the spread of hoaxes. This problem can be prevented by using text classification to classify clickbait in news titles. One method that can be used for text classification is a neural network. Artificial neural networks use algorithms that can independently adjust input coefficient weights. This makes this algorithm highly effective for modeling non-linear statistical data. The artificial neural network algorithm, especially the Long Short-Term Memory (LSTM), has been widely used in various natural language processing fields with satisfying results, including text classification. To improve the performance of the neural network model, adjustments can be made to the model's hyperparameters. Hyperparameters are parameters that cannot be obtained through data and must be defined before the training process. In this research, the Long Short-Term Memory (LSTM) model was used in clickbait classification in news titles. Sixteen neural network models were trained with different hyperparameter configurations for each model. Hyperparameter tuning was carried out using the random search algorithm. The dataset used was the CLICK-ID dataset published by William & Sari, 2020[1], with a total of 15,000 annotated data. The research results show that the developed LSTM model has a validation accuracy of 0.8030, higher than William & Sari's research, and a validation loss of 0.4876. Using this model, researchers were able to classify clickbait in news titles with fairly good accuracy. Purpose: The study was to develop and evaluate a LSTM model with hyperparameter tuning for clickbait classification on news headlines. The thesis also aims to compare the performance of simple LSTM and bidirectional LSTM for this task. Methods: This study uses CLICK-ID dataset and applies different text preprocessing techniques. The dataset later was used to build and train 16 LSTM models with different hyperparameters and evaluates them using validation accuracy and loss. This study uses random search for hyperparameter tuning. Result: The results of the study show that the best model for clickbait classification on news headlines is a bidirectional LSTM model with one layer, 64 units, 0.2 dropout rate, and 0.001 learning rate. This model achieves a validation accuracy of 0.8030 and a validation loss of 0.4876. The results also show that hyperparameter tuning using random search can improve the performance of the LSTM models by avoiding zero probabilities and finding the optimal values for the hyperparameters. Novelty: This study compares and analyzes the different preprocessing methods on text and the different configurations of the models to find the best model for clickbait classification on news headlines. The study also uses hyperparameter tuning to tune the model into the best model and finding the optimal values for the hyperparameters.

The developed research includes an Long Short-Term Memory (LSTM) network with IoT sensor data for the management of rice crop irrigation. Optimizing the amount of water required for rice crops is very critical, based on real-time predictions of the actual environmental and soil parameters including moisture, temperature, humidity, and rainfall as well as all other possible related factors. IoT sensors installed in agricultural fields gathered data, which was transmitted to a controller and then uploaded to the cloud for further processing. The training dataset contained 5,600 records. In this research, 70% was used for training and the rest 30% for testing. Three LSTM models were used for analyzing sensor data and predicting the need for irrigation and controlling the irrigation pump accordingly. These were Vanilla LSTM, Stacked LSTM, and Bidirectional LSTM. It was evaluated the performance of the models developed using precision, recall, F1 score, accuracy, and other performance measures such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and R<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> Score. Bidirectional LSTM was determined to have the best performance, with MAE at 0.15, RMSE at 0.24, and an R2 score of 0.93, exhibiting high accuracy and predictive power. The Stacked LSTM and Vanilla LSTM also gave fair results, in terms of having R2 values of 0.89 and 0.84, respectively. The number of training and memory used for the computation were also given, with Vanilla LSTM taking least, followed by Stacked LSTM and Bidirectional LSTM. These results suggest that the LSTM networks can potentially be capable of improving the irrigation management such that more water is conserved and, subsequently, more suitable for agricultural productivity.