Predicting Cryptocurrency Price Using RNN and LSTM Method

Highly accurate cryptocurrency price predictions are of paramount interest to investors and researchers. However, owing to the nonlinearity of the cryptocurrency market, it is difficult to assess the distinct nature of time-series data, resulting in challenges in generating appropriate price predictions. Numerous studies have been conducted on cryptocurrency price prediction using different Deep Learning (DL) based algorithms. This study proposes three types of Recurrent Neural Networks (RNNs): namely, Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Bi-Directional LSTM (Bi-LSTM) for exchange rate predictions of three major cryptocurrencies in the world, as measured by their market capitalization—Bitcoin (BTC), Ethereum (ETH), and Litecoin (LTC). The experimental results on the three major cryptocurrencies using both Root Mean Squared Error (RMSE) and the Mean Absolute Percentage Error (MAPE) show that the Bi-LSTM performed better in prediction than LSTM and GRU. Therefore, it can be considered the best algorithm. Bi-LSTM presented the most accurate prediction compared to GRU and LSTM, with MAPE values of 0.036, 0.041, and 0.124 for BTC, LTC, and ETH, respectively. The paper suggests that the prediction models presented in it are accurate in predicting cryptocurrency prices and can be beneficial for investors and traders. Additionally, future research should focus on exploring other factors that may influence cryptocurrency prices, such as social media and trading volumes.

Given the substantial volatility and non-stationarity of cryptocurrency prices, forecasting them has become a complex task within the realm of financial time series analysis. This study introduces an innovative hybrid prediction model, VMD-AGRU-RESVMD-LSTM, which amalgamates the disintegration–integration framework with deep learning techniques for accurate cryptocurrency price prediction. The process begins by decomposing the cryptocurrency price series into a finite number of subseries, each characterized by relatively simple volatility patterns, using the variational mode decomposition (VMD) method. Next, the gated recurrent unit (GRU) neural network, in combination with an attention mechanism, predicts each modal component’s sequence separately. Additionally, the residual sequence, obtained after decomposition, undergoes further decomposition. The resultant residual sequence components serve as input to an attentive GRU (AGRU) network, which predicts the residual sequence’s future values. Ultimately, the long short-term memory (LSTM) neural network integrates the predictions of modal components and residuals to yield the final forecasted price. Empirical results obtained for daily Bitcoin and Ethereum data exhibit promising performance metrics. The root mean square error (RMSE) is reported as 50.651 and 2.873, the mean absolute error (MAE) stands at 42.298 and 2.410, and the mean absolute percentage error (MAPE) is recorded at 0.394% and 0.757%, respectively. Notably, the predictive outcomes of the VMD-AGRU-RESVMD-LSTM model surpass those of standalone LSTM and GRU models, as well as other hybrid models, confirming its superior performance in cryptocurrency price forecasting.

Analysis of time series data has been a challenging research subject for decades. Email traffic has recently been modelled as a time series function using a Recurrent Neural Network (RNN) and RNNs were shown to provide higher prediction accuracy than previous probabilistic models from the literature. Given the exponential rise of email workloads which need to be handled by email servers, in this paper we first present and discuss the literature on modelling email traffic. We then explain the advantages and limitations of different approaches as well as their points of agreement and disagreement. Finally, we present a comprehensive comparison between the performance of RNN and Long Short Term Memory (LSTM) models. Our experimental results demonstrate that both approaches can achieve high accuracy over four large datasets acquired from different universities’ servers, outperforming existing work, and show that the use of LSTM and RNN is very promising for modelling email traffic.

The purpose of this study is to predict the decade rainfall in Semarang City using two main methods, namely Seasonal Autoregressive Integrated Moving Average with Exogenous Variables (SARIMAX) and Long Short Term Memory (LSTM). The methodology of this study begins with data pre-processing, which includes data deletion analysis using dropna and data normalization using Min-Max Scaling to reduce scale the to between 0 and 1. The dataset is then divided into 80% training data and 20% test data. The validity of the data (X_test, Y_test) using the best 56-epoch data validation (val_loss) is better than the validity of the training data (loss). On the other hand, SARIMAX uses the (2,1,2), (2,1,2,36) model, and its validation techniques include Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Coefficient of Determination (R2). Specifically, the RMSE of the LSTM model is 19.6, and its RMSE of the SARIMAX is 31.05. The MAE of LSTM is 15.0, SARIMAX is 24.5, and the R2 of LSTM is 0.814, and SARIMAX is 0.52. Lower RMSE and MAE values indicate lower prediction errors, but a higher R2 value of 1 indicates that LSTM can explain 81% of the actual data variation, which is better than SARIMAX, which is only about 52%. The main finding of this study is that the LSTM model performs better when recommending rainfall datasets.

Stock price prediction targets to predict the future development direction of the stock market and the degree of rise and fall of the stock price according to stock market quotations. However, since the stock price has high nonlinear, high noisy, and dynamic characteristics, it is challenging to predict stock prices. This paper predicts stock price prediction with a long-short term memory (LSTM) model according to the above data characteristics. First, because the stock price is distributed in different price ranges, we pre-process the data by normalizing all the data to the range of 0 to 1. Then, we improve the model performance by adjusting the three main parameters, hidden layers, learning rate, and time window. LSTM adds a control part into LSTM to further catch these data to make the best of historical data. We compare the proposed method with Recurrent Neural Network (RNN) on a related dataset with relative root mean square error (RRMSE), mean absolute error (MAE) and mean absolute error percentage (MAPE). The lower the score on all three indicators, the more accurate the prediction. The experimental results show that the scores of LSTM are lower than RNN in three indicators, so its prediction is more accurate than RNN with appropriate parameters. Our analyses illustrate that LSTM can better predict the dynamic non-linear data like a stock price by considering the historical data.

Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU)

Daily land surface temperature (LST) forecasting is of great significance for application in climate-related, agricultural, eco-environmental, or industrial studies. Hybrid data-driven prediction models using Ensemble Empirical Mode Composition (EEMD) coupled with Machine Learning (ML) algorithms are useful for achieving these purposes because they can reduce the difficulty of modeling, require less history data, are easy to develop, and are less complex than physical models. In this article, a computationally simple, less data-intensive, fast and efficient novel hybrid data-driven model called the EEMD Long Short-Term Memory (LSTM) neural network, namely EEMD-LSTM, is proposed to reduce the difficulty of modeling and to improve prediction accuracy. The daily LST data series from the Mapoling and Zhijiang stations in the Dongting Lake basin, central south China, from 1 January 2014 to 31 December 2016 is used as a case study. The EEMD is firstly employed to decompose the original daily LST data series into many Intrinsic Mode Functions (IMFs) and a single residue item. Then, the Partial Autocorrelation Function (PACF) is used to obtain the number of input data sample points for LSTM models. Next, the LSTM models are constructed to predict the decompositions. All the predicted results of the decompositions are aggregated as the final daily LST. Finally, the prediction performance of the hybrid EEMD-LSTM model is assessed in terms of the Mean Square Error (MSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Root Mean Square Error (RMSE), Pearson Correlation Coefficient (CC) and Nash-Sutcliffe Coefficient of Efficiency (NSCE). To validate the hybrid data-driven model, the hybrid EEMD-LSTM model is compared with the Recurrent Neural Network (RNN), LSTM and Empirical Mode Decomposition (EMD) coupled with RNN, EMD-LSTM and EEMD-RNN models, and their comparison results demonstrate that the hybrid EEMD-LSTM model performs better than the other five models. The scatterplots of the predicted results of the six models versus the original daily LST data series show that the hybrid EEMD-LSTM model is superior to the other five models. It is concluded that the proposed hybrid EEMD-LSTM model in this study is a suitable tool for temperature forecasting.

Electricity is the most substantial energy form that significantly affects the development of modern life, work efficiency, quality of life, production, and competitiveness of the society in the ever-growing global world. In this respect, forecasting accurate electricity energy consumption (EEC) is fairly essential for any country?s energy consumption planning and management regarding its growth. In this study, four time-series methods; long short-term memory (LSTM) neural network, adaptive neuro-fuzzy inference system (ANFIS) with subtractive clustering (SC), ANFIS with fuzzy cmeans (FCM), and ANFIS with grid partition (GP) were implemented for the short-term one-day ahead EEC prediction. Root mean square error (RMSE), correlation coefficient (R), mean absolute error (MAE) and mean absolute percentage error (MAPE) were considered as statistical accuracy criteria. Those forecasted results by the LSTM, ANFIS-FCM, ANFIS-SC and ANFIS-GP models were evaluated by comparing with the actual data using statistical accuracy metrics. According to the testing process, the best MAPE values were obtained to be 4.47%, 3.21%, 2.34%, and 1.91% for the ANFIS-GP, ANFIS-SC, ANFIS-FCM, and LSTM, respectively. Furthermore, the best RMSE values were found as 25.94 GWh, 41.17 GWh, 29.50 GWh, and 80.14 GWh for the LSTM, ANFIS-SC, ANFIS-FCM, and ANFIS-GP models, respectively. As a consequence, the LSTM model generally outperformed all ANFIS models. The results revealed that forecasting of short-term daily EEC time series using the LSTM approach can provide high accuracy results.

Rainfall is the height of rainwater that falls on a flat area, assuming it doesn't evaporate, doesn't seep, and doesn't flow. Rain levels are measured in mm (millimeters). The target of the research being conducted is in Badung Regency, Bali because Bali is a tourist area that is often visited by tourists and from Indonesian itself, so predictions of meteorology, such as rainfall will greatly impact tourism. In this test, predictions use the Long Short Term Memory (LSTM) method, using daily weather data from the BMKG from 2010 to 2020 as training data and daily weather data for 2021 as prediction data. Based on the test results above, the results show that the two LSTM tests with LSTM Model 128.64 and LSTM Model 64.32 have low MAE and MAPE error values. From First Scenario, the Mean Absolute Error (MAE) value is 8.97246598930908 and Mean Absolute Percentage Error (MAPE) value is 1.7657206683278308%. From Second Scenario, the Mean Absolute Error is 9.706669940783014 and Mean Absolute Percentage Error is 1.9028466692362323%. From the MAE and MAPE values obtained in these two scenarios, it can be proven that from the evaluation results of Rainfall predictions in Badung Regency, Bali, the predictions can be said to be very accurate because they have an error value of less than 10.

Artificial Intelligence (AI) has recently emerged as a powerful tool with versatile applications spanning various domains. AI replicates human intelligence processes through machinery and computer systems, finding utility in expert systems, image and speech recognition, machine vision, and natural language processing (NLP). One notable area with limited exploration pertains to using deep learning models, specifically Recurrent Neural Networks (RNNs), for predicting water quality in wastewater treatment plants (WWTPs). RNNs are purpose-built for handling sequential data, featuring a feedback mechanism. However, standard RNNs may exhibit limitations in accommodating both short-term and long-term dependencies when addressing intricate time series problems. The solution to this challenge lies in adopting Long Short-Term Memory (LSTM) cells, known for their inherent memory management through a ‘forget gate’ mechanism. In general, LSTM architecture demonstrates superior performance. WWTP data represent a historical series influenced by fluctuating environmental conditions. This study employs simple RNNs and LSTM architecture to construct prediction models for effluent parameters, systematically assessing their performance through various training data scenarios and model architectures. The primary objective was to determine the most suitable WWTP dataset model. The study revealed that an epoch setting of 50 and a batch size of 100 yielded the lowest training time and root mean square error (RMSE) values for both RNN and LSTM models. Furthermore, when these models are applied to predict effluent parameters, they exhibit precise RMSE values for all parameters. The study results can be applied to detect potential upsets in WWTP operations.

Compressive strength is an important mechanical property of high-strength concrete (HSC), but testing methods are usually uneconomical, time-consuming, and labor-intensive. To this end, in this paper, a long short-term memory (LSTM) model was proposed to predict the HSC compressive strength using 324 data sets with five input independent variables, namely water, cement, fine aggregate, coarse aggregate, and superplasticizer. The prediction results were compared with those of the conventional support vector regression (SVR) model using four metrics, root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and correlation coefficient (R2). The results showed that the prediction accuracy and reliability of LSTM were higher with R2 = 0.997, RMSE = 0.508, MAE = 0.08, and MAPE = 0.653 compared to the evaluation metrics R2 = 0.973, RMSE = 1.595, MAE = 0.312, MAPE = 2.469 of the SVR model. The LSTM model is recommended for the pre-estimation of HSC compressive strength under a given mix ratio before the laboratory compression test. Additionally, the Shapley additive explanations (SHAP)-based approach was performed to analyze the relative importance and contribution of the input variables to the output compressive strength.

Many countries around the globe, including Tanzania, are investing in renewable energy, partly because of the need to increase electric power generation and meet the ever-increasing electricity demands, and partly because of the need to combat global climate change caused by carbon emissions from fossil fuel-based electricity production. Kishapu Solar Project, located in Kishapu District, Shinyanga Region, Tanzania, is one of the renewable energy projects with a planned generation of 150 MW of electric power once completed, using solar photovoltaic technology. Accurate forecasting of solar radiation is important in managing and maintaining solar energy plants. Inaccurate forecasting of solar radiation can lead to poor harvest of solar energy and poor management of solar energy plants, which directly impacts electricity contribution to the national electricity grid. Long Short-Term Memory (LSTM) and its variant, PeepHole LSTM, are examples of Deep Learning models that can be used to predict solar radiation. The purpose of PeepHole LSTM is to introduce “peephole” connections in the LSTM model, which allow LSTM gates to directly inspect memory cell state and hence have richer information to process. However, there is still a research gap on the impact of “peephole” connections on the prediction performance of the LSTM model, especially in the context of forecasting solar radiation in Kishapu District, where the Kishapu Solar Project is located. The purpose of this study is to fill this research gap by developing both LSTM and PeepHole LSTM models and comparing their performances in forecasting solar radiation in Kishapu District. The 14-year Kishapu District daily solar radiation (Downward Shortwave Radiation) dataset was first pre-processed by scaling (normalizing) it using Standard Scaler and then split into training set (the first 70%), validation set (the next 15%) and test set (the last 15%) before being utilized to train and test the developed LSTM and PeepHole LSTM models. Both LSTM and PeepHole LSTM models used the previous 5 days' solar radiation values as inputs to predict the output (next day (6th day) solar radiation value). The trained and better-performing model between the two was finally saved in .h5 format and integrated with a Gradio based Web Application to provide a user interface for officials in Kishapu District and at Kishapu Solar Project to predict daily solar radiation. The findings from performance evaluation revealed that the LSTM model outperformed the PeepHole LSTM model in predicting solar radiation by achieving test Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) scores of 26.22 W/m2 and 36.65 W/m2, respectively, compared to MAE and RMSE scores of 30.84 W/m2 and 41.88 W/m2, respectively, achieved by the PeepHole LSTM model, concluding that “peephole” connections reduce the performance of the LSTM model rather than increasing it when used to forecast solar radiation in Kishapu District. This study’s recommendation to Artificial Intelligence (AI) software developers and researchers is to use the LSTM rather than the PeepHole LSTM Deep Learning model when forecasting solar radiation in Kishapu District and in locations with similar climatic conditions

Cryptocurrencies have gained immense popularity in recent years as an emerging asset class, and their prices are known to be highly volatile. Predicting cryptocurrency prices is a difficult task due to their complex nature and the absence of a central authority. In this paper, our proposal is to employ Long Short-Term Memory (LSTM) networks, a type of deep learning technique to forecast the prices of cryptocurrencies. We use historical price data and technical indicators as inputs to the LSTM model, which learns the underlying patterns and trends in the data. To improve the accuracy of the predictions, we also incorporate a Change Point Detection (CPD) technique using the Pruned Exact Linear Time (PELT) algorithm. This method allows us to detect significant changes in cryptocurrency prices and adjust the LSTM model accordingly, leading to better predictions. We evaluate our approach predominantly on Bitcoin cryptocurrency, but the model can be implemented on other cryptocurrencies provided there are valid historical price data. Our experimental results show that our proposed model outperforms the baseline LSTM algorithm, achieving higher accuracy and better performance in terms of Mean Absolute Error (MAE), Mean Square Error (MSE), and Root Mean Square Error (RMSE). Our research findings suggest that combining deep learning techniques such as LSTM with change point detection techniques such as PELT can improve cryptocurrency price prediction accuracy and have practical implications for investors, traders, and financial analysts.

Purpose: This study aims to predict the closing price of the EUR/JPY currency pair in the forex market using recurrent neural network (RNN) architectures, namely Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), with the incorporation of Bidirectional layers. Methods: The dataset comprises hourly price data obtained from Yahoo Finance and pre-processed accordingly. The data is divided into training and testing sets, and time series sequences are constructed for input into the models. The RNN, LSTM, and GRU models are trained using the Adam optimization algorithm with the mean squared error (MSE) loss metric. Results: Results indicate that the LSTM model, particularly when coupled with Bidirectional layers, exhibits superior predictive performance compared to the other models, as evidenced by lower MSE values. Conclusions: Therefore, the LSTM model with Bidirectional layers is the most effective in predicting the EUR/JPY currency pair's closing price in the forex market. These findings offer valuable insights for practitioners and researchers involved in financial market prediction and neural network modelling

This article explores the suitability of a long short-term memory recurrent neural network (LSTM-RNN) and artificial intelligence (AI) method for low-flow time series forecasting. The long short-term memory works on the sequential framework which considers all of the predecessor data. This forecasting method used daily discharged data collected from the Basantapur gauging station located on the Mahanadi River basin, India. Different metrics [root-mean-square error (RMSE), Nash–Sutcliffe efficiency (ENS), correlation coefficient (R) and mean absolute error] were selected to assess the performance of the model. Additionally, recurrent neural network (RNN) model is also used to compare the adaptability of LSTM-RNN over RNN and naive method. The results conclude that the LSTM-RNN model (R = 0.943, ENS = 0.878, RMSE = 0.487) outperformed RNN model (R = 0.935, ENS = 0.843, RMSE = 0.516) and naive method (R = 0.866, ENS = 0.704, RMSE = 0.793). The finding of this research concludes that LSTM-RNN can be used as new reliable AI technique for low-flow forecasting.