Autoregressive Integrated Moving Average (ARIMA) and Long Short-Term Memory (LSTM) Network Models for Forecasting Energy Consumptions

Abstract: This research is driven by the challenges faced by Universitas Lancang Kuning (UNILAK) in attracting applicants amidst intense competition, especially after the government's policy opened independent pathways to State Universities (PTN) from 2022-2023, which impacted private university applicant numbers. To address this and support strategic planning, this study aims to predict the trend of prospective students applying to all study programs at UNILAK for the period 2025-2027. Two time series models were employed: ARIMA (AutoRegressive Integrated Moving Average) and LSTM (Long Short-Term Memory). Applicant data from 2019 to 2024 was used to build the model. The Augmented Dickey-Fuller (ADF) test confirmed the data's stationarity with a p-value of 0.0. ACF and PACF analyses determined the ARIMA parameters as p=1, d=1, q=1. The LSTM model was trained to capture more complex data patterns. ARIMA predictions for 2025, 2026, and 2027 are 3298.66, 3362.33, and 3371.30, respectively. LSTM predictions for the same years are 3335.64, 3476.52, and 3518.42. Evaluation using Root Mean Squared Error (RMSE) showed ARIMA (RMSE=588.72) to be more accurate than LSTM (RMSE=653.96). Nevertheless, LSTM provided a more optimistic prediction. This study concludes that ARIMA is better suited for short-term planning, while LSTM can be used for more ambitious long-term strategies. Keywords: arima; LSTM; applicants; prediction; university Abstrak: Penelitian ini didorong oleh tantangan Universitas Lancang Kuning (UNILAK) dalam menarik pendaftar di tengah persaingan ketat, khususnya setelah kebijakan pemerintah membuka jalur mandiri ke Perguruan Tinggi Negeri (PTN) sejak 2022-2023, yang menyebabkan penurunan jumlah pendaftar di universitas swasta. Untuk mendukung perencanaan strategis, studi ini bertujuan memprediksi tren jumlah calon mahasiswa yang mendaftar ke seluruh program studi di UNILAK untuk periode 2025-2027.Dua model deret waktu digunakan: ARIMA (AutoRegressive Integrated Moving Average) dan LSTM (Long Short-Term Memory). Data jumlah pendaftar dari 2019 hingga 2024 digunakan untuk membangun model. Uji Augmented Dickey-Fuller (ADF) menunjukkan data stasioner dengan p-value 0,0. Analisis ACF dan PACF menentukan parameter ARIMA sebagai p=1, d=1, q=1. Model LSTM dilatih untuk menangkap pola data yang lebih kompleks.Prediksi ARIMA untuk 2025, 2026, dan 2027 adalah 3298.66, 3362.33, dan 3371.30. Prediksi LSTM untuk tahun yang sama adalah 3335.64, 3476.52, dan 3518.42. Evaluasi menggunakan Root Mean Squared Error (RMSE) menunjukkan ARIMA (RMSE=588.72) lebih akurat daripada LSTM (RMSE=653.96). Meskipun demikian, LSTM memberikan prediksi yang lebih optimis. Studi ini menyimpulkan ARIMA lebih cocok untuk perencanaan jangka pendek, sementara LSTM dapat digunakan untuk strategi jangka panjang yang ambisius. Kata kunci: arima; LSTM; pendaftar; prediksi; universitas

Accurate resource demand forecasts are necessary for sustainable healthcare systems to preserve flexibility and efficiency as well as to provide services in a professional manner. In this work, we propose an integrated Random Forest/Long Short-Term Memory (RF-LSTM) model for predicting Saudi Arabia's national healthcare resource demand. It combines non-linear feature extraction and temporal sequence learning. The integrated model employs governmental epidemiological and operational data from 2020 to 2024 to capture both short-term and long-term volatility and sustainability trends. The results demonstrate significant improvements in predictive accuracy compared with single-model baselines, such as Autoregressive Integrated Moving Average (ARIMA), Random Forest (RF), and Long Short Term Memory (LSTM), with reductions in Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) for up to 22% and 18% compared with ARIMA, and by 12% and 9% relative to the best single model, which is LSTM, respectively A statistical analysis using one-way ANOVA confirmed the robustness of the hybrid method. Furthermore, residual plots were examined to verify model assumptions and visually assess the uniformity of prediction errors, thereby validating the results. These findings suggest that integrated AI-based prediction models can effectively facilitate capacity planning, enhance resource allocation, and contribute to achieving the objectives of Saudi Vision 2030 for a resilient, data-driven healthcare system.

Dengue hemorrhagic fever (DHF) is one of the most widespread and deadly diseases in several parts of Indonesia. An accurate forecast-based model is required to reduce the incidence rate of this disease. Time-series methods such as autoregressive integrated moving average (ARIMA) models are used in epidemiology as statistical tools to study and forecast DHF and other infectious diseases. The present study attempted to forecast the monthly confirmed DHF cases via a time-series approach. The ARIMA, seasonal ARIMA (SARIMA), and long short-term memory (LSTM) models were compared to select the most accurate forecasting method for the deadly disease. The data were obtained from the Surabaya Health Office covering January 2014 to December 2016. The data were partitioned into the training and testing sets. The best forecasting model was selected based on the lowest values of accuracy metrics such as the root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE). The findings demonstrated that the SARIMA (2,1,1) (1,0,0) model was able to forecast the DHF outbreaks in Surabaya City compared to the ARIMA (2,1,1) and LSTM models. We further forecasted the DHF cases for 12 month horizons starting from January 2017 to December 2017 using the SARIMA (2,1,1) (1,0,0), ARIMA (2,1,1), and LSTM models. The results revealed that the SARIMA (2,1,1) (1,0,0) model outperformed the ARIMA (2,1,1) and LSTM models based on the goodness-of-fit measure. The results showed significant seasonal outbreaks of DHF, particularly from March to September. The highest cases observed in May suggested a significant seasonal correlation between DHF and air temperature. This research is the first attempt to analyze the time-series model for DHF cases in Surabaya City and forecast future outbreaks. The findings could help policymakers and public health specialists develop efficient public health strategies to detect and control the disease, especially in the early phases of outbreaks.

Nowadays , nonlinear time series and artificial neural networks (ANN) models are used for forecasting in the field of business, agriculture and soon. Recent studies have shown, ANN have been successfully used for forecasting of financial and agriculture data series The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. ANN have more advantages that can approximate to model both linear and nonlinear structures in time series, they are not able to handling both structures equally well. The autoregressive integrated moving average (ARIMA) model and two ANN models namely, Radial basis function neural networks (RBFNN), and Elman recurrent neural networks (ERNN) methods were applied to Hyderabad airport traffic data. The data obtained for 15 years from 2002–2003 to 2016–2017 about domestic and international passenger of International Airport of Hyderabad, India. In this research paper, we compared the performances of ARIMA, RBFNN and ERNN were based on three measures: mean absolute error (MAE), mean absolute percentage error (MAPE), and root mean square error (RMSE). The results showed that RBFNN obtained the smallest MAE, MAPE and RMSE in both the modeling and forecasting processes. The performances of the three models ranked in ascending order were: ARIMA, ERNN and the RBFNN model. Keywords: T ime series, forecasting, artificial neural networks, ARIMA models, radial basis function neural networks, and Elman recurrent neural networks Cite this Article R. Ramakrishna, Berhe Aregay, Tewodros Gebregergs. The Comparison in Time Series Forecasting of Air Traffic Data by Autoregressive Integrated Moving Average Model, Radial Basis Function and Elman Recurrent Neural Networks. Research & Reviews: Journal of Statistics . 2018; 7(3): 75–90p.

Deep learning-based forecasting model for COVID-19 outbreak in Saudi Arabia

This study aims to create a monthly sales quantity budget by making use of the previous income data of an enterprise operating within the construction sector, which is considered the locomotive of the economy. For estimating time-series of sales as a linear model ARIMA (Auto-Regressive Integrated Moving Average), as nonlinear model LSTM (Long ShortTerm Memory) and a HYBRID (LSTM and ARIMA) model built to improve system performance compared to a single model was used. As a result of the study, Mean Square Error (MSE), Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE) and Mean Absolute Error (MAE) values obtained from each of the methods used in the application were compared, and a monthly sales volume budget was created for 2017 with all the methods used. When the MAPE and MSE values obtained from each of these methods were compared, the best performance was the Hybrid model that gave the lowest error, and in addition, the fact that all of the application models got very realistic results by using the historical data showed the success of the predictions.

BackgroundAccurate incidence prediction of sexually transmitted diseases (STDs) is critical for early prevention and better government strategic planning. In this paper, four different forecasting models were presented to predict the incidence of AIDS, gonorrhea, and syphilis.MethodsThe annual percentage changes in the incidence of AIDS, gonorrhea, and syphilis were estimated by using joinpoint regression. The performance of four methods, namely, the autoregressive integrated moving average (ARIMA) model, Elman neural network (ERNN) model, ARIMA-ERNN hybrid model and long short-term memory (LSTM) model, were assessed and compared. For 1-year prediction, the collected data from 2011 to 2020 were used for modeling to predict the incidence in 2021. For 5-year prediction, the collected data from 2011 to 2016 were used for modeling to predict the incidence from 2017 to 2021. The performance was evaluated based on four indices: mean square error (MSE), mean absolute error (MAE), and mean absolute percentage error (MAPE).ResultsThe morbidities of AIDS and syphilis are on the rise, and the morbidity of gonorrhea has declined in recent years. The optimal ARIMA models were determined: ARIMA(2,1,2)(0,1,1)12, ARIMA(1,1,2)(0,1,2)12, and ARIMA(3,1,2)(1,1,2)12 for AIDS, gonorrhea, and syphilis 1-year prediction, respectively; ARIMA (2,1,2)(0,1,1)12, ARIMA(1,1,2)(0,1,2)12, and ARIMA(2,1,1)(0,1,0)12 for AIDS, gonorrhea and syphilis 5-year prediction, respectively. For 1-year prediction, the MAPEs of ARIMA, ERNN, ARIMA-ERNN, and LSTM for AIDS are 23.26, 20.24, 18.34, and 18.63, respectively; For gonorrhea, the MAPEs are 19.44, 18.03, 17.77, and 5.09, respectively; For syphilis, the MAPEs are 9.80, 9.55, 8.67, and 5.79, respectively. For 5-year prediction, the MAPEs of ARIMA, ERNN, ARIMA-ERNN, and LSTM for AIDS are 12.86, 23.54, 14.74, and 25.43, respectively; For gonorrhea, the MAPEs are 17.07, 17.95, 16.46, and 15.13, respectively; For syphilis, the MAPEs are 21.88, 24.00, 20.18 and 11.20, respectively. In general, the performance ranking of the four models from high to low is LSTM, ARIMA-ERNN, ERNN, and ARIMA.ConclusionThe time series predictive models show their powerful performance in forecasting STDs incidence and can be applied by relevant authorities in the prevention and control of STDs.

Solar energy is one of the most promising renewable energy sources in Indonesia, particularly in Bali, which has relatively high solar irradiance throughout the year. However, daily variability in solar radiation caused by weather conditions and atmospheric factors leads to fluctuations in solar energy production, making accurate forecasting essential for effective energy planning. This study aims to evaluate the performance of the Autoregressive Integrated Moving Average (ARIMA), Long Short-Term Memory (LSTM), and hybrid ARIMA–LSTM models in forecasting daily solar energy at the Jembrana Climatological Station, Bali. The dataset consists of 10-minute solar radiation observations obtained from an Automatic Weather Station (AWS) for the period January 2023 to September 2025, which were aggregated into daily solar energy values expressed in kWh/m². Data preprocessing included missing value handling, outlier correction, normalization, and an 80:20 split between training and testing datasets. Model performance was evaluated using Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Mean Absolute Percentage Error (MAPE). The results show that the hybrid ARIMA–LSTM model achieved the best performance, with an RMSE of 0.960 kWh/m², MAE of 0.771 kWh/m², and MAPE of 22.245%, outperforming both the ARIMA and LSTM models. These findings indicate that the hybrid approach is more effective in capturing both linear and nonlinear characteristics of daily solar energy time series.

BackgroundMore than 79.2 million confirmed COVID-19 cases and 1.7 million deaths were caused by SARS-CoV-2; the disease was named COVID-19 by the World Health Organization. Control of the COVID-19 epidemic has become a crucial issue around the globe, but there are limited studies that investigate the global trend of the COVID-19 pandemic together with each country’s policy measures.ObjectiveWe aimed to develop an online artificial intelligence (AI) system to analyze the dynamic trend of the COVID-19 pandemic, facilitate forecasting and predictive modeling, and produce a heat map visualization of policy measures in 171 countries.MethodsThe COVID-19 Pandemic AI System (CPAIS) integrated two data sets: the data set from the Oxford COVID-19 Government Response Tracker from the Blavatnik School of Government, which is maintained by the University of Oxford, and the data set from the COVID-19 Data Repository, which was established by the Johns Hopkins University Center for Systems Science and Engineering. This study utilized four statistical and deep learning techniques for forecasting: autoregressive integrated moving average (ARIMA), feedforward neural network (FNN), multilayer perceptron (MLP) neural network, and long short-term memory (LSTM). With regard to 1-year records (ie, whole time series data), records from the last 14 days served as the validation set to evaluate the performance of the forecast, whereas earlier records served as the training set.ResultsA total of 171 countries that featured in both databases were included in the online system. The CPAIS was developed to explore variations, trends, and forecasts related to the COVID-19 pandemic across several counties. For instance, the number of confirmed monthly cases in the United States reached a local peak in July 2020 and another peak of 6,368,591 in December 2020. A dynamic heat map with policy measures depicts changes in COVID-19 measures for each country. A total of 19 measures were embedded within the three sections presented on the website, and only 4 of the 19 measures were continuous measures related to financial support or investment. Deep learning models were used to enable COVID-19 forecasting; the performances of ARIMA, FNN, and the MLP neural network were not stable because their forecast accuracy was only better than LSTM for a few countries. LSTM demonstrated the best forecast accuracy for Canada, as the root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) were 2272.551, 1501.248, and 0.2723075, respectively. ARIMA (RMSE=317.53169; MAPE=0.4641688) and FNN (RMSE=181.29894; MAPE=0.2708482) demonstrated better performance for South Korea.ConclusionsThe CPAIS collects and summarizes information about the COVID-19 pandemic and offers data visualization and deep learning–based prediction. It might be a useful reference for predicting a serious outbreak or epidemic. Moreover, the system undergoes daily updates and includes the latest information on vaccination, which may change the dynamics of the pandemic.

<p>Predicting commodity prices, particularly food prices, is a significant concern for various stakeholders, especially in regions that are highly sensitive to commodity price volatility. Historically, many machine learning models like autoregressive integrated moving average (ARIMA) and support vector machine (SVM) have been suggested to overcome the forecasting task. These models struggle to capture the multifaceted and dynamic factors influencing these prices. Recently, deep learning approaches have demonstrated considerable promise in handling complex forecasting tasks. This paper presents a novel long short-term memory (LSTM) network-based model for commodity price forecasting. The model uses five essential commodities namely bread, meat, milk, oil, and petrol. The proposed model focuses on advanced feature engineering which involves moving averages, price volatility, and past prices. The results reveal that our model outperforms traditional methods as it achieves 0.14, 3.04%, and 98.2% for root mean square error (RMSE), mean absolute percentage error (MAPE), and R-squared (R<sup>2</sup>), respectively. In addition to the simplicity of the model, which consists of an LSTM single-cell architecture that reduced the training time to a few minutes instead of hours. This paper contributes to the economic literature on price prediction using advanced deep learning techniques as well as provides practical implications for managing commodity price instability globally.</p>

The prediction of wind energy generation is important to enhance the performance and dependability of renewable energy systems due to the rising demand for wind-generated electricity and advancements in wind energy technology competitiveness. This study leverages advanced machine learning (ML) and some other statistical and deep learning based time series forecasting models to enhance the accuracy of wind energy predictions. This comprehensive analysis includes nine ML models—Linear Regression, Random Forests (RF), Gradient Boosting Machines (GBM), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), AdaBoost, XGBoost, Support Vector Regression (SVR), and Neural Networks—as well as Four time-series forecasting models—ARIMA, Temporal Convolutional Networks (TCNs), Long Short-Term Memory (LSTM) networks and GRU. Each ML model underwent rigorous cross-validation to ensure optimal performance. The assessment criteria utilized here comprised the Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the R² Score. It was found that among the nine ML models, Random Forests, GBM and KNN consistently provided superior accuracy and robustness, making them the top choices for wind energy prediction whereas the performance of linear regression, SVM and SVR were very poor for the considered dataset. From the experiment, Random Forest, GBM, and KNN showed the best performance with low MSE values of 0.77, 1.95, and 1.51 respectively, while other models had MSEs above 7.5, with AdaBoost reaching 30. Their RMSEs (0.88, 1.40, 1.23) and MAEs (0.093, 0.73, 0.10) also indicate strong predictive accuracy compared to the rest.In this paper, time series forecasting, TCNs, LSTM and GRU networks showed strong capabilities in capturing temporal dependencies and trends within the wind energy data. Visualization techniques were employed to compare model performances comprehensively, providing clear insights into their predictive power. Therefore, this present study offers a robust framework for researchers and practitioners aiming to leverage machine learning and time series forecasting in the realm of renewable energy prediction.

Deep Learning is a promising domain. It has different applications in different areas of life, and its application on the stock market is widely used due to its efficiency. Long Short-Term Memory (LSTM) proved its efficiency in dealing with time series data due to the unique hidden unit structure. This paper integrated LSTM with Attention Mechanism and sentiment analysis to forecast the closing price of two stocks, namely APPL and TSLA, from the NASDAQ stock market. We compared our hybrid model with LSTM, LSTM with sentiment analysis, and LSTM with Attention Mechanism. Three benchmarks are used to measure the performance of the models, the first one is Mean Square Error (MSE), the second one is Root Mean Square Error (RMSE), and the third one is Mean Absolute Error (MAE). The results show that the hybridization is more accurate compared to only LSTM model.

Wind speed forecasting is important for wind energy forecasting. In the modern era, the increase in energy demand can be managed effectively by forecasting the wind speed accurately. The main objective of this research is to improve the performance of wind speed forecasting by handling uncertainty, the curse of dimensionality, overfitting and non-linearity issues. The curse of dimensionality and overfitting issues are handled by using Boruta feature selection. The uncertainty and the non-linearity issues are addressed by using the deep learning based Bi-directional Long Short Term Memory (Bi-LSTM). In this paper, Bi-LSTM with Boruta feature selection named BFS-Bi-LSTM is proposed to improve the performance of wind speed forecasting. The model identifies relevant features for wind speed forecasting from the meteorological features using Boruta wrapper feature selection (BFS). Followed by Bi-LSTM predicts the wind speed by considering the wind speed from the past and future time steps. The proposed BFS-Bi-LSTM model is compared against Multilayer perceptron (MLP), MLP with Boruta (BFS-MLP), Long Short Term Memory (LSTM), LSTM with Boruta (BFS-LSTM) and Bi-LSTM in terms of Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Square Error (MSE) and R2. The BFS-Bi-LSTM surpassed other models by producing RMSE of 0.784, MAE of 0.530, MSE of 0.615 and R2 of 0.8766. The experimental result shows that the BFS-Bi-LSTM produced better forecasting results compared to others.

<p>Load forecasting has become reproving aspect of an energy management system (EMS). It gives basic advantage to grid stability, cost effectiveness and battery storage system (BSS). For this purpose, machine learning (ML) is widely adopted to forecast the electricity load. This research paper investigates the performances of various time series estimating models applied to electricity load data for an Irish company. The research mainly adopts the autoregressive integrated moving average (ARIMA) model, long short-term memory (LSTM) networks and transformer neural network (TNN) to forecast the electricity load. A comparison evaluation is conducted encompassing various quantifying measures such as root mean square error (RMSE), mean square error (MSE) and mean absolute error (MAE). The results are then compared to get an understanding whether the TNN using attention-based mechanism is better than the two state of the art models. Hence provides a complete understanding about which of the model needs improvements in its architecture for enhancement of operational efficiency and cost effectiveness in the realm of EMS.</p>

An effective compression algorithm for real-time transmission data using predictive coding with mixed models of LSTM and XGBoost