Classification of Electrocardiography Hybrid Convolutional Neural Network-Long Short Term Memory with Fully Connected Layer

Recent user recognition technologies have focused on biometric signals to remotely identify users in the access management, medical welfare, and public sectors. The electrocardiogram (ECG) signal is an individual’s unique electrophysiological signal generated within the body and is difficult to forge or change; thus, it can be used to uniquely identify the user. Existing user identification systems based on ECG signals detect R peaks according to morphological features and use a fiducial-based segmentation process for data normalization. However, this process does not detect a distinct R peak due to motion artifacts generated by the movement of the subject, thereby degrading identification accuracy. To address the problem of decreasing peak accuracy of the fiducial-based segmentation data, this study proposes a user identification system based on one-dimensional neural networks using periodic non-fiducial-based segmentation data that do not overlap in the time domain. The proposed system comprises a preprocessing step for data denoising, a non-fiducial-based and non-overlap segmentation step, and a step for classifying users using a one-dimensional shallow neural network. In the experiment, when using self-acquired 10-second ECG signal data that were divided into non-fiducial and non-overlapping segments, the long short-term memory (LSTM), bidirectional LSTM, and one-dimensional convolutional neural network (CNN) models achieved accuracies of 92.01%, 93.13%, and 95.51%, respectively, with the 1D CNN model exhibiting the best accuracy. The proposed system demonstrated a 25.48% improvement in accuracy on non-fiducial segmented data compared to the 1D CNN model, which achieved an accuracy of 70.03% on fiducial segmented data. Moreover, when tested on publicly available ECG datasets, including MIT-BIH, ECG-ID, and PTB-XL, the proposed system exhibited a user identification accuracy of over 94%, confirming its superior performance.

As solar photovoltaic (PV) generation becomes cost-effective, solar power comes into its own as the alternative energy with the potential to make up a larger share of growing energy needs. Consequently, operations and maintenance cost now have a large impact on the profit of managing power modules, and the energy market participants need to estimate the solar power in short or long terms of future. In this paper, we propose a solar power forecasting technique by utilizing convolutional neural networks and long–short-term memory networks recently developed for analyzing time series data in the deep learning communities. Considering that weather information may not be always available for the location where PV modules are installed and sensors are often damaged, we empirically confirm that the proposed method predicts the solar power well with roughly estimated weather data obtained from national weather centers as well as it works robustly without sophisticatedly preprocessed input to remove outliers.

This study evaluates the performance of traditional statistical methods, specifically the Seasonal Autoregressive Integrated Moving Average (SARIMA), in comparison to advanced deep learning models—Long Short-Term Memory (LSTM), Bidirectional LSTM (BiLSTM), and Convolutional Neural Network (CNN)—for wind speed forecasting across various regions in Saudi Arabia: Al-Jouf, Abha, Al-Ahsa, and Al-Dawadami. The historical wind speed dataset covering the year 2018 was utilized, with data preprocessing conducted using the Exploratory Data Analysis (EDA) method to ensure consistency and quality. The models were assessed based on three primary error metrics: Mean Absolute Error (MAE), Mean Squared Error (MSE), and Root Mean Square Error (RMSE). Results show that CNN consistently outperforms SARIMA and the other deep learning models, particularly when forecasting stable wind speed patterns. LSTM demonstrates an ability to handle fluctuating wind speeds effectively, while BiLSTM offers advantages in capturing complex bidirectional temporal dependencies. On the other hand, SARIMA generally exhibits lower performance compared to deep learning approaches. The superior performance of CNN is likely attributed to its strength in local feature extraction and handling spatial patterns effectively, which are beneficial for short-term forecasting. These findings provide valuable insights into model selection for wind energy forecasting and can contribute to optimizing renewable energy integration and planning strategies. Future work may explore hybrid model approaches to further enhance forecasting accuracy.

Improving the performance of Deep Learning (DL) algorithms is a challenging problem. However, DL is applied to different types of Deep Neural Networks, and Long Short-Term Memory (LSTM) is one of them that deals with time series or sequential data. This paper attempts to overcome this problem by optimizing LSTM parameters using the Bees Algorithm (BA), which is a nature-inspired algorithm that mimics the foraging behavior of honey bees. In particular, it was used to optimize the adjustment factors of the learning rate in the forget, input, and output gates, in addition to cell candidate, in both forward and backward sides. Furthermore, the BA was used to optimize the learning rate factor in the fully connected layer. In this study, artificial porosity images were used for testing the algorithms; since the input data were images, a Convolutional Neural Network (CNN) was added in order to extract the features in the images to feed into the LSTM for predicting the percentage of porosity in the sequential layers of artificial porosity images that mimic real CT scan images of products manufactured by the Selective Laser Melting (SLM) process. Applying a Convolutional Neural Network Long Short-Term Memory (CNN-LSTM) yielded a porosity prediction accuracy of 93.17%. Although using Bayesian Optimization (BO) to optimize the LSTM parameters mentioned previously did not improve the performance of the LSTM, as the prediction accuracy was 93%, adding the BA to optimize the same LSTM parameters did improve its performance in predicting the porosity, with an accuracy of 95.17% where a hybrid Bees Algorithm Convolutional Neural Network Long Short-Term Memory (BA-CNN-LSTM) was used. Furthermore, the hybrid BA-CNN-LSTM algorithm was capable of dealing with classification problems as well. This was shown by applying it to Electrocardiogram (ECG) benchmark images, which improved the test set classification accuracy, which was 92.50% for the CNN-LSTM algorithm and 95% for both the BO-CNN-LSTM and BA-CNN-LSTM algorithms. In addition, the turbofan engine degradation simulation numerical dataset was used to predict the Remaining Useful Life (RUL) of the engines using the LSTM network. A CNN was not needed in this case, as there was no feature extraction for the images. However, adding the BA to optimize the LSTM parameters improved the prediction accuracy in the testing set for the LSTM and BO-LSTM, which increased from 74% to 77% for the hybrid BA-LSTM algorithm.

The aim of this study was to assess the aptitude of the recurrent Long Short-Term Memory (LSTM) neural networks for fast and accurate predictions of process dynamics in vertical-gradient-freeze growth of gallium arsenide crystals (VGF-GaAs) using datasets generated by numerical transient simulations. Real time predictions of the temperatures and solid–liquid interface position in GaAs are crucial for control applications and for process visualization, i.e., for generation of digital twins. In the reported study, an LSTM network was trained on 1950 datasets with 2 external inputs and 6 outputs. Based on network performance criteria and training results, LSTMs showed the very accurate predictions of the VGF-GaAs growth process with median root-mean-square-error (RMSE) values of 2 × 10−3. This deep learning method achieved a superior predictive accuracy and timeliness compared with more traditional Nonlinear AutoRegressive eXogenous (NARX) recurrent networks.

Maxout neurons for deep convolutional and LSTM neural networks in speech recognition

This paper proposes a hybrid modeling framework that synergistically integrates LSTM (Long Short-Term Memory) networks with LightGBM and CatBoost for stock price prediction. We systematically preprocess time-series financial data and conduct comprehensive evaluations using seven classical models: Artificial Neural Networks (ANNs), Convolutional Neural Networks (CNNs), Bidirectional LSTM (BiLSTM), vanilla LSTM, XGBoost, LightGBM, and standard Neural Networks (NNs). Through rigorous comparison of performance metrics, including MAE, R2, MSE, and RMSE, we establish baseline references across multiple temporal scales. Building on these empirical benchmarks, we introduce a novel ensemble architecture that harmonizes the complementary strengths of sequential and tree-based models. Experimental results demonstrate that our integrated framework achieves 10-15% improvement in predictive accuracy compared to individual constituent models, particularly in reducing error volatility during market regime transitions. These findings validate the underexplored potential of heterogeneous ensemble strategies in financial forecasting and establish methodological foundations for developing adaptive prediction systems in non-stationary market environments. The proposed architecture's modular design enables seamless integration of emerging machine learning components, suggesting promising directions for future research in computational finance.

Cryptomining malware (also referred to as cryptojacking) has changed the cyber threat landscape. Such malware exploits the victim’s CPU or GPU resources with the aim of generating cryptocurrency. In this paper, we study the potential of using deep learning techniques to detect cryptomining malware by utilizing both static and dynamic analysis approaches. To facilitate dynamic analysis, we establish an environment to capture the system call events of 1500 Portable Executable (PE) samples of the cryptomining malware. We also demonstrate how one can perform static analysis of PE files’ opcode sequences. In our study, we evaluate the performance of using Long Short-Term Memory (LSTM), Attention-based LSTM (ATT-LSTM), and Convolutional Neural Networks (CNN) on our sequential data (opcodes and system call invocations) for classification by a Softmax function. We achieve an accuracy rate of 95% in the static analysis and an accuracy rate of 99% in the dynamic analysis.

The prognostics and health management (PHM) plays the main role to handle the risk of failure before its occurrence. Next, it has a broad spectrum of applications including utility networks, energy storage systems (ESS), etc. However, an accurate capacity estimation of batteries in ESS is mandatory for their safe operations and decision making policy. ESS comprises of different storage mechanisms such as batteries, capacitors, etc. Consequently, the measurement of different charging profiles (CPs) has a strong relation to battery capacity. These profiles include temperature (T), voltage (V), and current (I) where the CPs patterns vary as the battery ages with cycles. Consequently, estimating a battery capacity, the conventional methods practice single channel charging profile (SCCP) and hop multiple channel CPs (MCCPs) that cause incorrect battery health estimation. To tackle these issues, this article proposes MCCPs based battery management system (BMS) to estimate batteries health/capacity through the deep learning (DL) concept where the patterns in these CPs are changed as the battery ages with time and cycles. Thus, we deeply investigate both machine learning (ML) and DL based methods to provide a concrete comparative analysis of our method. The adaptive boosting (AB) and support vector regression (SVR) are widely compared with long short-term memory (LSTM), multi-layer perceptron (MLP), bi-directional LSTM (BiLSTM), and convolutional neural network (CNN) to attain the appropriate approach for battery capacity and state of health (SOH) estimation. These approaches have a high learning capability of inter-relation between the battery capacity and variation in CPs patterns. To validate and verify the proposed technique, we use NASA battery dataset and experimentally prove that BiLSTM outperforms all the approaches and obtains the smallest error values for MAE, MSE, RMSE, and MAPE using MCCPs compared to SCCP.

The state-of-energy (SOE) and state-of-health (SOH) are two crucial quotas in the battery management systems, whose accurate estimation is facing challenges by electric vehicles’ (EVs) complexity and changeable external environment. Although the machine learning algorithm can significantly improve the accuracy of battery estimation, it cannot be performed on the vehicle control unit as it requires a large amount of data and computing power. This paper proposes a joint SOE and SOH prediction algorithm, which combines long short-term memory (LSTM), Bi-directional LSTM (Bi-LSTM), and convolutional neural networks (CNNs) for EVs based on vehicle-cloud collaboration. Firstly, the indicator of battery performance degradation is extracted for SOH prediction according to the historical data; the Bayesian optimization approach is applied to the SOH prediction combined with Bi-LSTM. Then, the CNN-LSTM is implemented to provide direct and nonlinear mapping models for SOE. These direct mapping models avoid parameter identification and updating, which are applicable in cases with complex operating conditions. Finally, the SOH correction in SOE estimation achieves the joint estimation with different time scales. With the validation of the National Aeronautics and Space Administration battery data set, as well as the established battery platform, the error of the proposed method is kept within 3%. The proposed vehicle-cloud approach performs high-precision joint estimation of battery SOE and SOH. It can not only use the battery historical data of the cloud platform to predict the SOH but also correct the SOE according to the predicted value of the SOH. The feasibility of vehicle-cloud collaboration is promising in future battery management systems.

The study explores the field of weather prediction with attention to its real‑world use and the quality that can be enhanced with the help of the most advanced methods of machine learning. It particularly studies the application of long short‑ term memory (LSTM) networks to improve forecasting. The paper relies on the data collected in Delhi, India, to train and evaluate the LSTM model. The paper identifies critical gaps in weather forecasting studies and investigates the effects of the gaps on business and lives. Accurate weather prediction can be used in such industries as agriculture, transport and disaster management, where a small development may have tremendous consequences. The paper provides a clear overview of LSTM model, the architecture, validation policy and evaluation. LSTM networks are the most appropriate networks to make the weather forecasts given that they are capable of repeating the patterns using the time series data. The paper will reveal that LSTM networks are efficient to improve the accuracy of weather prediction as well as how they may revolutionize industries that are reliant on the accuracy of predictions. This model was trained in this study based on an effective evaluation of MSE 0.034.

COVID-19 pandemic has indeed plunged the global community especially African countries into an alarming difficult situationculminating into a great deal amounts of catastrophes such as economic recession, political instability and loss of jobs. Thepandemic spreads exponentially and causes loss of lives. Following the outbreak of the omicron new variant of concern,forecasting and identification of the COVID-19 infection cases is very vital for government at various levels. Hence, havingknowledge of the spread at a particular point in time, swift actions can be taken by government at various levels with a view toaccordingly formulate new policies and modalities towards minimizing the trajectory of the consequences of COVID-19 pandemicto both public health and economic sectors. Here, a potent combination of Convolutional Neural Network (CNN) learning algorithm along with Long Short Term Memory(LSTM) learning algorithm has been proposed in this work in order to produce a hybrid of a deep learning algorithm ConvolutionalNeural Network - Long Short Term Memory (CNN-LSTM) for forecasting COVID-19 infection cases particularly in Nigeria, SouthAfrica and Botswana. Forecasting models for COVID-19 infection cases in Nigeria, South Africa and Botswana, were developedfor 10 days using deep learning-based approaches namely CNN, LSTM and CNN-LSTM deep learning algorithm respectively. The models were evaluated on the basis of four standard performance evaluation metrics which include accuracy, MSE, MAEand RMSE respectively. However, the CNN-LSTM deep learning-based forecasting model achieved the best accuracy of98.30%, 97.60%, and 97.74% for Nigeria, South Africa and Botswana respectively; and in the same manner, achieved lesserMSE, MAE and RMSE values compared to models developed with CNN and LSTM respectively. Taken together, the CNN-LSTM deep learning-based forecasting model for COVID-19 infection cases in Nigeria, South Africaand Botswana dramatically surpasses the two other DL based forecasting models (CNN and LSTM) for COVID-19 infectioncases in Nigeria, South Africa and Botswana in terms of not only the best accuracy of with 98.30%, 97.60%, and 97.74% but alsoin terms of lesser MSE, MAE and RMSE.

To explore the potential relationship between the leading vehicle and the following vehicle during car-following, we proposed a novel car-following model combining a convolutional neural network (CNN) with a long short-term memory (LSTM) network. Firstly, 400 car-following periods were extracted from the natural driving database and the OpenACC car-following experiment database. Then, we developed a CNN-LSTM car-following model, and the CNN is employed to analyze the potential relationship between the vehicle’s dynamic parameters and to extract the features of car-following behavior to generate the feature vector. The LSTM network is adopted to save the feature vector and predict the speed of the following vehicle. Finally, the CNN-LSTM model is trained and tested with the extracted car-following trajectories data and compared with the classical car-following models (LSTM model, intelligent driver model). The results show that the accuracy and the ability to learn the heterogeneity of the proposed model are better than the other two. Furthermore, the CNN-LSTM model can accurately reproduce the hysteresis phenomenon of congested traffic flow and apply to heterogeneous traffic flow mixed with adaptive cruise control vehicles on the freeway, which indicates that it has strong generalization ability.

Forecasting of hygrothermal behaviour of direct solar floors using artificial neural networks

A general-purpose no-reference video quality assessment algorithm based on a long short-term memory (LSTM) network and a pretrained convolutional neural network (CNN) is introduced. Considering video sequences as a time series of deep features extracted with the help of a CNN, an LSTM network is trained to predict subjective quality scores. In contrast to previous methods, the resulting algorithm was trained on the recently published Konstanz Natural Video Quality Database (KoNViD-1k), which is the only publicly available database that contains sequences with authentic distortions. The results of experiments on KoNViD-1k demonstrate that the proposed method outperforms other state-of-the-art algorithms. Furthermore, these results are also confirmed using tests on the LIVE Video Quality Assessment Database, which consists of artificially distorted videos.