Working modes recognition method of phased array radar based on TCN-BiLSTM parallel processing

The existing literature on forecasting time series data is primarily based on univariate analysis and techniques such as Univariate Autoregressive (UAR), Univariate Moving Average (UMA), Simple Exponential Smoothing (SES), deep learning models, and, most notably, univariate Long Short-Term Memory (LSTM) built based on univariate variable where the next lag of time series is leveraged for forecasting the next cycle of data. This paper takes this line of research to the next level by focusing on forecasting time series data based on “multivariate” modeling and analysis. To have a better insight of the performance of various deep learning-based models when multivariate analysis is performed, the paper builds and reports the forecasting accuracy for techniques such as the Transformer-based Multi-head Attention network, Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (BI-LSTM), Temporal Convolution Network (TCN), and conventional Vector Autoregressive (VAR) models. The findings revealed that the TCN model achieved the average lowest RMSE values of 0.0589 for stock data and 0.1554 for cryptocurrency data. Notably, the Multi-Head Attention model achieved average <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$R^{2}$ </tex-math></inline-formula> values of 0.92 for stock data and −1.98 for cryptocurrency data with respect to five variables (i.e., open, high, low, close and volume). According to the empirical studies conducted and reported in this paper, the transformer-based Multi-head Attention network outperformed other models such as LSTM, BI-LSTM, and more importantly conventional Vector Auto-Regression Models (VAR) in stocks and cryptocurrencies time series data where several variables were leveraged in building these multivariate-based models.

In cybersecurity, the rise of fileless malware poses a significant challenge to endpoint security. Traditional detection methods often fail against these sophisticated attacks, necessitating advanced techniques like deep learning models. This study highlights the limitations of Bi-Directional Long Short-Term Memory (BLSTM) models in dynamic malware analysis and proposes enhancements through Convolutional Long Short-Term Memory (ConvLSTM) architecture. BLSTM models process input sequences in forward and backward directions, combining the results into one output. While this dual-layer approach improves analysis, it is time-consuming, potentially increasing the risk of fileless malware attacks. A key limitation of BLSTM is the lack of parameter sharing between forward and backward directions. This reduces its ability to capture spatial and temporal features simultaneously, hindering effectiveness in detecting fileless malware. To address this, the ConvLSTM model consolidates feature extraction within a single LSTM cell layer. ConvLSTM breaks down samples into subsequence and uses timesteps for additional feature extraction, enabling spatial-temporal data analysis and improving malware prediction accuracy. The model was tested using a dynamic malware dataset. Unlike traditional LSTM, ConvLSTM integrates convolutional layers, allowing parameter sharing across both spatial and temporal dimensions. This reduces computational complexity and improves model performance in handling multidimensional data. The research re-simulated prior work with BLSTM using the same malware dataset. The Spyder app ran the event simulator and the ConvLSTM model's results replaced BLSTM's using identical parameters. Time, accuracy and loss were the main performance metrics. ConvLSTM outperformed BLSTM, achieving 98% detection accuracy compared to BLSTM's 90%. It also significantly reduced processing time, averaging 10 seconds, while BLSTM took 22 seconds. ConvLSTM experienced lower losses, averaging 10% per epoch versus BLSTM's 20%. In conclusion, ConvLSTM offers superior performance over BLSTM in fileless malware detection. Its enhanced computational efficiency and ability to quickly mitigate threats make it a robust solution for fortifying endpoint security against evolving cyber threats. ConvLSTM holds potential in strengthening defence mechanisms against sophisticated malware attacks, providing a proactive approach to safeguarding networks and data.

Automatic depression classification from multimodal input data is a challenging task. Modern methods use paralinguistic information such as audio and video signals. Using linguistic information such as speech signals and text data for depression classification is a complicated task in deep learning models. Best audio and video features are built to produce a dependable depression classification system. Textual signals related to depression classification are analyzed using text-based content data. Moreover, to increase the achievements of the depression classification system, audio, visual, and text descriptors are used. So, a deep learning-based depression classification model is developed to detect the person with depression from multimodal data. The EEG signal, Speech signal, video, and text are gathered from standard databases. Four stages of feature extraction take place. In the first stage, the features from the decomposed EEG signals are attained by the empirical mode decomposition (EMD) method, and features are extracted by means of linear and nonlinear feature extraction. In the second stage, the spectral features of the speech signals from the Mel-frequency cepstral coefficients (MFCC) are extracted. In the third stage, the facial texture features from the input video are extracted. In the fourth stage of feature extraction, the input text data are pre-processed, and from the pre-processed data, the textual features are extracted by using the Transformer Net. All four sets of features are optimally selected and combined with the optimal weights to get the weighted fused features using the enhanced mountaineering team-based optimization algorithm (EMTOA). The optimal weighted fused features are finally given to the hybrid attention-based dilated network (HADN). The HDAN is developed by combining temporal convolutional network (TCN) with bidirectional long short-term memory (Bi-LSTM). The parameters in the HDAN are optimized with the assistance of the developed EMTOA algorithm. At last, the classified output of depression is obtained from the HDAN. The efficiency of the developed deep learning HDAN is validated by comparing it with various traditional classification models.

The power metering and detection equipment is a device used to measure the power consumption of users and energy loss of power lines. It is of great significance to timely identify and handle operational anomalies of electric power metering and detection equipment to ensure stable and reliable operation of the metering device. In response to the problems of low accuracy and poor robustness in existing fault diagnosis methods for electric power metering and detection equipment, this paper proposes an intelligent fault diagnosis method based on deep learning. The paper combines the characteristics of convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) in extracting local and global features, and combines them with self-attention (SA) mechanism to propose a hybrid network model SA-CNN-BiLSTM for monitoring the status of electric power metering and detection equipment. This model first extracts local information through the CNN network. At the same time, BiLSTM can extract global features, and then the feature fusion layer combines these two different features. Then, the self-attention mechanism weight adjustment layer is used to calculate and adjust the weights of the fused feature vectors. Finally, the fused feature vectors are input into the fully connected layer, and fault classification predictions are obtained through a softmax classifier. System experiments have demonstrated the correctness and effectiveness of this method.

Tuberculosis is an infectious disease and requires serious treatment. Extrapulmonary Tuberculosis is detected using a microscope. Currently it will take a long time because the fluid preparations are viewed in a microscope one by one carefully and in the fluid preparations there are 150 fields of vision. Examination for Extra Pulmonary Tuberculosis by culture takes between 1-2 weeks or even more. Examination by biopsy will take a long time because the fluid preparations are looked at carefully under the microscope one by one. The image of Tuberculosis is expressed if in the image there is a bacillus object in red, and it turns out that apart from the bacillus object there are other objects also in red. So that examinations for tuberculosis can be more efficient, examinations using computer technology are needed. This research aims to compare the Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BiLSTM) classification methods in the detection of extra-pulmonary tuberculosis disease to obtain better accuracy results. This research carried out HSI color space transformation, segmentation using global thresholding, feature extraction using 13 features based on shape and texture using the Correlation Based Feature Selection (CFS) feature selection method. The results show that BiLSTM has the best accuracy with a value of 88.40% at the number of features = 3, namely Short Run High Gray-Level Emphasis, Run Length Nonuniformity, Minor axis length, while LSTM produces an accuracy of 63.19% at the number of features = 5. BiLSTM is capable of detecting opposite features, meaning that BiLSTM can detect opposite features in data sequences and BiLSTM's ability to understand multiple contexts, so it tends to provide more accurate results in some data classification tasks.

The integrity and efficiency of modern energy grids are increasingly reliant on accurate anomaly detection within energy consumption data. However, class imbalance poses significant challenges, where normal consumption patterns vastly outnumber critical anomalies, leading to biased detection models. This paper presents a novel heterogeneous deep ensemble model specifically designed to handle class imbalance in energy consumption anomaly detection. The architecture strategically integrates Bidirectional Long ShortTerm Memory (BiLSTM) networks for capturing temporal dependencies and Convolutional Neural Networks (CNNs) for feature extraction. Cost-sensitive learning was incorporated to address class imbalance, with rigorous hyperparameter tuning using Bayesian optimization. The model was evaluated using the State Grid Corporation of China (SGCC) dataset containing 42,372 customers' electricity consumption data.The deep ensemble model achieved impressive performance metrics: accuracy of 97.5%, precision of 97%, recall of 99%, F1-score of 98%, and AUC-ROC score of 99%. Statistical analysis confirmed significant improvements over baseline methods (BiLSTM and CNN) and existing ensemble models, with p-values consistently below 0.05.The heterogeneous ensemble architecture demonstrates superior performance compared to individual models and existing approaches. Cost-sensitive learning effectively addresses class imbalance while maintaining high accuracy. The findings establish new performance benchmarks for anomaly detection in energy systems with significant implications for energy efficiency, grid stability, and infrastructure security.

Multivariate time-series forecasting is one of the crucial and persistent challenges in time-series forecasting tasks. As a kind of data with multivariate correlation and volatility, multivariate time series impose highly nonlinear time characteristics on the forecasting model. In this paper, a new multivariate time-series forecasting model, multivariate temporal convolutional attention network (MTCAN), based on a self-attentive mechanism is proposed. MTCAN is based on the Convolution Neural Network (CNN) model, using 1D dilated convolution as the basic unit to construct asymmetric blocks, and then, the feature extraction is performed by the self-attention mechanism to finally obtain the prediction results. The input and output lengths of this network can be determined flexibly. The validation of the method is carried out with three different multivariate time-series datasets. The reliability and accuracy of the prediction results are compared with Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), Convolutional Long Short-Term Memory (ConvLSTM), and Temporal Convolutional Network (TCN). The prediction results show that the model proposed in this paper has significantly improved prediction accuracy and generalization.

Pedestrian dead reckoning (PDR) uses built-in sensors in smartphones to track user positions, offering both versatility and portability. However, diversities among individuals and their behavior patterns decrease positioning accuracy. In this study, a two-stage personalized pedestrian dead reckoning based on neural networks (P2Net) is proposed. The first stage employs a human activity and smartphone location recognition (HSR) module, integrating a convolutional neural network with focal loss (FLCNN) to recognize nine modes, which constrains the subsequent optimized PDR procedure. In the second stage, a hybrid feature temporal attention network (HFTAN) is constructed to achieve generalized step length estimation across individual diversities. Temporal features via temporal convolutional network (TCN) and physical features are combined to generate hybrid features with time-series modeling capability and interpretability, which are then fed into a bi-directional long short-term memory (BiLSTM) model with a feature attention mechanism to estimate pedestrian step length. Experimental results demonstrate that P2Net achieves a class average accuracy of 92.75% for nine modes, and the total traveled distance error (TTDE) under various states is within 10%, outperforming other mentioned positioning methods.

This paper proposes a multi-layered anomaly detection scheme to train feature extraction and to test anomaly prediction by using Convolutional Neural Networks (CNNs) layer, Bidirectional and Unidirectional Long Short-Term Memory (LSTM) Recurrent Neural Networks (RNNs), which is one of a novel deep architecture named stacked convolutional bidirectional LSTM network (SCB-LSTM). In the proposed model, the stacked CNNs perform feature extraction of vibration sensor signal patterns, and the result is used to feature learning with the stacked bidirectional LSTMs (SB-LSTMs). After this procedure, the stacked unidirectional LSTMs (SU-LSTMs) enhance the feature learning, and a regression layer finally predicts anomaly detections. The experimental results of bearing data not only show the accuracy of the proposed model in anomaly detection for rotating machinery diagnostics, but also suggest the better performance than other state-of-the-art algorithms such as a plain uni-LSTM or Bi-LSTM.

Due to the high dimensionality and sparsity of text and the complex semantics of the natural language, sentiment analysis of movie reviews presents difficult challenges. To solve these problems, a novel architecture that contains a robustly optimized bidirectional encoder representations from transformers pretraining approach (RoBERTa), a bidirectional long short-term memory (BiLSTM), a temporal convolutional network (TCN) and a convolutional layer is proposed in this paper. The proposed architecture is called dual branch feature coding network based on RoBERTa (DBN-Ro). In DBN-Ro, the RoBERTa pretraining model is used to obtain the word embedding and the dual branch network is used to extract the contextual semantic and multi-level representations. The convolutional layer is used to perform dimensionality compression on the stitched vectors. The DBN-Ro is experimentally validated on two movie reviews, the results show that it achieves better prediction results in sentiment analysis of movie reviews tasks.

Polysomnography (PSG) is the standard test for diagnosing sleep apnea. However, the approach is obtrusive, time-consuming, and with limited access for patients in need of sleep apnea diagnosis. In recent years, there have been many attempts to search for an alternative device or approach that avoids the limitations of PSG. Pressure-sensitive mats (PSM) have proven to be able to detect central sleep apneas (CSA) and be a potential alternative for PSG. In the current study, we combine advanced machine learning approaches with a practical unobtrusive home monitoring device (PSM) to detect CSA events from data collected nocturnally and unattended. Two deep learning methods are implemented for the automatic detection of CSA events: a temporal convolutional network (TCN) and a bidirectional long short-term memory (BiLSTM) network. The deep learning models are compared to a classical machine learning approach (linear support vector machine, SVM) and a simple threshold-based algorithm. Considering the characteristics of each method, we choose strategies, including resampling and weighted cost-functions, to optimize the methods and to perform CSA detection as anomaly detection in an imbalanced data set. We evaluate the performance of all models on a database containing 7 days of data from 9 elderly patients. From the resulting 63 days, data from 7 patients (49 days) are devoted to training for optimizing hyperparameters, and data from 2 patients (14 days) are devoted to testing. Experimental results indicate that the best-performing model achieves an accuracy of 95.1% through training an BiLSTM network. Overall, the implemented deep learning methods achieve better performance than the conventional classification approach (SVM) and the simple threshold-based method, and show good potential for the use of PSM for practical unobtrusive monitoring of CSA.

Electricity demand is driven by a diverse set of factors, including fluctuations in business cycles, interregional dynamics, and the effects of climate change. Accurately quantifying the impact of these factors remains challenging, as existing methods often fail to address the complexities inherent in these influences. This study introduces a time series forecasting model based on Kolmogorov–Arnold Networks (KANs), integrated with three advanced neural network architectures, Temporal Convolutional Network (TCN), Bidirectional Long Short-Term Memory (BiLSTM), and Transformer, to forecast UK electricity demand. The analysis utilizes real-world datasets from a leading utility company and publicly available sources. Experimental findings reveal that the integration of KANs significantly improves forecasting accuracy, robustness, and adaptability, particularly in modeling intricate sequential patterns in electricity demand time series. The proposed approach addresses the limitations of traditional time series models, underscoring the potential of KANs as a transformative tool for predictive analytics.

PurposeOne of the paramount challenges in the field of structural health monitoring (SHM) is the precise assessment of structural damage. Recently, many methods have been proposed to diagnose damage in structures using time series data. Nevertheless, these techniques are restricted in their ability to capture the bidirectional temporal and spatial relationships among the data. To remedy these shortcomings, this study proposes an advanced deep learning (DL) technique that integrates one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks, termed BiLSTM-1DCNN.Design/methodology/approachThis study proposes an advanced deep learning (DL) technique that integrates one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks, termed BiLSTM-1DCNN. The novelty of BiLSTM-1DCNN comes in its effective fusion of 1DCNN’s local feature extraction and BiLSTM’s capacity to capture long-term information from both directions (forward and backward).FindingsValidation using a dataset from the Nam O steel truss bridge demonstrates that the proposed method surpasses conventional models, including 1DCNN (87.9%), LSTM (72.5%), BiLSTM (76.1%) and LSTM-1DCNN (91.1%), achieving an accuracy rate of 96.4%. This approach provides a significant advancement in SHM, paving the way for more accurate and reliable damage detection.Research limitations/implicationsThe study’s limitations include potential overfitting due to the model’s complexity and the high computational resources required. The BiLSTM-1DCNN model’s performance is also influenced by the quality and quantity of the training data as well as the specific characteristics of the dataset. Additionally, while the model performs well in detecting damage in the Nam O steel truss bridge, its generalizability to other types of structures and environmental conditions remains untested.Practical implicationsThe BiLSTM-1DCNN model offers significant practical benefits for structural health monitoring by enhancing damage detection accuracy. Its ability to effectively capture both local features and long-term temporal dependencies makes it a valuable tool for real-time monitoring and early detection of structural issues. This can lead to more timely maintenance actions, potentially reducing repair costs and improving safety. The model’s high accuracy in detecting damage can also support infrastructure management decisions, contributing to better resource allocation and enhanced overall safety of critical structures.Social implicationsThe BiLSTM-1DCNN model’s advanced damage detection capabilities have positive social implications, such as improving the safety and reliability of public infrastructure like bridges. Enhanced structural health monitoring can reduce the risk of catastrophic failures, protecting lives and reducing accidents. By providing more accurate and timely assessments, the model can also lead to more efficient use of maintenance and repairs, ensuring that resources are allocated effectively.Originality/valueThe originality of the BiLSTM-1DCNN model lies in its innovative integration of one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks. This unique combination leverages 1DCNN’s strength in local feature extraction and BiLSTM’s capacity to capture temporal dependencies in both directions, addressing the limitations of existing methods. The model’s high accuracy in detecting structural damage, as demonstrated by its performance on the Nam O steel truss bridge dataset, highlights its value in advancing structural health monitoring technologies and offers a significant improvement over traditional approaches.

The major issues with business cycle value prediction are that the data sources are heterogeneous, complex spatiotemporal dependencies, and a lack of long-term prediction accuracy. The model of dynamic prediction, which is developed in this paper, is founded on the fusion of multimodal data and deep learning and incorporates four kinds of heterogeneous data, financial indicators, market transactions, macroeconomic data, and textual sentiment. The former applies a Temporal Convolutional Network (TCN) to learn the temporal features of each modality and a Multi-Head Attention (MHA) mechanism to learn cross-modal interaction relationships. Second, gated fusion unit is intended to weigh and fuse heterogeneous features dynamically and Bidirectional Long Short-Term Memory (BiLSTM) network is employed to model cycle evolution law. Lastly, residual connections with Dropout regularization are also added to enhance the generalization capacity of the model. The model on an empirical dataset of 3500 companies in the 2010-2024 period had a mean absolute percentage error (MAPE) of 6.2% and root mean square error (RMSE) of 0.043 in the expansion phase and 8.7% in the contraction phase, giving it a useful tool and theoretical foundation on dynamic monitoring of business cycle and corporate decision-making.

Missing data reconstruction in attitude for quadrotor unmanned aerial vehicle based on deep regression model with different sensor failures