MFQE 2.0: A New Approach for Multi-Frame Quality Enhancement on Compressed Video.

The standard paradigm of video super-resolution (SR) is to generate the spatial-temporal coherent high-resolution (HR) sequence from the corresponding low-resolution (LR) version which has already been decoded from the bitstream. However, a highly practical while relatively under-studied way is enabling the built-in SR functionality in the decoder, in the sense that almost all videos are compactly represented. In this paper, we systematically investigate the SR of compressed LR videos by leveraging the interactivity between decoding prior and deep prior. By fully exploiting the compact video stream information, the proposed bitstream prior embedded SR framework achieves compressed video SR and quality enhancement simultaneously in a single feed-forward process. More specifically, we propose a motion vector guided multi-scale local attention module that explicitly exploits the temporal dependency and suppresses coding artifacts with substantially economized computational complexity. Moreover, a scale-wise deep residual-in-residual network is learned to reconstruct the SR frames from the multi-scale fused features. To facilitate the research of compressed video SR, we also build a large-scale dataset with compressed videos of diverse content, including ready-made diversified kinds of side information extracted from the bitstream. Both quantitative and qualitative evaluations show that our model achieves superior performance for compressed video SR, and offers competitive performance compared to the sequential combinations of the state-of-the-art methods for compressed video artifacts removal and SR.

In this paper, to detect the moving objects between frames in compressed video and to obtain the best compression video and the noiseless video. We describe a video in which frames by classifying macroblocks (MB), and describe motion estimation (ME), motion vector field (MV) and motion compensation (MC). we propose to classify Macroblocks of each video frame into different classes and use this class information to describe the frame content based on the motion vector. MB class information video applications such as shot change detection, motion discontinuity detection, Outlier rejection for global motion estimation. To reduce the noise and to improve the clarity of the compressed video by using contrast limited adaptive histogram equalization (CLAHE) Algorithm.

The past few years have witnessed fast development in video quality enhancement via deep learning. Existing methods mainly focus on enhancing the objective quality of compressed video while ignoring its perceptual quality. In this paper, we focus on enhancing the perceptual quality of compressed video. Our main observation is that enhancing the perceptual quality mostly relies on recovering high-frequency sub-bands in wavelet domain. Accordingly, we propose a novel generative adversarial network (GAN) based on multi-level wavelet packet transform (WPT) to enhance the perceptual quality of compressed video, which is called multi-level wavelet-based GAN (MW-GAN). In MW-GAN, we first apply motion compensation with a pyramid architecture to obtain temporal information. Then, we propose a wavelet reconstruction network with wavelet-dense residual blocks (WDRB) to recover the high-frequency details. In addition, the adversarial loss of MW-GAN is added via WPT to further encourage high-frequency details recovery for video frames. Experimental results demonstrate the superiority of our method.KeywordsVideo perceptual quality enhancementWavelet packet transformGAN

This paper introduces a novel dataset for video enhancement and studies the state-of-the-art methods of the NTIRE 2021 challenge on quality enhancement of com-pressed video. The challenge is the first NTIRE challenge in this direction, with three competitions, hundreds of participants and tens of proposed solutions. Our newly collected Large-scale Diverse Video (LDV) dataset is employed in the challenge. In our study, we analyze the solutions of the challenges and several representative methods from previous literature on the proposed LDV dataset. We find that the NTIRE 2021 challenge advances the state-of-the-art of quality enhancement on compressed video. The pro-posed LDV dataset is publicly available at the homepage of the challenge: https://github.com/RenYang-home/NTIRE21_VEnh

In cybersecurity, the rise of fileless malware poses a significant challenge to endpoint security. Traditional detection methods often fail against these sophisticated attacks, necessitating advanced techniques like deep learning models. This study highlights the limitations of Bi-Directional Long Short-Term Memory (BLSTM) models in dynamic malware analysis and proposes enhancements through Convolutional Long Short-Term Memory (ConvLSTM) architecture. BLSTM models process input sequences in forward and backward directions, combining the results into one output. While this dual-layer approach improves analysis, it is time-consuming, potentially increasing the risk of fileless malware attacks. A key limitation of BLSTM is the lack of parameter sharing between forward and backward directions. This reduces its ability to capture spatial and temporal features simultaneously, hindering effectiveness in detecting fileless malware. To address this, the ConvLSTM model consolidates feature extraction within a single LSTM cell layer. ConvLSTM breaks down samples into subsequence and uses timesteps for additional feature extraction, enabling spatial-temporal data analysis and improving malware prediction accuracy. The model was tested using a dynamic malware dataset. Unlike traditional LSTM, ConvLSTM integrates convolutional layers, allowing parameter sharing across both spatial and temporal dimensions. This reduces computational complexity and improves model performance in handling multidimensional data. The research re-simulated prior work with BLSTM using the same malware dataset. The Spyder app ran the event simulator and the ConvLSTM model's results replaced BLSTM's using identical parameters. Time, accuracy and loss were the main performance metrics. ConvLSTM outperformed BLSTM, achieving 98% detection accuracy compared to BLSTM's 90%. It also significantly reduced processing time, averaging 10 seconds, while BLSTM took 22 seconds. ConvLSTM experienced lower losses, averaging 10% per epoch versus BLSTM's 20%. In conclusion, ConvLSTM offers superior performance over BLSTM in fileless malware detection. Its enhanced computational efficiency and ability to quickly mitigate threats make it a robust solution for fortifying endpoint security against evolving cyber threats. ConvLSTM holds potential in strengthening defence mechanisms against sophisticated malware attacks, providing a proactive approach to safeguarding networks and data.

PurposeOne of the paramount challenges in the field of structural health monitoring (SHM) is the precise assessment of structural damage. Recently, many methods have been proposed to diagnose damage in structures using time series data. Nevertheless, these techniques are restricted in their ability to capture the bidirectional temporal and spatial relationships among the data. To remedy these shortcomings, this study proposes an advanced deep learning (DL) technique that integrates one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks, termed BiLSTM-1DCNN.Design/methodology/approachThis study proposes an advanced deep learning (DL) technique that integrates one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks, termed BiLSTM-1DCNN. The novelty of BiLSTM-1DCNN comes in its effective fusion of 1DCNN’s local feature extraction and BiLSTM’s capacity to capture long-term information from both directions (forward and backward).FindingsValidation using a dataset from the Nam O steel truss bridge demonstrates that the proposed method surpasses conventional models, including 1DCNN (87.9%), LSTM (72.5%), BiLSTM (76.1%) and LSTM-1DCNN (91.1%), achieving an accuracy rate of 96.4%. This approach provides a significant advancement in SHM, paving the way for more accurate and reliable damage detection.Research limitations/implicationsThe study’s limitations include potential overfitting due to the model’s complexity and the high computational resources required. The BiLSTM-1DCNN model’s performance is also influenced by the quality and quantity of the training data as well as the specific characteristics of the dataset. Additionally, while the model performs well in detecting damage in the Nam O steel truss bridge, its generalizability to other types of structures and environmental conditions remains untested.Practical implicationsThe BiLSTM-1DCNN model offers significant practical benefits for structural health monitoring by enhancing damage detection accuracy. Its ability to effectively capture both local features and long-term temporal dependencies makes it a valuable tool for real-time monitoring and early detection of structural issues. This can lead to more timely maintenance actions, potentially reducing repair costs and improving safety. The model’s high accuracy in detecting damage can also support infrastructure management decisions, contributing to better resource allocation and enhanced overall safety of critical structures.Social implicationsThe BiLSTM-1DCNN model’s advanced damage detection capabilities have positive social implications, such as improving the safety and reliability of public infrastructure like bridges. Enhanced structural health monitoring can reduce the risk of catastrophic failures, protecting lives and reducing accidents. By providing more accurate and timely assessments, the model can also lead to more efficient use of maintenance and repairs, ensuring that resources are allocated effectively.Originality/valueThe originality of the BiLSTM-1DCNN model lies in its innovative integration of one-dimensional convolutional neural networks (1DCNN) with bidirectional long short-term memory (BiLSTM) networks. This unique combination leverages 1DCNN’s strength in local feature extraction and BiLSTM’s capacity to capture temporal dependencies in both directions, addressing the limitations of existing methods. The model’s high accuracy in detecting structural damage, as demonstrated by its performance on the Nam O steel truss bridge dataset, highlights its value in advancing structural health monitoring technologies and offers a significant improvement over traditional approaches.

The COVID-19 pandemic has triggered a global crisis in health and economic sectors, causing profound impacts on sea transport and trade. This research paper investigates the ramifications of the pandemic on maritime shipping prices, and, hence, their subsequent influence on the stocks of shipping companies. This global upheaval disrupted international trade significantly, resulting in an unprecedented demand surge for shipping services and a substantial spike in freight rates. This study is intended to propose a predictive method based on Multivariate Multi-step convolutional neural network - Bidirectional Long Short-Term Memory (Multivariate Multi-step CNNBiLSTM) networks in order to forecast the prices of three of the most prominent stocks of big organizations operating in maritime transport. The proposed method is composed of Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM), where the research utilizes CNN to help for feature extraction from the inputted data, alongside BiLSTM that forecasts the closing stock price for the upcoming five days, utilizing the extracted feature data. Hence, stock price prediction can be realized by applying a novel optimization strategy, which was founded on the Multivariate Multi-step CNN-BiLSTM model and utilizing the Adam optimizer. Prediction accuracy can be assessed by incorporating four metrics into the system: Root Mean Square Error, Mean Absolute Error, Mean Absolute Percentage Error, and Median Absolute Percentage Error. Experimental findings demonstrate that Multivariate Multi-step CNN-BiLSTM yields the most dependable stock price forecasts with the highest accuracy. The proposed prediction method, correctly applied, can yield economic benefits at the macr and micro levels; the prediction accuracy can help policy makers make better future outlook estimates in relation to inflation, gross domestic product (GDP), and unemployment levels that might be impacted by the volatile, uncontrolled, or unexpected fluctuations of stock prices of some leading economic sectors that are closely connected to global shipping and supply chain operations; thus, leading to serious impacts at the microeconomic level in relation to costs, supply and demand, and behavior of individual consumers and companies.

Deep learning methods have achieved impressive performance in compressed video quality enhancement tasks. However, these methods rely excessively on practical experience by manually designing the network structure and do not fully exploit the potential of the feature information contained in the video sequences, i.e., not taking full advantage of the multiscale similarity of the compressed artifact information and not seriously considering the impact of the partition boundaries in the compressed video on the overall video quality. In this article, we propose a novel Mixed Difference Equation inspired Transformer (MDEformer) for compressed video quality enhancement, which provides a relatively reliable principle to guide the network design and yields a new insight into the interpretable transformer. Specifically, drawing on the graphical concept of the mixed difference equation (MDE), we utilize multiple cross-layer cross-attention aggregation (CCA) modules to establish long-range dependencies between encoders and decoders of the transformer, where partition boundary smoothing (PBS) modules are inserted as feedforward networks. The CCA module can make full use of the multiscale similarity of compression artifacts to effectively remove compression artifacts, and recover the texture and detail information of the frame. The PBS module leverages the sensitivity of smoothing convolution to partition boundaries to eliminate the impact of partition boundaries on the quality of compressed video and improve its overall quality, while not having too much impacts on non-boundary pixels. Extensive experiments on the MFQE 2.0 dataset demonstrate that the proposed MDEformer can eliminate compression artifacts for improving the quality of the compressed video, and surpasses the state-of-the-arts (SOTAs) in terms of both objective metrics and visual quality.

Prediction of PM2.5 concentration in urban agglomeration of China by hybrid network model

Tuberculosis is an infectious disease and requires serious treatment. Extrapulmonary Tuberculosis is detected using a microscope. Currently it will take a long time because the fluid preparations are viewed in a microscope one by one carefully and in the fluid preparations there are 150 fields of vision. Examination for Extra Pulmonary Tuberculosis by culture takes between 1-2 weeks or even more. Examination by biopsy will take a long time because the fluid preparations are looked at carefully under the microscope one by one. The image of Tuberculosis is expressed if in the image there is a bacillus object in red, and it turns out that apart from the bacillus object there are other objects also in red. So that examinations for tuberculosis can be more efficient, examinations using computer technology are needed. This research aims to compare the Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BiLSTM) classification methods in the detection of extra-pulmonary tuberculosis disease to obtain better accuracy results. This research carried out HSI color space transformation, segmentation using global thresholding, feature extraction using 13 features based on shape and texture using the Correlation Based Feature Selection (CFS) feature selection method. The results show that BiLSTM has the best accuracy with a value of 88.40% at the number of features = 3, namely Short Run High Gray-Level Emphasis, Run Length Nonuniformity, Minor axis length, while LSTM produces an accuracy of 63.19% at the number of features = 5. BiLSTM is capable of detecting opposite features, meaning that BiLSTM can detect opposite features in data sequences and BiLSTM's ability to understand multiple contexts, so it tends to provide more accurate results in some data classification tasks.

The preservation and enhancement of historical news video archives represent a critical challenge in digital archiving. This paper proposes a novel dual-stream approach leveraging modified conditional Generative Adversarial Networks (GANs) for simultaneous enhancement of video and audio quality in historical news footage. The framework incorporates parallel processing pathways for video and audio restoration, connected through an innovative feature fusion mechanism. The architecture introduces several key improvements, including temporal-aware processing modules, multi-scale discriminators, and adaptive feature fusion strategies. Comprehensive experiments conducted on a diverse dataset of historical news broadcasts from 1960-2000 demonstrate significant improvements over existing methods, achieving a 35.2% increase in Peak Signal-to-Noise Ratio (PSNR) and 29.8 dB improvement in audio Signal-to-Noise Ratio (SNR). The proposed framework maintains temporal coherence while preserving content authenticity, addressing critical challenges in archival media restoration. Quantitative evaluations show superior performance across multiple quality metrics, while qualitative assessments confirm enhanced perceptual quality and historical accuracy preservation. The experimental results validate the effectiveness of the dual-stream approach in historical news video restoration, establishing a new benchmark for automated archival media enhancement.

Aiming at the problem of high complexity and low feedback accuracy of existing channel state information (CSI) feedback algorithms for frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems, this paper proposes a CSI compression feedback algorithm based on deep learning (DL), which is suitable for single-user and multi-user scenarios in massive MIMO systems. This algorithm considers the spatial correlation of massive MIMO channel and uses bidirectional long short-term memory (Bi-LSTM) and bidirectional convolutional long short-term memory (Bi-ConvLSTM) network to decompress and recover the CSI for single-user and multi-user, respectively. The proposed DL-based CSI feedback network is trained offline by massive MIMO channel data and could learn the structural characteristics of the massive MIMO channel by fully exploiting the channel information in the training samples. The simulation results show that compared with several classical CSI compression feedback algorithms, the proposed CSI compression feedback algorithm has lower computational complexity, higher feedback accuracy, and better system performance in massive MIMO systems.

Cyber-physical system (CPS) security has become more important in the age of Industry 4.0 because of the quick integration of automation and the Internet of Things. The goal of this project is to create a strong intrusion detection and control system that can recognize and lessen security risks in CPS settings. The suggested approach makes use of deep learning (DL) and reinforcement learning (RL) techniques. To guarantee data consistency, pre-processing procedures such as mean-based imputation and min–max scaling come after data collection. ADASYN data augmentation is used to address class imbalance, while entropy analysis and statistical techniques are used to extract key features. The intrusion detection phase uses a combination of deep convolutional neural networks (DCNN) and bidirectional long short-term memory (BI-LSTM) networks to capture both spatial and temporal relationships in the data, while a hybrid feature selection technique improves the model’s performance. A deep Q-network (DQN) handles attack mitigation and uses reinforcement learning to adjust to new threats. Detecting attack patterns with high sensitivity (0.984), specificity (0.983), and accuracy (0.991626) for dataset 1, the accuracy of dataset 2 is 0.985 for 70% of training and 0.988 for 80% of training, and the Proposed-DBID-Net architecture enhances CPS security in Industry 4.0. The evaluation phase emphasizes how crucial feature selection is to maximize the model’s accuracy. In conclusion, this study offers a thorough and flexible method for protecting CPS in Industry 4.0, guaranteeing accuracy and scalability across changing cyber threats.

Research on sentiment analysis in recent years has increased. However, in sentiment analysis research there are still few ideas about the handling of negation, one of which is in the Indonesian sentence. This results in sentences that contain elements of the word negation have not found the exact polarity.The purpose of this research is to analyze the effect of the negation word in Indonesian. Based on positive, neutral and negative classes, using attention-based Long Short Term Memory and word2vec feature extraction method with continuous bag-of-word (CBOW) architecture. The dataset used is data from Twitter. Model performance is seen in the accuracy value.The use of word2vec with CBOW architecture and the addition of layer attention to the Long Short Term Memory (LSTM) and Bidirectional Long Short Term Memory (BiLSTM) methods obtained an accuracy of 78.16% and for BiLSTM resulted in an accuracy of 79.68%. whereas in the FSW algorithm is 73.50% and FWL 73.79%. It can be concluded that attention based BiLSTM has the highest accuracy, but the addition of layer attention in the Long Short Term Memory method is not too significant for negation handling. because the addition of the attention layer cannot determine the words that you want to pay attention to.

The analysis and prediction of industrial production plants are of great significance for reducing energy consumption, improving economic efficiency. Therefore, a production prediction method based on bidirectional long short-term memory (Bi-LSTM) is proposed to accurately analyze and evaluate the energy efficiency status of ethylene production plants in industrial processes. Bi-LSTM is a Indirection ally connected network with two layers of long short-term memory (LSTM), it gives full consideration to the relationship between the current data and the data before and after it. Bi-LSTM solves the gradient disappearance or gradient explosion problem in recurrent neural network (RNN), and overcomes the drawback that LSTM only consider the relationship between the current data and its previous data. The comparison results show that the prediction effect of the Bi-LSTM model is superior to that of the back propagation (BP) neural network model, and the average relative error is reduced by 70%, which proves that the Bi-LSTM can effectively raise the accuracy and stability of the ethylene production prediction.