An Efficient Algorithm for Weather Forecasting Using Causal Graph Neural Network

Most Graph Neural Networks (GNNs) follow the message-passing scheme. Residual connection is an effective strategy to tackle GNNs' over-smoothing issue and performance reduction issue on non-homophilic networks. Unfortunately, the coarse-grained residual connection still suffers from class-imbalanced over-smoothing issue, due to the fixed and linear combination of topology and attribute in node representation learning. To make the combination flexible to capture complicated relationship, this paper reveals that the residual connection needs to be node-dependent, layer-dependent, and related to both topology and attribute. To alleviate the difficulty in specifying complicated relationship, this paper presents a novel perspective on GNNs, i.e., the representations of one node in different layers can be seen as a sequence of states. From this perspective, existing residual connections are not flexible enough for sequence modeling. Therefore, a novel node-dependent residual connection, i.e., Long Short-Term Graph Memory Network (LSTGM) is proposed to employ Long Short-Term Memory (LSTM), to model the sequence of node representation. To make the graph topology fully employed, LSTGM innovatively enhances the updated memory and three gates with graph topology. A speedup version is also proposed for effective training. Experimental evaluations on real-world datasets demonstrate their effectiveness in preventing over-smoothing issue and handling networks with heterophily.

MP41-09 COMBINING VIDEO AND FORCE SENSOR DATA WITHIN A MULTILABEL MULTIMODAL DEEP LEARNING ALGORITHM TO PROVIDE AUTOMATED FEEDBACK FOR ROBOT ASSISTED RADICAL PROSTATECTOMY SIMULATIONS

In this digital era, there is an exponential growth of text-based content in the electronic world. Data as texts exist in the form of documents, social media posts on Facebook, Twitter, etc., logs, sensor data, and emails. Twitter is a social platform where users express their views on various aspects in a day to day life. Twitter produces over 500 million tweets daily that is 6000 tweets per second. Twitter data is, by definition, very noisy and unstructured in nature. Text classifications based on the machine learning techniques have problems like poor generalization ability and sparsity dimension explosion. Classifiers based on deep learning techniques are implemented to improve accuracy to overcome shortcomings of machine learning techniques and to avoid feature extraction processes and have high prediction accuracy and strong learning ability. In this work, the classification of tweets is performed on Covid-19 dataset by implementing deep learning techniques namely Convolution Neural Network (CNN), Recurrent Neural Network (RNN), Recurrent Convolution Neural Network (RCNN), Recurrent Neural Network with Long Short Term Memory (RNN+LSTM), and Bidirectional Long Short Term Memory with Attention (BI-LSTM + Attention). The algorithms are implemented using two-word embedding techniques namely Global Vectors for Word Representation (GloVe) and Word2Vec. RNN with Bidirectional LSTM model has performed better than all the classifiers considered. It has classified the text with an accuracy of 93% and above when used with GloVe and Word2Vec.

Prediction concept needs human-like thinking and ideas. ANN helps make a program for describing the solutions to the prediction problems. To gain accurate prediction, there is a need for deep thinking in the knowledge system discovered. Deep learning helps form such next-level type of ANN thinking. Deep learning models do not require humans for programming the problems. It can determine the prediction by itself by learning the dataset. This paper describes the prediction by considering sequential model for continuous accessing of data with the help of multi-layers. Deep learning is very helpful for predicting larger dataset. This paper proposes an algorithmic model known as a Comprehensive Deep Recurrent Artificial Neural Networks (CDRANN) by hybridizing LSTM (long short-term memory) with RNN (recurrent neural network) backtrack solver for better future stock prediction. This paper also explains the need for hybridizing evolutionary model CDRANN to create a novel change in future prediction.KeywordsCDRANN (Comprehensive Deep Recurrent Artificial Neural Networks)LSTM (long short-term memory)RNN (recurrent neural network)Stock marketPrediction

Deepfakes, which are synthetic media realistic in nature generated using artificial intelligence (AI); pose a significant threat to individuals and society. The rapid advancement of deepfake technology has led to the creation of highly realistic synthetic content covering images, videos, audio, and news. While deepfake applications offer creative possibilities, their misuse for misinformation, identity fraud, and cybersecurity threats necessitates robust detection methods. Deepfake crimes are rising daily, wherein deepfake media detection has become a big challenge and has high claim in digital forensics. This review explores the state-of-the-art deep learning (DL) techniques for deepfake detection of four parameters, namely images, videos, audio, and news. The ML approaches rely on handcrafted features but struggle with evolving deepfake methods. In contrast, DL techniques, such as Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks, have demonstrated superior detection accuracy by learning discriminative features. Even Recurrent Neural Networks (RNNs), and Transformer-based architectures like Bidirectional encoder representations from transformers (BERT), have demonstrated superior accuracy in identifying manipulated content. Furthermore, recent advancements such as Vision Transformers (ViTs) and Explainable AI (XAI) models are enhancing detection interpretability and robustness. This review highlights the future research directions for strengthening deepfake detection mechanisms. The rapid advancements in deepfake generation necessitate continuous research and development of countermeasures.

The COVID-19 pandemic has had a devastating effect on many people, creating severe anxiety, fear, and complicated feelings or emotions. After the initiation of vaccinations against coronavirus, people's feelings have become more diverse and complex. Our aim is to understand and unravel their sentiments in this research using deep learning techniques. Social media is currently the best way to express feelings and emotions, and with the help of Twitter, one can have a better idea of what is trending and going on in people's minds. Our motivation for this research was to understand the diverse sentiments of people regarding the vaccination process. In this research, the timeline of the collected tweets was from December 21 to July21. The tweets contained information about the most common vaccines available recently from across the world. The sentiments of people regarding vaccines of all sorts were assessed using the natural language processing (NLP) tool, Valence Aware Dictionary for sEntiment Reasoner (VADER). Initializing the polarities of the obtained sentiments into three groups (positive, negative, and neutral) helped us visualize the overall scenario; our findings included 33.96% positive, 17.55% negative, and 48.49% neutral responses. In addition, we included our analysis of the timeline of the tweets in this research, as sentiments fluctuated over time. A recurrent neural network- (RNN-) oriented architecture, including long short-term memory (LSTM) and bidirectional LSTM (Bi-LSTM), was used to assess the performance of the predictive models, with LSTM achieving an accuracy of 90.59% and Bi-LSTM achieving 90.83%. Other performance metrics such as precision,, F1-score, and a confusion matrix were also used to validate our models and findings more effectively. This study improves understanding of the public's opinion on COVID-19 vaccines and supports the aim of eradicating coronavirus from the world.

Accurate traffic flow prediction plays a crucial role in designing Ad hoc vehicular mobile networks in modern Internet of things (IoT) based intelligent systems. Several deep learning techniques have been deployed to predict traffic conditions to make vehicular communication more reliable. However, not all these approaches deal with complex road networks and spatial temporal dependencies of traffic data. In this paper, we analyze this problem using long short-term memory (LSTM), gated recurrent unit (GRU) and hybrid CNN-LSTM models. We trained our models using actual traffic flow data provided by the California Department of Transportation (Caltrans) over a 6 month duration and showed that our deep learning models outperform the traditional linear regression method. Moreover, an architectural study of deep learning models is carried out for the traffic flow prediction problem. The performance of these models is evaluated using MSE and MAE metrics. It is observed that the GRU model is the best to handle the complex vehicular traffic mechanisms. Also, that a complex hybrid model like CNN-LSTM does not always outperform the much simpler architectures such as LSTM and GRU.

<p>Accurate traffic flow prediction plays a crucial role in designing Ad hoc vehicular mobile networks in modern Internet of things (IoT) based intelligent systems. Several deep learning techniques have been deployed to predict traffic conditions to make vehicular communication more reliable. However, not all these approaches deal with complex road networks and spatial temporal dependencies of traffic data. In this paper, we analyze this problem using long short-term memory (LSTM), gated recurrent unit (GRU) and hybrid CNN-LSTM models. We trained our models using actual traffic flow data provided by the California Department of Transportation (Caltrans) over a 6 month duration and showed that our deep learning models outperform the traditional linear regression method. Moreover, an architectural study of deep learning models is carried out for the traffic flow prediction problem. The performance of these models is evaluated using MSE and MAE metrics. It is observed that the GRU model is the best to handle the complex vehicular traffic mechanisms. Also, that a complex hybrid model like CNN-LSTM does not always outperform the much simpler architectures such as LSTM and GRU. </p>

Recurring wildfires pose a critical global issue as they undermine social and economic stability and jeopardize human lives. To effectively manage disasters and bolster community resilience, the development of wildfire susceptibility maps (WFSMs) has emerged as a crucial undertaking in recent years. In this research endeavor, two deep learning algorithms were leveraged to generate WFSMs using two distinct remote sensing datasets. Specifically, the Moderate-Resolution Imaging Spectroradiometer (MODIS) and Landsat-8 images were utilized to monitor wildfires that transpired during the year 2021. To develop an effective WFSM, two datasets were created by incorporating 599 wildfire locations with Landsat-8 images and 232 sites with MODIS images, as well as twelve factors influencing wildfires. Deep learning algorithms, namely the long short-term memory (LSTM) and recurrent neural network (RNN), were utilized to model wildfire susceptibility using the two datasets. Subsequently, four WFSMs were generated using the LSTM (MODIS), LSTM (Landsat-8), RNN (MODIS), and RNN (Landsat-8) algorithms. The evaluation of the WFSMs was performed using the area under the receiver operating characteristic (ROC) curve (AUC) index. The results revealed that the RNN (MODIS) (AUC = 0.971), RNN (Landsat-8) (AUC = 0.966), LSTM (MODIS) (AUC = 0.964), and LSTM (Landsat-8) (AUC = 0.941) algorithms demonstrated the highest modeling accuracy, respectively. Moreover, the Gini index was employed to assess the impact of the twelve factors on wildfires in the study area. The results of the random forest (RF) algorithm indicated that temperature, wind speed, slope, and topographic wetness index (TWI) parameters had a significant effect on wildfires in the study region. These findings are instrumental in facilitating efficient wildfire management and enhancing community resilience against the detrimental effects of wildfires.

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information from inputs. For modeling long-term dependencies in a dataset, the gating mechanism concept can help RNNs remember and forget previous information. Representing the hidden layers of an RNN with more expressive operations (i.e., tensor products) helps it learn a more complex relationship between the current input and the previous hidden layer information. These ideas can generally improve RNN performances. In this paper, we proposed a novel RNN architecture that combine the concepts of gating mechanism and the tensor product into a single model. By combining these two concepts into a single RNN, our proposed models learn long-term dependencies by modeling with gating units and obtain more expressive and direct interaction between input and hidden layers using a tensor product on 3-dimensional array (tensor) weight parameters. We use Long Short Term Memory (LSTM) RNN and Gated Recurrent Unit (GRU) RNN and combine them with a tensor product inside their formulations. Our proposed RNNs, which are called a Long-Short Term Memory Recurrent Neural Tensor Network (LSTMRNTN) and Gated Recurrent Unit Recurrent Neural Tensor Network (GRURNTN), are made by combining the LSTM and GRU RNN models with the tensor product. We conducted experiments with our proposed models on word-level and character-level language modeling tasks and revealed that our proposed models significantly improved their performance compared to our baseline models.

The exponential growth in mobile data demand, fueled by the proliferation of smart devices, IoT applications, and multimedia services, has posed significant challenges to the performance andscalability of 5G networks. Traditional network traffic management techniques are increasingly insufficient to meet the dynamic and complex requirements of modern wireless communication systems. In response, deep learning (DL) has emerged as a powerful tool to enable intelligent, adaptive, and realtime optimization of mobile network traffic in 5G environments. This review provides a comprehensive overview of the integration of deep learning algorithms into various layers of the 5G architecture, including radio access networks (RAN), core networks, and edge computing platforms. Key DL models such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory (LSTM), deep reinforcement learning (DRL), and graph neural networks (GNNs) are analyzed in terms of their application to traffic prediction, congestion control, resource allocation, and quality of service (QoS) enhancement. The article also explores existing challenges such as data scarcity, model interpretability, latency constraints, and deployment complexity. Furthermore, it discusses emerging trends like federated learning, transfer learning, and edge intelligence as promising directions for future research. By synthesizing state-of-the-art contributions, this review highlights the transformative potential of DL in building efficient, resilient, and autonomous 5G networks.

The speed of the advancement of digital technologies has led to a remarkable rise in the scale, complexity, and sophistication of cyber-attacks. Traditional security approaches based on extensive use of static rules and signature-based detections are simply not adequate for contemporary threats such as zero-day exploits, advanced persistent threats (APTs), and adversarial attacks. As a radical shift in approach, deep learning has emerged, providing intelligent, adaptive, and automated features for cyber defenses. This review paper provides an inclusive overview of deep learning technologies to mitigate various forms of cyber-attacks. Various deep learning architectures are investigated in this paper, such as convolutional neural networks (CNN), recurrent neural networks (RNN), long short-term memory (LSTM), autoencoders, generative adversarial networks (GANs), and graph neural networks (GNN), and the applications of each technology in intrusion detection, malware classification, phishing detection, anomaly detection, and network traffic analysis. In addition, we discuss mainstream datasets, metrics for evaluation, and methodology as they relate to cyber security. Issues such as limited data, adversarial robustness, and usability, will be critically discussed. We also discuss new directions such as hybrid models, privacy-preserving learning, and federated defenses. By aggregating recent research, this review highlights the promise of deep models to serve as robust defenders against deep and evolving cyber-attacks, which serves as impetus for next-generation intelligent cybersecurity systems.

Deep Learning technologies have proven to be capable of making predictions in High-Frequency Trading, often reaching better results compared to other techniques traditionally used for this purpose. A Long Short-Term Memory (LSTM) architecture has been implemented because, despite noise, nonlinearity, nonstationarity and complexities in high-frequency data, this Recurrent Neural Network (RNN) deep learning technique allows for the discovery of interesting patterns, due to its peculiar features. Unlike traditional RNNs, which struggle to retain information over extended sequences, LSTM cells are able to selectively store and retrieve significant information from the past values. The goal of this paper is to study and implement a robust process for the fine-tuning of these nonlinear autoregressive models, analyze the results with the proper metrics, and evaluate the overall performance. A market case study based on an Italian stock has been analyzed to complement our discussion and we show how to improve the network performance using the technical indicator Williams %R as an exogenous variable related to volumes.

For environmental protection, urban planning, monitoring, and management of the urban ecosystem, mapping urban green spaces is a crucial undertaking. A vital source of information for United Nations Sustainable Development Goal 11.7 could come from urban green space mapping. The standard method of mapping urban green spaces requires field measurements and takes a lot of time. It is also important to update urban green space maps periodically because urban green spaces can change quickly over time due to development. With the advent of high-resolution satellite sensors like Sentinel-1 and Sentinel-2, a large number of remote sensing images may be gathered, providing quick and precise information over urban areas. This work intends to offer a new perspective on how crowd sourced geospatial big data and remote sensing may be combined to enhance the mapping of urban green spaces, including time optimization and accurate information through machine learning and deep learning. For the revitalization of cities, this data will be valuable. Remote sensing imagery data can be classified using machine learning techniques like Support vector machines (SVM), Random forests (RF), and Naive Bayes (NB). In deep learning techniques such as Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN), K Nearest Neighbor (KNN), Generative Adversarial Networks (GAN), and Recurrent Neural Networks (RNN) can be used to classify remote sensing images.

In recent years, machine learning and Deep Learning have increased and gathered epic success in traditional application domains and new areas of Artificial Intelligence. The performance using Deep Learning has dominated experimental results compared to conventional machine learning algorithms. This paper presents an overview of the progress that has occurred in Deep Learning (DL) concerning some application domains like Autonomous Driving, Healthcare, Voice Recognition, Image Recognition, Advertising, Predicting Natural Calamities, National Stock Exchange and many more. Additionally, deeper insights into several Deep Learning techniques, their working principles, and experimental results are scrutinized. The survey covers Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), including Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL).