• Home
  • Search
  • Enhanced Asynchronous Advantage Actor-Critic (EA3C) Algorithm for Intrusion Detection in IIoT Environment
  • https://doi.org/10.59628/jast.v3i3.1681Copy DOI Icon

Enhanced Asynchronous Advantage Actor-Critic (EA3C) Algorithm for Intrusion Detection in IIoT Environment

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Intrusion detection is crucial for securing Industrial Internet of Things (IIoT) networks, especially within edge computing environments. Traditional Intrusion Detection Systems (IDSs) struggle with the complexity and dynamic nature of IIoT networks, where increasing intrusion classes make classification tasks more challenging. While the Asynchronous Advantage Actor-Critic (A3C) algorithm has shown promise in reinforcement learning-based IDSs, previous A3C implementations suffer from slow convergence, high variance, unstable gradient updates, and inefficient parameter synchronization. These issues limit their ability to accurately classify diverse attack patterns, particularly underrepresented intrusion types. To address these challenges, this research introduces an Enhanced A3C (EA3C) using an enhanced convolutional neural network (CNN) structure to significantly improve feature representation compared to traditional fully connected networks from the dataset before passing them to the policy and value networks. Additionally, gradient clipping will be applied to prevent exploding gradients, and bootstrapping-based reward handling will be used to enhance policy and value estimation for better long-term learning and improved intrusion detection performance. The proposed approach is evaluated using the X-IIoTID dataset, which is a comprehensive benchmark that is effective in detecting a wide range of cyber threats in IIoT environments. Experimental results indicate that the EA3C algorithm significantly outperforms Decision Tree (DT), Adversarial Environment Reinforcement Learning (AERL), Double Deep Q-Network (DDQN), and traditional A3C algorithms, particularly in identifying underrepresented attack classes. The results of EA3C show that its weighted Accuracy, Precision, Recall, and F1-score exceeded 0.98, making it suitable for practical use with the increasing number of labeled classes of cyber-attacks. Although these results are promising, this algorithm needs further improvement, especially for attacks with very small samples or attacks that occur for the first time, such as zero-day attacks.

Similar Papers
  • Research Article
  • Citations8

A novel deep learning framework with temporal attention convolutional networks for intrusion detection in IoT and IIoT networks

  • Dec 13, 2025
  • Scientific Reports
  • Kingkar Prosad Ghosh +4
  • Research Article
  • Citations29

Cyberattack Detection Systems in Industrial Internet of Things (IIoT) Networks in Big Data Environments

  • Mar 13, 2025
  • Applied Sciences
  • Abdullah Orman
  • Research Article
  • Citations2

Intrusion Detection System using Convolutional Neural Network for Industrial Internet of Things Security

  • May 27, 2025
  • International Journal of Innovative Computing
  • Poh Yee Heng +1
  • PDF
  • Research Article
  • Citations9

Improving Intrusion Detection using Satin Bowerbird Optimization with Deep Learning Model for IIoT Environment

  • Mar 20, 2024
  • International Journal of Electrical and Electronics Research
  • E Anbalagan +4
  • Research Article

Hybrid IIoT intrusion detection enhancement with A3C

  • Nov 17, 2025
  • Edelweiss Applied Science and Technology
  • Abdulssalam M Khako +1
  • Research Article
  • Citations7

Modeling of Bayesian machine learning with sparrow search algorithm for cyberattack detection in IIoT environment

  • Nov 26, 2024
  • Scientific Reports
  • Faten Khalid Karim +4
  • Research Article
  • Citations170

Blockchain and federated learning-based intrusion detection approaches for edge-enabled industrial IoT networks: a survey

  • Oct 10, 2023
  • Ad Hoc Networks
  • Saqib Ali +2
  • Research Article

Federated Intrusion Detection Using TabTransformer-TCN-BiGRU-Attention: A High-Accuracy Hybrid Deep Learning Approach

  • Dec 08, 2025
  • Engineering, Technology & Applied Science Research
  • Noureddine Allassak +2
  • Research Article
  • Citations52

An end-to-end learning approach for enhancing intrusion detection in Industrial-Internet of Things

  • Apr 10, 2024
  • Knowledge-Based Systems
  • Karima Hassini +4
  • PDF
  • Research Article
  • Citations20

Integrated Genetic Algorithm and Deep Learning Approach for Effective Cyber-Attack Detection and Classification in Industrial Internet of Things (IIoT) Environments

  • Oct 21, 2024
  • Arabian Journal for Science and Engineering
  • Nadia Alkhafaji +2
  • Research Article

Detection of Influential nodes using Hybrid Deep learning methods in IIOT environment

  • Dec 01, 2024
  • Journal of Smart Internet of Things
  • Lakshmi Patil +1
  • Research Article
  • Citations10

Data driven intrusion detection system for software defined networking enabled industrial internet of things

  • Mar 22, 2018
  • Journal of Intelligent & Fuzzy Systems
  • Surendar Madhawa +2
  • Research Article

Deep Guard: A Novel Transformer-Based Framework for Real-Time Threat Detection in Heterogeneous Cyber Environments

  • May 23, 2025
  • International Journal of Computational and Experimental Science and Engineering
  • Pradeep K R +5
  • Research Article
  • Citations301

A hybrid CNN+LSTM-based intrusion detection system for industrial IoT networks

  • Jan 06, 2023
  • Engineering Science and Technology, an International Journal
  • Hakan Can Altunay +1
  • PDF
  • Research Article
  • Citations36

Intrusion Detection Framework for Industrial Internet of Things Using Software Defined Network

  • Jun 02, 2023
  • Sustainability
  • Hani Alshahrani +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.