Efficient Learning-driven Anomaly Detection and Classification for IoT-based Monitoring Systems

<abstract><p>With the widespread application of smart devices, the security of internet of things (IoT) systems faces entirely new challenges. The IoT data stream operates in a non-stationary, dynamic environment, making it prone to concept drift. This paper focused on addressing the issue of concept drift in data streams, with a key emphasis on introducing an innovative drift detection method-ensemble multiple non-parametric concept localization detectors, abbreviated as EMNCD. EMNCD employs an ensemble of non-parametric statistical methods, including the Kolmogorov-Smirnov, Wilcoxon rank sum and Mann-Kendall tests. By comparing sample distributions within a sliding window, EMNCD accurately detects concept drift, achieving precise localization of drift points, and enhancing overall detection reliability. Experimental results demonstrated the superior performance of EMNCD compared to classical methods on artificial datasets. Simultaneously, to enhance the robustness of data stream processing, we presented an online anomaly detection method based on the isolation forest (iForest). Additionally, we proposedwhale optimization algorithm (WOA)-extreme gradient boosting (XGBoost), a drift adaptation model employing XGBoost as a base classifier. This model dynamically updates using drift points detected by EMNCD and fine-tunes parameters through the WOA. Real-world applications on the edge-industrial IoTset (IIoTset) intrusion dataset explore the impact of concept drift on intrusion detection, where IIoT is a subclass of IoT. In summary, this paper focused on EMNCD, introducing innovative approaches for drift detection, anomaly detection, and drift adaptation. The research provided practical and viable solutions to address concept drift in data streams, enhancing security in IoT systems.</p></abstract>

Deep learning-enabled anomaly detection for IoT systems

In recent years, with the increasing popularity of "Smart Technology", the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT streaming data. However, IoT data analytics faces concept drift challenges due to the dynamic nature of IoT systems and the ever-changing patterns of IoT data streams. In this article, we propose an adaptive IoT streaming data analytics framework for anomaly detection use cases based on optimized LightGBM and concept drift adaptation. A novel drift adaptation method named Optimized Adaptive and Sliding Windowing (OASW) is proposed to adapt to the pattern changes of online IoT data streams. Experiments on two public datasets show the high accuracy and efficiency of our proposed adaptive LightGBM model compared against other state-of-the-art approaches. The proposed adaptive LightGBM model can perform continuous learning and drift adaptation on IoT data streams without human intervention.

The purpose of this paper is to explore the role of Machine Learning (ML) in fortifying the security of cloudbased Internet of Things (IoT) systems, using a comprehensive security management approach. The methodological approach involved comparing different ML techniques such as Decision Trees, Random Forest, Support Vector Machines, and Convolutional Neural Networks. Their effectiveness was evaluated based on the accuracy of threat detection in cloud-based IoT systems. The findings revealed that Convolutional Neural Networks demonstrated the highest accuracy rate (98%) in threat detection, thereby significantly enhancing the security of IoT systems. It also identified improvements in threat detection, prevention, response, and system recovery across all ML techniques. Research limitations were primarily the rapidly evolving nature of both ML and IoT technologies, necessitating continual reassessments. The scope was also limited to cloud-based IoT systems, leaving room for further research on other types of IoT systems. The practical implications included improved system security, which could lead to increased trust and wider adoption of IoT technology in various sectors, from healthcare to home security. The social implications entail a safer digital environment, contributing to data privacy and reducing the risk of cyber threats for individuals and communities. The originality of this paper lies in its comprehensive approach to IoT security management using ML, providing valuable insights into the effectiveness of different ML techniques in enhancing threat detection accuracy.

The Internet of Things (IoT) is an essential component of the digital age, particularly in ensuring reliable and efficient operations as well as the timely and precise recognition of anomalies within IoT systems. However, anomaly detection in time-series data—especially data collected by edge devices—poses several challenges, including concerns over data privacy and communication overhead. To address these issues, this research proposes a novel deep learning (DL)-based anomaly detection model capable of being trained in real-time on edge devices within an IoT environment. The framework ensures user privacy by enabling distributed edge devices to cooperatively train an anomaly recognition system. This study introduces a new, Intelligent Shark Smell Tuned Deep Isolation Forest (ISS-DIF), which effectively detects anomalies and identifies outliers in industrial IoT sensor data with high accuracy. The hybrid model isolates anomalies rather than profiling normal data, making it particularly suitable for identifying rare anomalies within large datasets. Industrial data are collected from real-world manufacturing environments using IoT edge devices. Following data collection, median filtering is applied to reduce noise, and min-max scaling is employed for data normalization. The ISS component allows for fine-tuning the hyperparameters of the Deep Isolation Forest (DIF) to optimize detection performance. The DIF model is tailored to enhance anomaly detection capabilities in sensor data from industrial IoT applications. For validation, 80% of the dataset was used for training, while the remaining 20% served as the test set. The results demonstrate that the proposed ISS-DIF framework achieved superior training accuracy of 99.30%, with precision of 97.89%, recall of 98.76%, and an F1-score of 97.21%, outperforming the testing metrics. This approach integrates real-time anomaly detection with the processing capabilities of edge devices, thereby improving IoT data analytics and providing a scalable, efficient solution that preserves privacy in irregularity recognition within IoT environments.

Since the Internet of Things (IoT) will be entwined with everything we use in our daily life, the consequence of security flaws escalates. Smart objects will govern most of the home appliances and car engines yielding potential disaster scenarios. In this context, successful attacks could lead to chaos and scary scenarios (www.darkreading.com). Unprotected personal information may expose sensitive and embarrassing data to the public and attacks may threaten not only our computers and smart devices, but our intimacy and perhaps our lives too. Because persons and objects will be bonded with each other, user consent becomes critical. Therefore, thing, object, and user Identity will be the focus of future IoT security solutions, yielding a Trust, Security, and Privacy (TSP) paradigm, which may constitute the Achilles' heel of IoT. While security issues are quite straightforward, mainly from background knowledge, privacy issues are far more complex. Privacy constitutes a rather challenging task, even for the m...

Destructive cyber-attacks and cybercriminals are increasing with the increase in IoT (Internet of Things) devices globally. This ha/s led to the need for increase in security in IoT systems. Innovative and novel techniques are used by the intruders to accomplish malicious goals effectively through cyber-attacks. An Intrusion Detection System (IDS) is used for classification of attacks in IoT networks based on anomaly detection and machine learning techniques. Inefficiency is observed in the conventional machine learning models and intrusion detection techniques as the network technologies are unpredictable. Accurate identification of various anomalies is possible with deep learning models in several research segments. The input data along with its prominent characteristics may be categorized automatically for classification and anomaly detection using convolutional neural networks (CNN). Faster computations are enabled due to the performance efficiency of CNN. For IoT networks, an intrusion detection model based on anomaly detection is designed and developed in this paper. A multiclass classification framework is created initially using a CNN model. Further, 3D CNN is used for implementation of the proposed model. Various intrusion detection datasets from IoT networks are used for validation of the proposed CNN model. Pre-trained multiclass CNN model is used for implementation of multiclass and binary classification based on transfer learning. When compared to the conventional deep learning models, the proposed multiclass and binary classification framework has attained improved F1 score, recall, precision and accuracy.

A comparative analysis of various machine learning methods for anomaly detection in cyber attacks on IoT networks

Herein, an Internet of Things (IoT) system with remote reconfigurable wireless sensor network (WSN) nodes is presented and its application to measure group work activity in a classroom is discussed. This IoT system consists of wiki pages, bots, (defined as remotely controlled devices), gateways, and remotely reconfigurable WSN Nodes. The bots/gateways and WSN nodes of the IoT system are controlled by scripts written on wiki pages that are read by the bot/gateways, which then forward the commands contained in the scripts to the WSN nodes. Each WSN node then executes the commands, obtains the resulting sensor values, and then returns those values to the bot/gateways. The bot/gateways relay the values and write them onto the wiki page. Each WSN node is flexible and reconfigurable because its behavior can be changed by the script commands written onto the wiki page. Using this IoT system, we created a measurement system to evaluate activity levels of group work in a classroom. After developing the measurement system, we found it was possible to adjust the sampling rate for obtaining sensor values simply by rewriting the script on the wiki page without directly manipulating the WSN.

Groundwater is a primary source of drinking water for billions worldwide. It plays a crucial role in irrigation, domestic, and industrial uses, and significantly contributes to drought resilience in various regions. However, excessive groundwater discharge has left many areas vulnerable to potable water shortages. Therefore, assessing groundwater potential zones (GWPZ) is essential for implementing sustainable management practices to ensure the availability of groundwater for present and future generations. This study aims to delineate areas with high groundwater potential in the Bankura district of West Bengal using four machine learning methods: Random Forest (RF), Adaptive Boosting (AdaBoost), Extreme Gradient Boosting (XGBoost), and Voting Ensemble (VE). The models used 161 data points, comprising 70% of the training dataset, to identify significant correlations between the presence and absence of groundwater in the region. Among the methods, Random Forest (RF) and Extreme Gradient Boosting (XGBoost) proved to be the most effective in mapping groundwater potential, suggesting their applicability in other regions with similar hydrogeological conditions. The performance metrics for RF are very good with a precision of 0.919, recall of 0.971, F1-score of 0.944, and accuracy of 0.943. This indicates a strong capability to accurately predict groundwater zones with minimal false positives and negatives. Adaptive Boosting (AdaBoost) demonstrated comparable performance across all metrics (precision: 0.919, recall: 0.971, F1-score: 0.944, accuracy: 0.943), highlighting its effectiveness in predicting groundwater potential areas accurately; whereas, Extreme Gradient Boosting (XGBoost) outperformed the other models slightly, with higher values in all metrics: precision (0.944), recall (0.971), F1-score (0.958), and accuracy (0.957), suggesting a more refined model performance. The Voting Ensemble (VE) approach also showed enhanced performance, mirroring XGBoost's metrics (precision: 0.944, recall: 0.971, F1-score: 0.958, accuracy: 0.957). This indicates that combining the strengths of individual models leads to better predictions. The groundwater potentiality zoning across the Bankura district varied significantly, with areas of very low potentiality accounting for 41.81% and very high potentiality at 24.35%. The uncertainty in predictions ranged from 0.0 to 0.75 across the study area, reflecting the variability in groundwater availability and the need for targeted management strategies.In summary, this study highlights the critical need for assessing and managing groundwater resources effectively using advanced machine learning techniques. The findings provide a foundation for better groundwater management practices, ensuring sustainable use and conservation in Bankura district and beyond.

The Internet of Things (IoT) has recently received considerable interest due to the development of smart technologies in today’s interconnected world. With the rapid advancement in Internet technologies and the proliferation of IoT sensors, myriad systems and applications generate data of a massive volume, variety and velocity which traditional databases and systems are unable to manage effectively. Many organizations need to deal with these massive datasets that encounter different types of data (e.g., IoT streaming data, static data) in different formats (e.g., structured, semi-structured) coming from multiple sources. Several data integration mechanisms have been designed to process mostly static data. Unfortunately, these techniques are not able to deal with and integrate IoT streaming datasets from multiple sources. In this paper, we identify the challenges of IoT Streaming Data Integration (ISDI) and present a formal approach for the real-time integration of such IoT streaming datasets. We address one of the important issues of timing conflict/alignment among streaming data coming from multiple sources. A generic window-based ISDI approach is proposed to deal with IoT data in different formats and algorithms are developed to integrate IoT streaming data from multiple sources. In particular, we extend the basic windowing algorithm for real-time data integration and to deal with the timing alignment issue. We also introduce a de-duplication algorithm to deal with data redundancy and to demonstrate the useful fragments of the integrated data. We conduct several sets of experiments and quantify the performance of our proposed window-based approach. In particular, we compare our local experimental results with a real setup for streaming data, using Apache Spark. The results of the experiments, which are performed on several IoT datasets, show the efficiency of our proposed solution in terms of processing time. The results are also used to provide an integrated data view to the users.

A survey of trust computation models for service management in internet of things systems

Privacy preservation in blockchain based IoT systems: Integration issues, prospects, challenges, and future research directions

LoRaWAN based internet of things (IoT) system for precision irrigation in plasticulture fresh-market tomato

Advanced digital signatures for preserving privacy and trust management in hierarchical heterogeneous IoT: Taxonomy, capabilities, and objectives