- Research Article
34
- 10.1016/j.adhoc.2023.103348
A review of on-device machine learning for IoT: An energy perspective
- Nov 10, 2023
- Ad Hoc Networks
- Nazli Tekin + 4 more +4
A review of on-device machine learning for IoT: An energy perspective
Internet of Things (IoT) is defined as the connection between places and physical objects (i.e., things) over the internet/network via smart computing devices. IoT is a rapidly emerging paradigm that now encompasses almost every aspect of our modern life. As such, it is crucial to ensure IoT devices follow strict security requirements. At the same time, the prevalence of IoT devices offers developers a chance to design and develop Machine Learning (ML)-based intelligent software systems using their IoT devices. However, given the diversity of IoT devices, IoT developers may find it challenging to introduce appropriate security and ML techniques into their devices. Traditionally, we learn about the IoT ecosystem/problems by conducting surveys of IoT developers/practitioners. Another way to learn is by analyzing IoT developer discussions in popular online developer forums like Stack Overflow (SO). However, we are aware of no such studies that focused on IoT developers’ security and ML-related discussions in SO. This paper offers the results of preliminary study of IoT developer discussions in SO. First, we collect around 53K IoT posts (questions + accepted answers) from SO. Second, we tokenize each post into sentences. Third, we automatically identify sentences containing security and ML-related discussions. We find around 12% of sentences contain security discussions, while around 0.12% sentences contain ML-related discussions. There is no overlap between security and ML-related discussions, i.e., IoT developers discussing security requirements did not discuss ML requirements and vice versa. We find that IoT developers discussing security issues frequently inquired about how the shared data can be stored, shared, and transferred securely across IoT devices and users. We also find that IoT developers are interested to adopt deep neural network-based ML models into their IoT devices, but they find it challenging to accommodate those into their resource-constrained IoT devices. Our findings offer implications for IoT vendors and researchers to develop and design novel techniques for improved security and ML adoption into IoT devices.
A review of on-device machine learning for IoT: An energy perspective
A review of on-device machine learning for IoT: An energy perspective
Integrating IoT with machine learning: A path towards ubiquitous smart applications
The integration of the Internet of Things (IoT) with Machine Learning (ML) is a transformative advancement that is revolutionizing the way data-driven decision-making occurs across various industries. IoT systems comprise interconnected devices that collect and transmit vast amounts of real-time data from sensors, machines, and appliances. However, merely collecting data is not sufficient; the real value lies in the analysis and interpretation of this data to generate actionable insights. This is where ML comes into play. ML techniques allow systems to learn from the data generated by IoT devices, enabling predictive analysis, automation, and enhanced decision-making processes. This integration of IoT and ML is paving the way for smarter, more efficient systems that can be applied in a wide array of fields such as healthcare, manufacturing, transportation, home automation, and smart cities. For instance, in healthcare, wearable IoT devices track vital health statistics like heart rate and blood pressure, while ML algorithms process these data in real-time to detect anomalies, predict potential health risks, and provide healthcare professionals with alerts for timely interventions. Similarly, in manufacturing, IoT devices collect sensor data from machines, which is analyzed by ML algorithms to predict maintenance needs, preventing costly breakdowns and improving operational efficiency. The sheer scale and complexity of data produced by IoT devices pose significant challenges for traditional data processing methods. ML algorithms are essential for managing and extracting value from this data, as they can handle large datasets, identify patterns, and make predictions in a scalable manner. By utilizing ML models such as deep learning, reinforcement learning, and clustering techniques, IoT systems are capable of adapting to changing environments, learning from their surroundings, and making intelligent decisions without human intervention. This paper will review the various ways ML can be leveraged within IoT systems to provide scalable, intelligent decision-making processes for analyzing the vast amounts of data produced by IoT devices. It will examine key use cases across different sectors where the integration of ML and IoT has shown significant promise. Specific case studies will be highlighted, including healthcare, where ML models enhance the monitoring and prediction of patient health; industrial IoT (IIoT), where predictive maintenance and anomaly detection improve operational efficiency; and smart cities, where ML-optimized IoT systems are used to manage traffic flow, energy consumption, and public services. By exploring these case studies, this paper aims to demonstrate the immense potential of integrating IoT with ML. It will also examine the challenges that arise in implementing such systems, including issues of scalability, data privacy, and security, and discuss potential solutions to these challenges. The paper will conclude with insights into the future of IoT-ML integration and how these technologies can continue to evolve to create even more intelligent, autonomous, and efficient systems across a broad range of industries.
Read moreMalware Detection and Classification Framework for IOT Devices
Internet of Things (IoT) technology provides the basic infrastructure for a hyper connected society where all things are connected and exchange information through the Internet. IoT technology is fused with 5G and artificial intelligence (AI) technologies for use various fields such as the smart city and smart factory. As the demand for IoT technology increases, security threats against IoT infrastructure, applications, and devices have also increased. A variety of studies have been conducted on the detection of IoT malware to avoid the threats posed by malicious code. While existing models may accurately detect malicious IoT code identified through static analysis, detecting the new and variant IoT malware quickly being generated may become challenging. Due to the complexity of design and implementation in both hardware and software, as well as the lack of security functions and abilities, IoT devices are becoming an attractive target for cyber criminals who take advantage of weak authentication, outdated firmware’s , and malwares to compromise IoT devices .This project provides the light on the system named as malware classification and detection of IOT devices, used to detect the cyber-attacks caused by malware on IOT devices by using machine learning techniques. The malware classification and detection system detect and identifies the various types of malwares using static analysis with the help of machine learning algorithm. An easy-to-use user interface for easy uploading of files and checking for virus is designed. Also, acceptance testing is performed on the application to remove vulnerabilities.
Read morePromoting Information Privacy Protection Awareness for Internet of Things (IoT)
The Internet of Things (IoT) has had a considerable influence on our daily lives by enabling enhanced connection of devices, systems, and services that extends beyond machine-to-machine interactions and encompasses a wide range of protocols, domains, and applications. However, despite privacy concerns shown by IoT users, little has been done to reduce and protect individual information exposure. It is extremely difficult to mitigate IoT devices from reidentification threats which is why it is still a major challenge for IoT users to securely protect their information. The trust controls how we regulate privacy in our IoT platforms in the same way that it governs personal relationships. As IoT devices become increasingly linked, more data is shared across individuals, businesses, governments, and ecosystems. Technologies, sensors, machines, data, and cloud connections all rely largely on trust relationships that have been formed. With the rapid growth of additional types of IoT devices that are being introduced, it, therefore, expands privacy concerns and is difficult to develop trust with an IoT system or device without the option to regulate information privacy settings. Privacy has always been a barrier for many devices as they race for the early adoption of IoT technologies. Several Internet of Things devices or systems will continue to pose privacy threats. As a result, the main objective of this study was to examine the individual understanding of privacy and to promote information privacy protection awareness not only to IoT users but also to organizations that use IoT devices or platforms to run their day-to-day business operations. Furthermore, the objective extends to compare user knowledge and concerns about IoT privacy, as well as to identify any common attitudes and variances. However, in terms of enhancing individuals’ knowledge, an artifact was developed to educate and enhance information privacy awareness among IoT users. A pre- and postquestionnaire was generated to test and validate user knowledge regarding information privacy protection in IoT. The study was conducted using a quantitative research method. Findings indicate that IoT users’ awareness of information privacy protection turned out to be average, suggesting a need for education and awareness. Several participants stated that information privacy protection awareness is required within the community to educate, raise awareness, eliminate human error, and enable individuals to be conscious of their privacy when surfing the Internet.
Read moreTabdoc Approach: An Information Fusion Method to Implement Semantic Interoperability Between IoT Devices and Users
Services generated by various Internet of Things (IoT) devices are in heterogeneous contexts, hindering users from efficient consumption of those services and hence development of IoT. This paper addresses the problems in user-device interaction. A user-device interoperability framework, Tabdoc approach, is hereby established to implement semantic interoperability between IoT devices and users. In this approach, a divide-and-conquer strategy is used; a semantic document representation method for message modeling is devised to guarantee consistent message understanding among different contexts, and a semantic extraction algorithm and a semantic interpretation algorithm are proposed to implement automatic cross-context message processing. The experimental results show promising performance improvements over state-of-the-art methods.
Read moreEffectiveness of Transformer Models on IoT Security Detection in StackOverflow Discussions
The Internet of Things (IoT) is an emerging concept that directly links to the billions of physical items, or “things” that are connected to the Internet and are all gathering and exchanging information between devices and systems. However, IoT devices were not built with security in mind, which might lead to security vulnerabilities in a multi-device system. Traditionally, we investigated IoT issues by polling IoT developers and specialists. This technique, however, is not scalable since surveying all IoT developers is not feasible. Another way to look into IoT issues is to look at IoT developer discussions on major online development forums like Stack Overflow (SO). However, finding discussions that are relevant to IoT issues is challenging since they are frequently not categorized with IoT-related terms. In this paper, we present the “IoT Security Dataset”, a domain-specific dataset of 7147 samples focused solely on IoT security discussions. As there are no automated tools to label these samples, we manually labeled them. We further employed multiple transformer models to automatically detect security discussions. Through rigorous investigations, we found that IoT security discussions are different and more complex than traditional security discussions. We demonstrated a considerable performance loss (up to 44%) of transformer models on cross-domain datasets when we transferred knowledge from a general-purpose dataset “Opiner”, supporting our claim. Thus, we built a domain-specific IoT security detector with an F1-Score of 0.69. We have made the dataset public in the hope that developers would learn more about the security discussion and vendors would enhance their concerns about product security. The dataset can be found at— https://anonymous.4open.science/r/IoT-Security-Dataset-8E35 .
Read moreExploring lightweight machine learning models for personal internet of things (IOT) device security
The proliferation of Internet of Things (IoT) devices in personal and household environments has led to a significant increase in security vulnerabilities. These devices, due to their limited computational resources, often struggle to support conventional security solutions, making them prime targets for cyberattacks. This paper explores the potential of lightweight machine learning (ML) models to enhance the security of personal IoT devices. By leveraging the power of AI, lightweight models can offer real-time threat detection and anomaly identification without compromising the device's performance or requiring extensive computational resources. The paper investigates various ML techniques that are well-suited for IoT environments, such as decision trees, k-nearest neighbours (KNN), and support vector machines (SVM), focusing on their ability to detect intrusions, unauthorized access, and other malicious activities while maintaining efficiency. Additionally, the study highlights the trade-offs between model complexity, accuracy, and resource consumption, offering practical insights for deploying ML solutions in resource-constrained IoT systems. Key challenges, including data privacy, model generalization, and the adaptability of models to diverse IoT ecosystems, are addressed. Finally, the paper discusses future directions for the integration of more advanced lightweight models, such as federated learning and edge computing, which could further enhance security capabilities while ensuring minimal impact on IoT device performance. Through this review, the paper advocates for the adoption of lightweight ML models as a feasible and scalable solution to securing personal IoT devices in an increasingly connected world.
Read moreIntelligent Detection of IoT Botnets Using Machine Learning and Deep Learning
As the number of Internet of Things (IoT) devices connected to the network rapidly increases, network attacks such as flooding and Denial of Service (DoS) are also increasing. These attacks cause network disruption and denial of service to IoT devices. However, a large number of heterogenous devices deployed in the IoT environment make it difficult to detect IoT attacks using traditional rule-based security solutions. It is challenging to develop optimal security models for each type of the device. Machine learning (ML) is an alternative technique that allows one to develop optimal security models based on empirical data from each device. We employ the ML technique for IoT attack detection. We focus on botnet attacks targeting various IoT devices and develop ML-based models for each type of device. We use the N-BaIoT dataset generated by injecting botnet attacks (Bashlite and Mirai) into various types of IoT devices, including a Doorbell, Baby Monitor, Security Camera, and Webcam. We develop a botnet detection model for each device using numerous ML models, including deep learning (DL) models. We then analyze the effective models with a high detection F1-score by carrying out multiclass classification, as well as binary classification, for each model.
Read moreA survey on IoT platforms: Communication, security, and privacy perspectives
A survey on IoT platforms: Communication, security, and privacy perspectives
A REVIEW OF SECURING INTERNET OF THINGS (IOT) WITH MACHINE LEARNING
The Internet of Things (IoT) has revolutionized the way we interact with the physical world, embedding everyday objects with sensors and connectivity to enhance efficiency and convenience. However, the rapid proliferation of IoT devices has raised significant concerns regarding security and privacy. Traditional security mechanisms often fall short in addressing the dynamic and diverse nature of IoT ecosystems. This paper explores the paradigm shift towards securing IoT through the integration of Machine Learning (ML) techniques. This research delves into the innovative fusion of IoT and ML, presenting a comprehensive analysis of how machine learning algorithms can fortify the security infrastructure of IoT networks. By leveraging ML algorithms, IoT systems can detect and respond to evolving cyber threats in real-time. This proactive approach enhances anomaly detection, intrusion prevention, and incident response capabilities, mitigating potential risks before they escalate. The study discusses various ML models such as deep learning, clustering, and reinforcement learning, elucidating their applications in IoT security. Deep learning algorithms, particularly Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), are examined for their prowess in analyzing intricate patterns within large datasets, ensuring the integrity of IoT data transmission. Additionally, clustering algorithms are explored for their efficiency in grouping similar IoT devices, enabling the implementation of tailored security protocols for specific device clusters. Reinforcement learning techniques are also investigated to optimize security strategies dynamically, adapting to evolving threats in real-time. Furthermore, the paper sheds light on the challenges and opportunities in the integration of ML with IoT security. Ethical considerations, data privacy, and the energy efficiency of ML algorithms are discussed in the context of resource-constrained IoT devices. The research also explores the potential of federated learning, enabling collaborative ML model training across distributed IoT networks without compromising data privacy.
Read moreLow-overhead Hardware Supervision for Securing an IoT Bluetooth-enabled Device: Monitoring Radio Frequency and Supply Voltage
Over the past decade, the number of Internet of Things (IoT) devices increased tremendously. In particular, the Internet of Medical Things (IoMT) and the Industrial Internet of Things (IIoT) expanded dramatically. Resource restrictions on IoT devices and the insufficiency of software security solutions raise the need for smart Hardware-Assisted Security (HAS) solutions. These solutions target one or more of the three C’s of IoT devices: Communication, Control, and Computation. Communication is an essential technology in the development of IoT. Bluetooth is a widely-used wireless communication protocol in small portable devices due to its low energy consumption and high transfer rates. In this work, we propose a supervisory framework to monitor and verify the operation of a Bluetooth system-on-chip (SoC) in real-time. To verify the operation of the Bluetooth SoC, we classify its transmission state in real-time to ensure a secure connection. Our overall classification accuracy is measured as 98.7%. We study both power supply current (IVDD) and RF domains to maximize the classification performance and minimize the overhead of our proposed supervisory system.
Read moreA Large-Scale Study of IoT Security Weaknesses and Vulnerabilities in the Wild
Internet of Things (IoT) is defined as the connection between places and physical objects (i.e., things) over the internet/network via smart computing devices. IoT is a rapidly emerging paradigm that now encompasses almost every aspect of our modern life. As these devices differ from traditional computing, it is important to understand the challenges IoT developers face while implementing proper security measures in their IoT devices. We observed that IoT software developers share solutions to programming questions as code examples on three Stack Exchange Q & A sites: Stack Overflow (SO), Arduino, and Raspberry Pi. Previous research studies found vulnerabilities/weaknesses in C/C++ code examples shared in SO. However, the studies did not investigate C/C++ code examples related to IoT. The studies investigated SO code examples only. In this article, we conduct a large-scale empirical study of all IoT C/C++ code examples shared in the three Stack Exchange sites, i.e., SO, Arduino, and Raspberry Pi. From the 11,329 obtained code snippets from the three sites, we identify 29 distinct Common Weakness Enumeration (CWE) types in 609 snippets. These CWE types can be categorized into eight general weakness categories, and we observe that evaluation, memory, and initialization-related weaknesses are the most common to be introduced by users when posting programming solutions. Furthermore, we find that 39.58% of the vulnerable code snippets contain instances of CWE types that can be mapped to real-world occurrences of those CWE types (i.e., CVE instances). The most number vulnerable IoT code examples was found in Arduino, followed by SO, and Raspberry Pi. Memory type vulnerabilities are on the rise in the sites. For example, from the 3,595 mapped CVE instances, we find that 28.99% result in Denial of Service (DoS) errors, which is particularly harmful for network reliant IoT devices such as smart cars. Our study results can guide various IoT stakeholders to be aware of such vulnerable IoT code examples and to inform IoT researchers during their development of tools that can help prevent developers the sharing of such vulnerable code examples in the sites.
Read moreInformation management for trust computation on resource-constrained IoT devices
Resource-constrained Internet of Things (IoT) devices are executing increasingly sophisticated applications that may require computational or memory intensive tasks to be executed. Due to their resource constraints, IoT devices may be unable to compute these tasks and will offload them to more powerful resource-rich edge nodes. However, as edge nodes may not necessarily behave as expected, an IoT device needs to be able to select which edge node should execute its tasks. This selection problem can be addressed by using a measure of behavioural trust of the edge nodes delivering a correct response, based on historical information about past interactions with edge nodes that are stored in memory. However, due to their constrained memory capacity, IoT devices will only be able to store a limited amount of trust information, thereby requiring an eviction strategy when its memory is full of which there has been limited investigation in the literature. To address this, we develop the concept of the memory profile of an agent and that profile’s utility. We formalise the profile eviction problem in a unified profile memory model and show it is NP-complete. To circumvent the inherent complexity, we study the performance of eviction algorithms in a partitioned profile memory model using our utility metric. Our results show that localised eviction strategies which only consider one specific type of information do not perform well. Thus we propose a novel eviction strategy that globally considers all types of trust information stored and we show that it outperforms local eviction strategies for the majority of memory sizes and agent behaviours. In this paper, we develop a concept of information utility to a trust model and formalise the problem of information eviction, which we prove to be NP-complete. We then investigate the usefulness of different eviction strategies to maximise the utility of information stored to enable trust-based task offloading.
Read moreМЕТОДИ ФУНКЦІОНУВАННЯ ПРИСТРОЇВ IOT З ВИКОРИСТАННЯМ МАШИННОГО НАВЧАННЯ
Актуальність. Функціонування пристроїв Інтернету речей (IoT) з використанням методів машинного навчання (МН) відкриває безліч нових можливостей та переваг. Ці технології дозволяють розширити функціональні можливості традиційних пристроїв, надаючи їм здатність до самонавчання та адаптації до змінюваних умов середовища або поведінки користувачів. IoT пристрої збирають величезні обсяги даних з різних джерел, таких як датчики температури, вологості, руху тощо. МН дозволяє аналізувати ці дані, визначаючи закономірності та тенденції. Використовуючи історичні дані, алгоритми МН можуть передбачати майбутні стани системи або поведінку користувачів, дозволяючи оптимізувати роботу пристроїв. Застосування МН дозволяє IoT пристроям самостійно управляти своїми функціями, наприклад, регулювати освітлення або температуру в будинку, виходячи зі звичок користувачів. Алгоритми можуть аналізувати споживання електроенергії або води і оптимізувати їх використання, зменшуючи витрати та вплив на навколишнє середовище. МН також може допомогти виявити незвичну поведінку або спроби несанкціонованого доступу до системи, підвищуючи рівень безпеки. Здатність до анонімізації та захисту даних, що обробляються IoT пристроями, є критичною, особливо в контексті зростаючих занепокоєнь щодо приватності. Таким чином, використання МН в IoT розкриває потенціал для створення інноваційних рішень, які роблять наше життя зручнішим, безпечнішим та ефективнішим, що і робить тему досліджень в цій області актуальною. Метою даної роботи є аналіз методів функціонування пристроїв IoT. Об’єктом дослідження є методи збору, обробки та передачі даних в обчислювальних вузлах IoT. Предметом дослідження є керування обчислювальними вузлами IoT за допомогою машинного навчання. Результати. Проведено аналіз методів функціонування пристроїв IoT. Застосування методів зменшення затримки передачі сигналів вимагає врахування специфіки конкретної IoT системи, включаючи вимоги до затримки, типи даних, обчислювальні та мережеві ресурси, а також потреби користувачів або процесів, які вона обслуговує. При використанні методів зниження обсягу даних, що передаються, слід брати до уваги те, що вони вимагають ретельного планування та налаштування системи IoT, враховуючи специфіку застосування, типи даних та комунікаційні мережі. Це допоможе забезпечити оптимальне використання ресурсів, підвищення масштабованості та зниження вартості експлуатації IoT систем. Впровадження методів конфеденційності та безпеки даних вимагає комплексного підходу до безпеки на всіх етапах життєвого циклу IoT системи, від розробки та виробництва до експлуатації та зняття з експлуатації пристроїв. Основними викликами у зборі та аналізі даних в IoT є забезпечення безпеки та конфіденційності даних, обробка великих обсягів даних в реальному часі, а також потреба в ефективних методах МН, здатних адаптуватися до динамічних умов і змінних середовищ. Інтеграція передових технологій МН в IoT відкриває широкі можливості для створення більш інтелектуальних, ефективних та автономних систем, які можуть революціонізувати багато сфер життя, від розумних будинків до індустріального Інтернету речей.
Read morePCANN: Distributed ANN Architecture for Image Recognition in Resource-Constrained IoT Devices
As deployment of Internet of Things (IoT) devices gain momentum, there is an increased interest in implementing machine learning (ML) algorithms on IoT devices. Most of the existing ML solutions, however, rely on a central server to execute data-intensive ML models, because most devices in IoT systems do not have sufficient storage and computing resources. This paper presents a distributed Artificial Neural Networks (ANN) architecture, called PCANN, which allows execution of a complex image recognition task on a collection of resource-constrained IoT devices. Our solution separates a single ML model into multiple small modules that are executed by the distributed IoT devices. The solution effectively reduces storage and computing requirements for individual devices to store and process ML model. We design multiple PCANN models and utilize the models for human posture recognition as the case study. The experimental results show that the distributed PCANN architecture achieves comparable accuracy as the classical ANN model, while the average size of each PCANN module is largely reduced.
Read more