Performance Improvement IoT Applications Through Multimedia Analytics Using Big Data Stream Computing Platforms

The rapid innovations in technologies endorsed the emergence of sensory equipment's connection to the Internet for acquiring data from the environment. The increased number of devices generates the enormous amount of sensor data from diversified applications of Internet of things (IoT). The generation of data may be a fast or real-time data stream which depends on the nature of applications. Applying analytics and intelligent processing over the data streams discovers the useful information and predicts the insights. Decision-making is a prominent process which makes the IoT paradigm qualified. This chapter provides an overview of architecting IoT-based healthcare systems with different machine learning algorithms. This chapter elaborates the smart data characteristics and design considerations for efficient adoption of machine learning algorithms into IoT applications. In addition, various existing and hybrid classification algorithms are applied to sensory data for identifying falls from other daily activities.

Knowledge-infused and consistent Complex Event Processing over real-time and persistent streams

A number of technologies enabled by Internet of Thing (IoT) have been used for the prevention of various chronic diseases, continuous and real-time tracking system is a particularly important one. Wearable medical devices with sensor, health cloud and mobile applications have continuously generating a huge amount of data which is often called as streaming big data. Due to the higher speed of the data generation, it is difficult to collect, process and analyze such massive data in real-time in order to perform real-time actions in case of emergencies and extracting hidden value. using traditional methods which are limited and time-consuming. Therefore, there is a significant need to real-time big data stream processing to ensure an effective and scalable solution. In order to overcome this issue, this work proposes a new architecture for real-time health status prediction and analytics system using big data technologies. The system focus on applying distributed machine learning model on streaming health data events ingested to Spark streaming through Kafka topics. Firstly, we transform the standard decision tree (DT) (C4.5) algorithm into a parallel, distributed, scalable and fast DT using Spark instead of Hadoop MapReduce which becomes limited for real-time computing. Secondly, this model is applied to streaming data coming from distributed sources of various diseases to predict health status. Based on several input attributes, the system predicts health status, send an alert message to care providers and store the details in a distributed database to perform health data analytics and stream reporting. We measure the performance of Spark DT against traditional machine learning tools including Weka. Finally, performance evaluation parameters such as throughput and execution time are calculated to show the effectiveness of the proposed architecture. The experimental results show that the proposed system is able to effectively process and predict real-time and massive amount of medical data enabled by IoT from distributed and various diseases.

Evolution of the Internet of Things (IoT) makes a revolution in connecting, monitoring, controlling, and managing things, objects, and almost surroundings through the Internet. To reveal the potential of IoT, rich knowledge has to be extracted, indexed, and shared securely in real time. Recent comprehensive researches on IoT spot the light on main correlative challenges, such as security, scalability, heterogeneity, and big data. Due to the heterogeneity of IoT applications that produce a large volume of a variety of data streams in real time, mining, securing, and analyzing IoT data become tedious and challenging tasks. Indexing sensory data is one of data mining techniques, which ease information retrieval. But ordinary indexing methods are not fit with such massive and dynamic data; where indexes become out-of-date once they are built. Clustering, data reduction, and summarization present promising solutions for enabling low-power security and balanced indexing. This article presents a novel method for dynamic data reduction and summarization using dynamic time warping (DTW), which also presents a balanced architecture for enabling balanced indexing based on similarity data fusion. Data reduction-based prediction models enable real-time search and secure discovery for Smart Things (SThs). The results of the proposed model were proved using real examples and data sets. Using the Szeged-weather data set similar SThs data is reduced by 95%. Thus, indexes sizes could be reduced, and using smart scheduling, crawling cycle length could be expanded.

A Novel Edge Computing Architecture Based on Adaptive Stratified Sampling

The advent of the Internet of Things (IoT) has ushered in a transformative era in supply chain management, revolutionizing the way organizations monitor, analyze, and optimize their operations. This comprehensive survey paper explores the multifaceted landscape of IoT applications in supply chain management, shedding light on the challenges, opportunities, and best practices that define this technological paradigm shift. The paper delves into the fundamental principles of IoT, elucidating how sensor-laden devices, real-time data streams, and advanced analytics empower organizations with unprecedented visibility and control across their supply chains. It systematically examines IoT applications in key supply chain domains, including inventory management, asset tracking, cold chain monitoring, predictive maintenance, route optimization, and waste reduction. Each application is scrutinized for its role in enhancing efficiency, reducing costs, ensuring product quality, and advancing sustainability. Furthermore, this paper addresses the challenges inherent in implementing IoT within supply chains, such as data security, interoperability, scalability, and regulatory compliance. It underscores the importance of change management and workforce development in harnessing the full potential of IoT and presents a roadmap for best practices to overcome these obstacles. The paper culminates in a forward-looking exploration of future trends and innovations in the IoT-driven supply chain landscape. By offering a comprehensive overview of IoT's role in supply chain management, this paper equips practitioners, researchers, and decision-makers with a holistic understanding of the transformative power of IoT, empowering them to navigate the complexities, seize opportunities, and implement best practices that will define the future of supply chain management.

As a major agricultural province in China, Shandong Province has always played an important role. At the same time, it is also closely related to the strong support of science and technology. As a new technology, the Internet of things (IoT) has made positive contributions. Agricultural IoT is a mode that uses information technology, wireless communication technology and radio frequency automatic identification technology to share the identified agricultural information to the network. The application of agricultural IoT is a major change in agricultural development, which provides convenient conditions for the development of agriculture, provides a favorable environment for the agricultural products, promotes the transformation of agricultural technology, realizes the informatization of agricultural production, improves the efficiency of rural land, integrates agricultural resources and provides a foundation for food safety. In this paper, the application of IoT in the field of agriculture in Shandong Province is described from two practical cases. One is about how to use wireless sensor network technology to transmit data in the big data platform based on the Bohai granary project. The other describes how to use IoT for food quality and safety traceability. It takes pigs as the research object, runs through all links of the whole industrial chain of pig breeding, breeding, slaughtering, processing, logistics and sales, collects the data of the whole industrial chain with the help of IoT, and realizes the information tracking and traceability of the whole industrial chain. At the end of the paper, it discusses the countermeasures.

Internet of Things (IoT) applications are generally developed in a vertical manner, i.e., each IoT application is developed for a certain scenario which generally does not share data with IoT applications for recommendation services. This leads to an inefficient exploitation of other IoT service applications. In fact, such recommendation services can be achieved with the help of Social IoT (SIoT) by using data generated by various IoT applications. SIoT builds a profile of objects based on IoT applications data that can be exchanged with SIoT network for accessible to other IoT applications. In this manner, the SIoT network provides recommendation services for reusability of IoT applications' data among various IoT applications, as well as adapting IoT services according to users' needs which improve user experience. Additionally, the profiles built by a SIoT network can also help a single IoT application by looking for similar conditions that have been addressed in the past for the same IoT application. We propose a concept for exploiting the SIoT for recommendation services among various IoT applications with the help of a sample application scenario that highlights how the SIoT can help by providing recommendations. We also provide some implementation challenges for this concept.

Distributed Stream Processing Systems (DSPS) like Apache Storm and Spark Streaming enable composition of continuous dataflows that execute persistently over data streams. They are used by Internet of Things (IoT) applications to analyze sensor data from Smart City cyber-infrastructure, and make active utility management decisions. As the ecosystem of such IoT applications that leverage shared urban sensor streams continue to grow, applications will perform duplicate pre-processing and analytics tasks. This offers the opportunity to collaboratively reuse the outputs of overlapping dataflows, thereby improving the resource efficiency. In this paper, we propose dataflow reuse algorithms that given a submitted dataflow, identifies the intersection of reusable tasks and streams from a collection of running dataflows to form a merged dataflow. Similar algorithms to unmerge dataflows when they are removed are also proposed. We implement these algorithms for the popular Apache Storm DSPS, and validate their performance and resource savings for 35 synthetic dataflows based on public OPMW workflows with diverse arrival and departure distributions, and on 21 real IoT dataflows from RIoTBench. We see that our Reuse algorithms reduce the count of running tasks by 38 46% for the two workloads, and a reduction in cumulative CPU usage of 36-51%, that can result in real cost savings on Cloud resources.

Streaming data is widely generated in our lives. This has promoted a lot of research on streaming data mining, such as streaming data clustering and filtering. In our work, we present a problem about data stream processing, namely, streaming data sorting. There are some important characteristics of streaming data. Firstly, streaming data comes in the form of streams. It is usually assumed that streaming data is infinite, so it cannot be stored completely in memory. Secondly, we must process the streaming data in real time, otherwise we may lose the opportunity to deal with it forever. Based on these characteristics, we propose a dynamic algorithm that can make full use of memory and minimize error to solve the problem of streaming data sorting, which is further combined with the BFR algorithm to sort a particular type of streaming data. Some experiments are conducted to confirm the effectiveness of the proposed algorithms.

Recent advances in mobile technologies have enabled a plethora of new applications. The hardware capabilities of mobile devices, however, are still insufficient for real-time stream data processing (e.g., real-time video stream). In order to process real-time streaming data, most existing applications offload the data and computation to a remote cloud service, such as Apache Storm or Apache Spark Streaming. Offloading streaming data, however, has high costs for users, e.g., significant service fees and battery consumption. To address these challenges, we design, implement and evaluate Mobile Storm, the first stream processing platform for mobile clouds, leveraging clusters of local mobile devices to process real-time stream data. In Mobile Storm, we model the workflow of a real-time stream processing job and decompose it into several tasks so that the job can be executed concurrently and in a distributed manner on multiple mobile devices. Mobile Storm was implemented on Android phones and evaluated extensively through a real-time HD video processing application. The result shows that Mobile Storm effectively processes HD Video Stream in a mobile cloud, which would be impossible on a single mobile device.

New challenges have emerged in data mining as the traditional techniques have floundered with real-time data streams. The traditional technique needs refurbishing so as to acclimatize with concept drifting data streams. Thus dealing with the concept changes is the most imperative task of stream data mining. Ensemble classifiers have the ability to automatically adapt with the incoming drifts and, therefore, it is the most interesting research area in data stream mining. Bagging, Boosting and Random forest generation are the common ensemble techniques and are the most popular machine learning approaches in the current scenario for static data (Gomes HM, Bifet A, Read J, Barddal JP, Enembreck F, Pfharinger B, Abdessalem T (2017) Adaptive random forests for evolving data stream classification. Mach Learn 106(9–10):469–1495, [1]). A large number of base classifiers in an ensemble can cause computational overhead. Data mining classifiers for real-time data streams, therefore, need to be updated constantly and retrained with the labeled instances of the newly arrived novel classes in data streams and to cope with concept drift; otherwise, the mining models will become less and less accurate as time passes by. However, for data streams, adaptive random forest algorithms have been widely used for ensemble generation due to its competence to handle different types of drifts. This paper proposes a modified adaptive random forest with meta level learner algorithm and concept adaptive very fast decision tree to overcome the concept drift problem in real-time data streams. The proposed algorithm is experimentally compared with state-of-the-art adaptive random forest algorithm on several real synthetic datasets. Results indicate its efficiency in terms of accuracy and processing time.

One of the most exciting changes in Location-Based Services is the incredible growth of internet, development of wearable devices, and advanced positioning technologies. In addition, the big data from those sources helps performing seamless LBS as a technology. The existing processing methods used to detect the location of a particular tag, or specific device are not enough for complex processing while collecting all of the streaming data at the same time using a variety of wireless communication system [10,11,12,13]. We can use big data processing method for processing all the streaming data in real time. In this paper, we propose a framework for improving performance of Seamless LBS using NoSQL technology.

The rapid growth of data streams, propelled by the proliferation of sensors and Internet of Things (IoT) devices, presents significant challenges for real-time clustering of high-dimensional data. Traditional clustering algorithms struggle with high dimensionality, memory and time constraints, and adapting to dynamically evolving data. Existing dimensionality reduction methods often neglect feature ranking, leading to suboptimal clustering performance. To address these issues, we introduce E-Stream, a novel entropy-based clustering algorithm for high-dimensional data streams. E-Stream performs real-time feature ranking based on entropy within a sliding time window to identify the most informative features, which are then utilized with the DenStream algorithm for efficient clustering. We evaluated E-Stream using the NSL-KDD dataset, comparing it against DenStream, CluStream, and MR-Stream. The evaluation metrics included the average F-Measure, Jaccard Index, Fowlkes-Mallows Index, Purity, and Rand Index. The results show that E-Stream outperformed the baseline algorithms in both clustering accuracy and computational efficiency while effectively reducing dimensionality. E-Stream also demonstrated significantly less memory consumption and fewer computational requirements, highlighting its suitability for real-time processing of high-dimensional data streams. Despite its strengths, E-Stream requires manual parameter adjustment and assumes a consistent number of active features, which may limit its adaptability to diverse datasets. Future work will focus on developing a fully autonomous, parameter-free version of the algorithm, incorporating mechanisms to handle missing features and improving the management of evolving clusters to enhance robustness and adaptability in dynamic IoT environments.

This paper presents an integrated approach to real-time processing and analysis of large-scale data streams using artificial intelligence methods, multi-agent systems, and multi-layered control architectures. Particular attention is devoted to combining technologies that are traditionally applied separately: unmanned aerial vehicle (UAV) control systems, situational centers, streaming video services, and distributed sensor networks. The proposed model accounts for the stochastic nature of the environment, the dynamic behaviour of data flows, and resource constraints, which are critical factors for real-time systems. The study develops a multi-level multi-agent architecture that includes central, regional, and edge nodes, as well as local agents such as drones, sensors, and client-side video devices. A mathematical formalization of agent interaction and reward functions is proposed to ensure a balance between service quality, latency, packet loss, and energy consumption. The use of multi-agent reinforcement learning (MARL) algorithms is introduced to support adaptive decision-making in real time, along with the development of a digital twin of the environment for predicting future system states using deep and generative models. The results demonstrate that the integration of edge computing, hierarchical decision-making, and local agent autonomy significantly enhances system resilience, provides stable performance under external disturbances, and enables effective infrastructure scaling. The findings form a scientific foundation for designing adaptive, robust, and self-learning next-generation digital ecosystems capable of intelligent processing of large data streams in real time