- Research Article
7
- 10.1002/cpe.4517
Cloud computing and big data: Technologies and applications
- May 20, 2018
- Concurrency and Computation: Practice and Experience
- Mostapha Zbakh + 3 more +3
Cloud computing and big data: Technologies and applications
In recent years, fog computing has become an important environment for dealing with the Internet of Things. Fog computing was developed to handle large-scale big data by scheduling tasks via cloud computing. Task scheduling is crucial for efficiently handling IoT user requests, thereby improving system performance, cost, and energy consumption across nodes in cloud computing. With the large amount of data and user requests, achieving the optimal solution to the task scheduling problem is challenging, particularly in terms of cost and energy efficiency. In this paper, we develop novel strategies to save energy consumption across nodes in fog computing when users execute tasks through the least-cost paths. Task scheduling is developed using modified artificial ecosystem optimization (AEO), combined with negative swarm operators, Salp Swarm Algorithm (SSA), in order to competitively optimize their capabilities during the exploitation phase of the optimal search process. In addition, the proposed strategy, Enhancement Artificial Ecosystem Optimization Salp Swarm Algorithm (EAEOSSA), attempts to find the most suitable solution. The optimization that combines cost and energy for multi-objective task scheduling optimization problems. The backpack problem is also added to improve both cost and energy in the iFogSim implementation as well. A comparison was made between the proposed strategy and other strategies in terms of time, cost, energy, and productivity. Experimental results showed that the proposed strategy improved energy consumption, cost, and time over other algorithms. Simulation results demonstrate that the proposed algorithm increases the average cost, average energy consumption, and mean service time in most scenarios, with average reductions of up to 21.15% in cost and 25.8% in energy consumption.
Cloud computing and big data: Technologies and applications
Cloud computing and big data: Technologies and applications
Task Scheduling in Cloud Using Deep Reinforcement Learning
Task Scheduling in Cloud Using Deep Reinforcement Learning
An energy-efficient task scheduling algorithm for heterogeneous cloud computing systems
The massive growth of cloud computing leads to huge amounts of energy consumption and release of carbon footprints as data centers are housed by a large number of servers. Consequently, the cloud service providers are looking for eco-friendly solutions to reduce energy consumption and carbon emissions. As a result, task scheduling has drawn attention, in which efficient resource utilization and minimum energy consumption take into great consideration. This is an exigent issue, especially for the heterogeneous environment. In this work, we put forward an energy-efficient task scheduling algorithm (ETSA) to address the demerits associated with task consolidation and scheduling. The proposed algorithm ETSA takes into account the completion time and total utilization of a task on the resources, and follows a normalization procedure to make a scheduling decision. We evaluate the proposed algorithm ETSA to measure energy efficiency and makespan in the heterogeneous environment. The experimental results are compared with recent algorithms, namely random, round robin, dynamic cloud list scheduling, energy-aware task consolidation, energy-conscious task consolidation and MaxUtil. The proposed algorithm ETSA provides an elegant trade-off between energy efficiency and makespan than the existing algorithms.
Read moreBalancing the Load and Scheduling the Tasks using Zebra Optimizer in IoT based Cloud Computing for Big-data Applications.
Task scheduling is one of the major problems with Internet of Things (IoT) cloud computing. The need for cloud storage has skyrocketed due to recent advancements in IoT-based technology. Sophisticated planning approaches are needed to load the IoT services onto cloud resources professionally while meeting application necessities. This is significant because, in order to optimise resource utilisation and reduce waiting times, several procedures must be properly configured on various virtual machines. Because of the diverse nature of IoT, scheduling various IoT application activities in a cloud-based computing architecture can be challenging. Fog cloud computing is projected for the integration of fog besides cloud networks to address these expectations, given the proliferation of IoT sensors and the requirement for fast and dependable information access. Given the complexity of job scheduling, it can be difficult to determine the best course of action, particularly for big data systems. The behaviour of zebras in the wild serves as the primary basis of stimulus for the development of the Zebra Optimisation Algorithm (ZOA), a novel bio-inspired metaheuristic procedure presented in this study. ZOA mimics zebras' feeding habits and their defence mechanisms against predators. Various activities are analysed and processed using an optimised scheduling model based on ZOA to minimise energy expenditures and end-to-end delay. To reduce makespan and increase resource consumption, the technique uses a multi-objective strategy. By using a regional exploratory search strategy, the optimisation algorithm may better utilise data and stays out of local optimisation ruts. The analysis revealed that the suggested ZOA outperformed other well-known algorithms. It was advantageous for big data task scheduling scenarios since it converged more quickly than other techniques. It also produced improvements of 18.43% in several outcomes, including resource utilisation, energy consumption, and make span.
Read moreScheduling for green cloud load balancing with maximum efficiency
In addition to cutting down on energy use, the green cloud-based service also drastically cuts down on operating expenses. Strongly coupled data centers demand controlled energy, constant performance, and overall optimization of excess energy consumption in order to do considerable calculations, which in turn give entire processing influence from a wide collection of resources. An energy-saving scheduling method is the focus of the research, which makes use of green cloud technologies. In recent years, cloud computing has been integrated into several domains, including computing, research, industry, and business. The need for specialized hardware along with additional resources is rendered obsolete by the provision of many services across the internet through cloud computing. Problems with energy efficiency, resource heterogeneity, and resource usage are only a few of the issues that cloud computing systems encounter. Consolidation approaches like as task scheduling as well as virtual machines (VMs) are used to address these concerns. There has been a plethora of research on task scheduling. Researchers have examined the issue using a variety of metrics and aims. The essay delves into the topic of virtualized cloud data centers' energy usage and effective resource use. Task categorization and thresholds form the basis of the proposed method, which aims to improve resource use and scheduling efficiency. Every company needs a highly efficient structure that is both flexible and homogeneous across all of their cloud environments. This research aims to reduce energy consumption in green cloud systems by using a hybrid scheduling strategy that combines a minimal completion time with a priority-based weighted round-robin. An Artificial Neural Network (ANN) based load balancing method is presented in this study. ANN makes demand predictions and then distributes resources accordingly. This method uses less energy than the cautious over-provisioning strategy since it constantly adjusts the number of active servers based on current demand. In addition, a server that is operating at a high utilization may handle more task with the same amount of power, but it will use more power overall. At last, we take a look at the current state of load balancing in cloud computing and compare it to others using different metrics.
Read moreTask scheduling optimization in heterogeneous cloud computing environments: A hybrid GA-GWO approach
Task scheduling optimization in heterogeneous cloud computing environments: A hybrid GA-GWO approach
A new offloading method in the green mobile cloud computing based on a hybrid meta-heuristic algorithm
A new offloading method in the green mobile cloud computing based on a hybrid meta-heuristic algorithm
Evolutionary Algorithm Based Task Scheduling in IoT Enabled Cloud Environment
Internet of Things (IoT) is transforming the technical setting of conventional systems and finds applicability in smart cities, smart healthcare, smart industry, etc. In addition, the application areas relating to the IoT enabled models are resource-limited and necessitate crisp responses, low latencies, and high bandwidth, which are beyond their abilities. Cloud computing (CC) is treated as a resource-rich solution to the above mentioned challenges. But the intrinsic high latency of CC makes it nonviable. The longer latency degrades the outcome of IoT based smart systems. CC is an emergent dispersed, inexpensive computing pattern with massive assembly of heterogeneous autonomous systems. The effective use of task scheduling minimizes the energy utilization of the cloud infrastructure and rises the income of service providers by the minimization of the processing time of the user job. With this motivation, this paper presents an intelligent Chaotic Artificial Immune Optimization Algorithm for Task Scheduling (CAIOA-RS) in IoT enabled cloud environment. The proposed CAIOA-RS algorithm solves the issue of resource allocation in the IoT enabled cloud environment. It also satisfies the makespan by carrying out the optimum task scheduling process with the distinct strategies of incoming tasks. The design of CAIOA-RS technique incorporates the concept of chaotic maps into the conventional AIOA to enhance its performance. A series of experiments were carried out on the CloudSim platform. The simulation results demonstrate that the CAIOA-RS technique indicates that the proposed model outperforms the original version, as well as other heuristics and metaheuristics.
Read moreEnergy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review
Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review
Energy Optimization Based on Resource Allocation and Task Scheduling in Green Cloud Computing System
With the widespread application of cloud computing technology, the energy consumption problem of data centers is becoming increasingly severe. This research is dedicated to presenting a highly efficient and smart solution for optimizing energy usage in cloud computing systems, especially since effectively managing energy consumption through resource allocation and task scheduling has now become a critical challenge in the field. In view of this, the study first constructs a resource allocation model based on redundant resource recovery to dynamically identify and recover redundant resources. Second, a task scheduling optimization method based on dual deep reinforcement learning is established, which utilizes directed acyclic graphs to model task dependencies and optimizes task execution order and resource allocation strategies through reinforcement learning agents. In the testing of the resource allocation optimization model, when the number of tasks is 500, the redundant resource recovery rate is 87.0%, and the computational complexity is 16.7 s. The response time in the regional resource environment is 2.28 s, and the load adaptability is 95.8%. In the task scheduling method test, the proposed method has a memory occupancy of 85 MB and a scheduling delay of 0.13 s in a high-bandwidth environment of 300 Mbps. The results show that the proposed method outperforms traditional scheduling strategies in terms of resource utilization and energy consumption, and contributes to achieving the goal of green cloud computing. The research aims to provide an efficient and intelligent solution for energy optimization in cloud computing systems.
Read moreAn Energy-aware Real-time Task Scheduling Approach in a Cloud Computing Environment
Interest in cloud computing has grown considerably over recent years, primarily due to scalable virtualized resources. So, cloud computing has contributed to the advancement of real-time applications such as signal processing, environment surveillance and weather forecast where time and energy considerations to perform the tasks are critical. In real-time applications, missing the deadlines for the tasks will cause catastrophic consequences; thus, real-time task scheduling in cloud computing environment is an important and essential issue. Furthermore, energy-saving in cloud data center, regarding the benefits such as reduction of system operating costs and environmental protection is an important concern that is considered during recent years and is reducible with appropriate task scheduling. In this paper, we present an energy-aware task scheduling approach, namely EaRTs for real-time applications. We employ the virtualization and consolidation technique subject to minimizing the energy consumptions, improve resource utilization and meeting the deadlines of tasks. In the consolidation technique, scale up and scale down of virtualized resources could improve the performance of task execution. The proposed approach comprises four algorithms, namely Energy-aware Task Scheduling in Cloud Computing(ETC), Vertical VM Scale Up(V2S), Horizontal VM Scale up(HVS) and Physical Machine Scale Down(PSD). We present the formal model of the proposed approach using Timed Automata to prove precisely the schedulability feature and correctness of EaRTs. We show that our proposed approach is more efficient in terms of deadline hit ratio, resource utilization and energy consumption compared to other energy-aware real-time tasks scheduling algorithms.
Read moreA RESOURCE ALLOCATION SCHEME FOR CLOUD-BASED IOT APPLICATIONS BASED ON AN ENERGY-EFFICIENT MAKESPAN TASK SCHEDULING ALGORITHM
In cloud computing, task scheduling is the primary consideration when assigning resources dynamically to minimize makespan and increase performance. Due to the fact that data centers house a large number of computers, the rapid growth of cloud computing leads in massive energy consumption and emissions of carbon dioxide. Thus, in order to lower energy usage and carbon emissions, cloud service providers are searching for environmentally friendly solutions. Task scheduling has gained popularity as a result, where minimal energy usage and effective resource utilization are given careful thought. Although there are many applications and domains where cloud computing is widely employed, task and resource scheduling is still something that has to be improved. To lower costs, makespan, and energy consumption, this study presents the Cost and Energy-aware Task Scheduling Algorithm (CETSA). The suggested approach takes into account the load on each virtual machine as well as the trade-off between cost, energy consumption, and makespan in order to prevent virtual machines from overloading. The recommended method is put into practice with the help of the Cloud Sim toolkit and evaluated for various workloads. In addition, the recommended method lowers the rate of work failure, outperforms the prior algorithms in terms of energy consumption, and strikes a reasonable compromise between the makespan and the overall execution cost. Ultimately, the experimental findings demonstrate that the CETSA algorithm outperforms other algorithms in terms of energy usage.
Read moreDeep Reinforcement Learning for energy-aware task offloading in join SDN-Blockchain 5G massive IoT edge network
Deep Reinforcement Learning for energy-aware task offloading in join SDN-Blockchain 5G massive IoT edge network
Metaheuristic task scheduling algorithms for cloud computing environments
SummaryCloud computing has the advantage of providing flexibility, high‐performance, pay‐as‐you‐use, and on‐demand service. One of the important research issues in cloud computing is task scheduling. The purpose of scheduling is to assign tasks to available resources while providing optimization on some objectives. Tasks have diversified characteristics, and resources are heterogeneous. These properties make task scheduling an NP‐complete problem. In this study, metaheuristic and hybrid metaheuristic algorithms are developed for task scheduling problems in cloud computing environments. We have developed genetic algorithm (GA), differential evolution (DE), and simulated annealing (SA) based metaheuristic algorithms, which are also combined with a greedy approach (GR). In addition to this, we have developed hybrid metaheuristics algorithms, called DE‐SA and GA‐SA, which are also combined with a greedy approach. The proposed approaches are evaluated in terms of completion time and load balancing of virtual machines. In terms of average completion time, as the number of tasks increases, it has been observed that the DESA algorithm outperforms the solely used DE and SA algorithms. In addition, experiments show that hybrid algorithms improve both the average completion time and the average standard deviation of virtual machine loads for some task groups.
Read moreAn energy-saving task scheduling strategy based on vacation queuing theory in cloud computing
High energy consumption is one of the key issues of cloud computing systems. Incoming jobs in cloud computing environments have the nature of randomness, and compute nodes have to be powered on all the time to await incoming tasks. This results in a great waste of energy. An energy-saving task scheduling algorithm based on the vacation queuing model for cloud computing systems is proposed in this paper. First, we use the vacation queuing model with exhaustive service to model the task schedule of a heterogeneous cloud computing system. Next, based on the busy period and busy cycle under steady state, we analyze the expectations of task sojourn time and energy consumption of compute nodes in the heterogeneous cloud computing system. Subsequently, we propose a task scheduling algorithm based on similar tasks to reduce the energy consumption. Simulation results show that the proposed algorithm can reduce the energy consumption of the cloud computing system effectively while meeting the task performance.
Read more