- Research Article
7
- 10.1002/cpe.4517
Cloud computing and big data: Technologies and applications
- May 20, 2018
- Concurrency and Computation: Practice and Experience
- Mostapha Zbakh + 3 more +3
Cloud computing and big data: Technologies and applications
As on miniature devices to military applications, the cloud computing plays a vital role. Building efficient cloud management systems will lead to improve extraordinary features in the applications of cloud services. In cloud atmosphere, enormous tasks are performed simultaneously; an effectual task scheduling is very important role to get better performance of the cloud system. An assortment of cloud-based task scheduling algorithms is offered that schedule the user's task to resources for implementation. The innovation of cloud computing, conventional scheduling algorithms cannot gratify the cloud's requirements, the researchers are frustrating to modify conventional algorithms that can accomplish the cloud needs similar to rapid elasticity, resource pooling and on-demand self-service. Also, the priority becomes an important task when dealing with critical functionality systems. Real world invocations are needed to make an efficient selection in cloud services through a collection of functionally equivalent services. This research aims to detect a novel method to predict the system functionality without consuming more time and less expensive for implementation. Investigation on swarm intelligence-based task scheduling is presented. This will improve the power consumption by reducing overloads when more services opt for a single load. Experiments were carried out to test the effectiveness of the method.
Cloud computing and big data: Technologies and applications
Cloud computing and big data: Technologies and applications
Classification and Performance Study of Task Scheduling Algorithms in Cloud Computing Environment
Cloud computing is becoming very common in recent years and is growing rapidly due to its attractive benefits and features such as resource pooling, accessibility, availability, scalability, reliability, cost saving, security, flexibility, on-demand services, pay-per-use services, use from anywhere, quality of service, resilience, etc. With this rapid growth of cloud computing, there may exist too many users that require services or need to execute their tasks simultaneously by resources provided by service providers. To get these services with the best performance, and minimum cost, response time, makespan, effective use of resources, etc. an intelligent and efficient task scheduling technique is required and considered as one of the main and essential issues in the cloud computing environment. It is necessary for allocating tasks to the proper cloud resources and optimizing the overall system performance. To this end, researchers put huge efforts to develop several classes of scheduling algorithms to be suitable for the various computing environments and to satisfy the needs of the various types of individuals and organizations. This research article provides a classification of proposed scheduling strategies and developed algorithms in cloud computing environment along with the evaluation of their performance. A comparison of the performance of these algorithms with existing ones is also given. Additionally, the future research work in the reviewed articles (if available) is also pointed out. This research work includes a review of 88 task scheduling algorithms in cloud computing environment distributed over the seven scheduling classes suggested in this study. Each article deals with a novel scheduling technique and the performance improvement it introduces compared with previously existing task scheduling algorithms. Keywords: Cloud computing, Task scheduling, Load balancing, Makespan, Energy-aware, Turnaround time, Response time, Cost of task, QoS, Multi-objective. DOI: 10.7176/IKM/12-5-03 Publication date: September 30 th 2022
Read moreTask Scheduling Algorithm Based on PSO in Cloud Environment
In recent years, cloud computing has developed rapidly under the vigorous promotion of industry and academia. With the expansion of cloud computing, users' special needs for cloud resources have gradually improved. As a business model, cloud computing must pay more attention to user demands for services and provide users with high-quality services. As one of the key technologies in cloud computing, task scheduling is mainly responsible for assigning user tasks to the appropriate resources. However, the existing scheduling algorithms do not take full account of users' different needs. In this paper, we consider multidimensional QoS requirements, and introduce Berger model to judge the fairness of the resource allocation results. We also improve the Particle Swarm Optimization(PSO) algorithm by adjusting its parameters dynamically and making the position coding discrete. Then, we propose a task scheduling algorithm based on QoS-DPSO. The simulation results show that this algorithm can effectively carry out user tasks and reflect more fairness.
Read moreA Novel, Self-Adaptive, Multiclass Priority Algorithm with VM Clustering for Efficient Cloud Resource Allocation
Priority in task scheduling and resource allocation for cloud computing has attracted significant attention from the research community. However, traditional scheduling algorithms often lack the ability to differentiate between tasks with varying levels of importance. This limitation presents a challenge when cloud servers must handle diverse tasks with distinct priority classes and strict quality of service requirements. To address these challenges in cloud computing environments, particularly within the infrastructure of service models, we propose a novel, self-adaptive, multiclass priority algorithm with VM clustering for resource allocation. This algorithm implements a four-tiered prioritization system to optimize key objectives, including makespan and energy consumption, while simultaneously optimizing resource utilization, degree of imbalance, and waiting time. Additionally, we propose a resource prioritization and load-balancing model based on the clustering technique. The proposed work was validated through multiple simulations using the CloudSim simulator, comparing its performance against well-known task scheduling algorithms. The simulation results and analysis demonstrate that the proposed algorithm effectively optimizes makespan and energy consumption. Specifically, our work achieved percentage improvements ranging from +0.97% to +26.80% in makespan and +3.68% to +49.49% in energy consumption while also improving other performance metrics, including throughput, resource utilization, and load balancing. This novel model demonstrably enhances task scheduling and resource allocation efficiency, particularly in complex scenarios with tight deadlines and multiclass priorities.
Read moreApplication of PSO Algorithm based on Improved Accelerating Convergence in Task Scheduling of Cloud Computing Environment
Hadoop uses a reliable, efficient and scalable way to process data. It provides a good solution for dealing with big data. The task scheduler is the core component of Hadoop, and it is responsible for the managing and allocating the cluster resources. Therefore, scheduling algorithm directly affects the overall performance of Hadoop platform and utilization of cluster resource. Based on this, the improved accelerate particle swarm algorithm (IAPSO) is introduced to the cloud environment, and to solve the cloud task scheduling problem in this article. When we use particle swarm algorithm for task scheduling, the tasks are considered as particles, the resource pool is seen as the search space, and the process of finding the optimal solution is considered as a process of task scheduling. If all the sub tasks find the appropriate resources, then stop the iteration and allocate sub asks to the resource nodes. Finally, we simulate the experiment by using CloudSim software. When a single type of task is committed, our algorithm and the other three algorithms can also be used to complete the task scheduling process, and our algorithm is more efficient. But in practice, the cloud computing environment is facing multiuser, and the types of tasks are also varied. With the increase in the number of tasks, the advantage of the other three algorithms decreases gradually, but algorithm in this paper has been exhibited higher efficiency. In addition, with the increase of the number of nodes, task completed time of the algorithm in this paper is significantly less than the other three algorithms, and it has a steady downward trend. Therefore, IAPSO algorithm which is proposed in this paper is applied to solve task scheduling problem in the cloud environment, and it can effectively improve the efficiency of task scheduling.
Read moreChaotic symbiotic organisms search for task scheduling optimization on cloud computing environment
Recently, cloud computing have been witnessing high deployment rate of large scale scientific and business applications, this is due to the on-demand provisioning of shared pool of computational resources like networks, storage, and servers, it offers. Each of these applications is made up of various tasks whose execution determine the overall performance of the application. Task scheduling problem on cloud is an NP-hard problem, and thus task scheduling constitute one of the crucial aspects of resources management system in cloud computing, which ensures the attainment of the general user Quality of Service (QoS) performance in terms of response time, total execution time(makespan), throughput among others. In addition, appropriate task scheduling is effective in reducing the operational cost of cloud service providers in terms of energy consumption and resource utilization. This paper focuses on task scheduling problem using a novel Chaotic Symbiotic Organisms Search (CSOS) algorithm to minimize makespan and cost. The main idea is to prevent the premature convergence of SOS at early stages of optimization process by implementing a chaotic map, which enlarges the search space and provides diversity. The performance of the proposed CSOS algorithm is evaluated by extensive simulation using CloudSim toolkit simulation framework and compared with SOS and PSO. Simulation results reveal significant improvement in performance by the proposed CSOS in reducing cost and makespan, in task scheduling.
Read moreOptimization of Task Scheduling in Cloud Computing Using the RAO-3 Algorithm
Cloud computing provides computer resources such as hardware and software as a service to consumers over a network. The primary idea of cloud computing is to distribute massive amounts of storage, processing, and information to scientific applications. In cloud computing, user tasks are organized and executed with appropriate resources to supply services successfully. In order to complete task scheduling, a variety of task allocation approaches are employed. This work proposes an efficient task scheduling method to improve the task scheduling approach. Optimization techniques are often used to solve NP-hard situations. This work presents an effective scheduling task method for cloud computing systems based on the RAO-3 algorithm. We evaluate the performance of our approach by applying it to three instances. According to the data, the proposed technique provided the optimal solution in terms of schedule length, speedup, efficiency, and throughput.KeywordsHeterogeneous resourcesRAO-3 algorithmTask schedulingCloud computing
Read moreSAAS parallel task scheduling based on cloud service flow load algorithm
SAAS parallel task scheduling based on cloud service flow load algorithm
Task Scheduling in Cloud Computing Based on The Cuckoo Search Algorithm
Task scheduling is one of the very crucial facets of cloud computing. The task scheduling method must assign jobs to virtual machines. In cloud computing, task scheduling includes a frontal influence on a system's resource utilization and operational costs. Diverse meta-heuristic algorithms, in addition to their modifications, have been developed to improve the efficiency of task executions in the cloud. In this paper, a multiobjective optimization model is applied using the metaheuristics cuckoo search optimization algorithm (MCSO) to enhance the performance of a cloud system with limited computing resources while minimizing the time and cost. Finally, we analyze the performance of the proposed MCSO with the existing methods, such as Bee Life Algorithm (BLA), A Time–Cost aware Scheduling (TCaS) algorithm, Modified Particle Swarm Optimization (MPSO), and Round Robin (RR), for the evaluation metrics makespan and cost. Based on the outcomes of the experiments, it can be inferred that the proposed MCSO provides essential schedule jobs with the shortest makespan and average cost. Index Terms— Task Scheduling, Multiobjective, Cloud Computing, Cost, Makespan.
Read moreScheduling soft aperiodic tasks in adaptable fixed-priority systems
This paper presents a new type of scheduling algorithm for servicing soft deadline aperiodic tasks in adaptable fixed-priority real-time systems. The major goals of our proposed task scheduling are not only to guarantee all the deadlines of periodic tasks and to obtain fast response time for aperiodic tasks, but also to retain considerable scheduling predictability. To achieve these goals, we have adopted a new aperiodic task scheduling principle in which a normal fixed-priority assignment strategy and the information on a preassignment table built off-line are properly mingled somewhat dynamically according to the aperiodic tasks' arrivals at runtime. The paper also shows some simulation results in terms of the average aperiodic response time, verifying that the new algorithm offers significant performance improvements over other conventional joint scheduling algorithms, especially under a heavy transient overload.
Read moreModified Sunflower Optimization Algorithm for Task Scheduling in Cloud Computing
Objective: To develop a task scheduling algorithm that efficiently approximates solutions for the multi-objective task scheduling problem in a cloud environment, optimizing resource utilization, execution time, cost, and overall system performance. Method: A Modified Sunflower Optimization Algorithm for Task Scheduling (MSOTS) is proposed to improve efficiency in cloud environments. The traditional sunflower optimization algorithm is enhanced with Levy flight, crossover, and mutation operations to achieve a better balance between exploration and exploitation while preventing entrapment in local minima. These enhancements help improve convergence speed and solution quality. CloudSim is utilized for comprehensive performance evaluation, comparing MSOTS with existing algorithms in terms of execution time, cost, and resource utilization. The randomly generated dataset (500 tasks and 50 VMs) is used for analyze the performance of the MSOTS. Findings: The results demonstrate that MSOA significantly reduces makespan and cost while enhancing resource utilization. Specifically, the proposed method reduces makespan by 22.43% compared to PSO and 14.95% compared to SOA. Additionally, cost is reduced by 14.47% and 10.38% compared to PSO and SOA, respectively, while resource utilization increases by 3.89% and 2.51% over these methods. These findings indicate that MSOA effectively improves task scheduling performance in terms of makespan, cost efficiency, and resource utilization, making it a promising approach for cloud computing environments. Novelty: The MSOA is integrated with single-point crossover, swap mutation, and Lévy flight to update the solution, which prevents entrapment in local minima and premature convergence and enhances task scheduling efficiency, optimizes resource allocation, minimizes execution time, and reduces overall costs in cloud computing environments. Keywords: Meta-heuristic, Sunflower optimization, Levy flight, Crossover, Mutation
Read moreTask Scheduling and Resource Allocation of Cloud Computing Based on QoS
With the enlargement of the scope of cloud computing application, the number of users and types also increases accordingly, the special demand for cloud computing resources has also improved. Cloud computing task scheduling and resource allocation are key technologies, mainly responsible for assigning user jobs to the appropriate resources to perform. But the existing scheduling algorithm is not fully consider the user demand for resources is different, and not well provided for different users to meet the requirements of its resources. As the demand for quality of service based on cloud computing and cloud computing original scheduling algorithm, the computing power scheduling algorithm is proposed based on the QoS constraints to research the cloud computing task scheduling and resource allocation problems, improving the overall efficiency of cloud computing system.
Read morePerformance Analysis and Comparison Among Different Task Scheduling Algorithms in Cloud Computing
In the field of cloud computing, efficient task scheduling plays a vital role. Cloud computing is an on-demand service where resources are shared virtually by the users to complete their tasks. The main concept of task scheduling is to execute the tasks in such an order that can enhance the performance with full resource utilization and minimum loss. Already a lot of scheduling algorithm exists targeting to various goals like reducing execution time, cost, makespan and increase resource utilization, load balancing, etc. In this work, we have mainly carried out the performance analysis and comparison among various well-known task scheduling algorithms. The algorithms are examined and implemented in a well-known cloud simulator (CloudSim) to observe their performances by varying different parameters. Finally, the performance metrics like makespan, waiting time, turnaround time, throughput, and load balancing are observed by plotting the results graphically. Along with the comparative analysis, this work also assists one to identify a better scheduling algorithm based on different scheduling constraints and criteria.
Read moreTask Scheduling in Cloud Computing using Lion Optimization Algorithm
Cloud computing has spread fast because of its high performance distributed computing. It offers services and access to shared resources to internet users through service providers. Efficient performance of task scheduling in clouds is one of the most important research issues which needs to be focused on. Various task scheduling algorithms for cloud based on metaheuristic techniques have been examined and showed high performance in reasonable time such as scheduling algorithms based on Ant Colony Optimization (ACO), Genetic Algorithm (GA), and Particle Swarm Optimization (PSO). In this paper, we propose a new task-scheduling algorithm based on Lion Optimization Algorithm (LOA), for cloud computing. LOA is a nature-inspired population-based algorithm for obtaining global optimization over a search space. It was proposed by Maziar Yazdani and Fariborz Jolai in 2015. It is a metaheuristic algorithm inspired by the special lifestyle of lions and their cooperative characteristics. The proposed task scheduling algorithm is compared with scheduling algorithms based on Genetic Algorithm and Particle Swarm Optimization. The results demonstrate the high performance of the proposed algorithm, when compared with the other algorithms.
Read morePrediction-Based Resource Deployment and Task Scheduling in Edge-Cloud Collaborative Computing
Edge computing is becoming increasingly commonplace, as consumer devices become more computationally capable and network connectivity improves (e.g., due to 5G). With the rapid development of edge computing and Internet of Things (IoT), the use of edge-cloud collaborative computing to provide service-oriented network application (i.e., task) in edge-cloud IoT has become an important research topic. In this paper, we present an edge-cloud collaborative computing framework and our resource deployment algorithm with task prediction (RDAP). Based on our paradigm, tasks in the cloud service center are predicted using the two-dimensional time series, and task classification aggregation and delay threshold determination are combined to optimize task resource deployment of edge servers. A task scheduling algorithm with Pareto improvement (TSAP) is also proposed. At the edge servers, the Pareto progressive comparison is conducted in two stages to obtain the tangent point or any intersection point of the two objective curves of user’s quality of service and effect of system service to optimize task scheduling. The experimental results show that for varying user task scales and different Zipf distribution α parameters, combining RDAP and TSAP (RDAP-TSAP) can improve the average user task hit rate. In addition, the average task completion time of users, the overall system service effect, and the total task delay rate of RDAP-TSAP are better than TSAP and the benchmark algorithms for task scheduling.
Read more