- Research Article
7
- 10.1002/cpe.4517
Cloud computing and big data: Technologies and applications
- May 20, 2018
- Concurrency and Computation: Practice and Experience
- Mostapha Zbakh + 3 more +3
Cloud computing and big data: Technologies and applications
Execution of workflow application in cloud computing is widely applied, it is to apply heterogeneous resource in cloud for meeting the demand for large computational requirements. To maximize the efficiency of cloud computing, we have to effectively solve resources arrangement problem of workflow application in cloud computing, namely efficient task scheduling is needed. Cloud task scheduling problem is an NP-hard problem; therefore, a modified particle swarm optimization (PSO) is used to solve the task scheduling problem in the cloud, the grid task scheduling problems including how to distribute tasks to cloud resource and how to place a priority of tasks. In this study, two types of PSO are applied to solve these two issues, discrete particle swarm optimization is used to solve problem of distribution tasks in the cloud and a modified conventional PSO, named global topology controlling PSO (GTCPSO), is used in task priority assignments. In order to increase PSO searching efficiency, curve controlling is used to adjust the usage of global topology communication between particles so as to control search behavior of particle swarm. Thus, the swarm can perform global search at the initial stage, and then does fully local search at the last stage. The experiment results indicate that the curve controlling of topology communication between particles based on a designed global topology rate can efficiently solve the task scheduling problem and enhance performance of cloud computing.
Cloud computing and big data: Technologies and applications
Cloud computing and big data: Technologies and applications
Pso Optimization algorithm for Task Scheduling on The Cloud Computing Environment
The Cloud computing is a most recent computing paradigm where IT services are provided and delivered over the Internet on demand. The Scheduling problem for cloud computing environment has a lot of awareness as the applications tasks could be mapped to the available resources to achieve better results. One of the main existed algorithms of task scheduling on the available resources on the cloud environment is based on the Particle Swarm Optimization (PSO). According to this PSO algorithm, the applications tasks are allocated to the available resources to minimize the computation cost only. In this paper, a modified PSO algorithm has been introduced and implemented for solving task scheduling problem in the cloud. The main idea of the modified PSO is that the tasks are allocated on the available resources to minimize the execution time in addition to the computation cost. This modified PSO algorithm is called Modified Particle Swarm Optimization (MPOS).The MPOS evaluations have been illustrated using different time, and cost parameters and their effects in the performance measures such as utilization, speedup, and efficiency. According to the implementation results, it is found that the modified MPOS algorithm outperforms the existed PSO.
Read moreAn efficient task scheduling in a cloud computing environment using hybrid Genetic Algorithm - Particle Swarm Optimization (GA-PSO) algorithm
Cloud computing provides the computational machines as a support of the clients utilizing cloud organize. In cloud computing, the user inputs are executed with required machines to convey the administrations. Numerous task scheduling methods are utilized to plan the client tasks to the machines. In this paper, another successful hybrid task scheduling is proposed to minimize the total execution time using Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) algorithms. In hybrid Genetic Algorithm - Particle Swarm Optimization (GA-PSO) algorithm, PSO helped GA to obtain better results compare to a standard genetic algorithm, Min-Min, and Max-Min algorithms results.
Read moreNovel Discrete Particle Swarm Optimization Based on Huge Value Penalty for Solving Engineering Problem
For the purpose of solving the engineering constrained discrete optimization problem, a novel discrete particle swarm optimization(DPSO) is proposed. The proposed novel DPSO is based on the idea of normal particle swarm optimization(PSO), but deals with the variables as discrete type, the discrete optimum solution is found through updating the location of discrete variable. To avoid long calculation time and improve the efficiency of algorithm, scheme of constraint level and huge value penalty are proposed to deal with the constraints, the stratagem of reproducing the new particles and best keeping model of particle are employed to increase the diversity of particles. The validity of the proposed DPSO is examined by benchmark numerical examples, the results show that the novel DPSO has great advantages over current algorithm. The optimum designs of the 100?1 500 mm bellows under 0.25 MPa are fulfilled by DPSO. Comparing the optimization results with the bellows in-service, optimization results by discrete penalty particle swarm optimization(DPPSO) and theory solution, the comparison result shows that the global discrete optima of bellows are obtained by proposed DPSO, and confirms that the proposed novel DPSO and schemes can be used to solve the engineering constrained discrete problem successfully.
Read moreA Particle Swarm Optimization Based Load Scheduling Algorithm in Cloud Platform for Wireless Sensor Networks
Integration of wireless sensor network into cloud computing is a growing paradigm that supports a massive amount of applications in cloud computing, optimization of resources required in the machines. This integration requires the optimization of resources to efficiently complete the different tasks in the devices at cloud platform. This optimization can be done using load scheduling algorithms. These algorithms reduce overload and achieve higher throughput by maximizing the machine utilization concerning cost stabilization. There are lots of methods like First Come First Serve, Min-Min, Particle Swarm Optimization (PSO) for optimizing the load but we use Particle Swarm Optimization as it obtains the motivation from the social behavior of the flock of birds and analyses various approaches for load scheduling. In this paper, we propose the load scheduling algorithm based on PSO in wireless sensor networks for cloud computing to minimize total transfer time and cost stabilization. The proposed method is compared with the existing approaches used for load scheduling in Cloudlets. It is clear from the simulation results that the proposed method is more efficient because it minimizes the transfer time and cost than the conventional algorithms thereby making a system for cost stable.
Read moreSymbiotic Organism Search optimization based task scheduling in cloud computing environment
Symbiotic Organism Search optimization based task scheduling in cloud computing environment
A modified particle swarm optimization algorithm for optimal allocation of earthquake emergency shelters
Allocation for earthquake emergency shelters is a complicated geographic optimization problem because it involves multiple sites, strict constraints, and discrete feasible domain. Huge solution space makes the problem computationally intractable. Traditional brute-force methods can obtain exact optimal solutions. However, it is not sophisticated enough to solve the complex optimization problem with reasonable time especially in high-dimensional solution space. Artificial intelligent algorithms hold the promise of improving the effectiveness of location search. This article proposes a modified particle swarm optimization (PSO) algorithm to deal with the allocation problem of earthquake emergency shelter. A new discrete PSO and the feasibility-based rule are incorporated according to the discrete solution space and strict constraints. In addition, for enhancing search capability, simulated annealing (SA) algorithm is employed to escape from local optima. The modified algorithm has been applied to the allocation of earthquake emergency shelters in the Zhuguang Block of Guangzhou City, China. The experiments have shown that the algorithm can identify the number and locations of emergency shelters. The modified PSO algorithm shows a better performance than other hybrid algorithms presented in the article, and is an effective approach for the allocation problem of earthquake emergency shelters.
Read moreA novel task scheduling scheme in a cloud computing environment using hybrid biogeography-based optimization
Task scheduling, which plays a crucial role in cloud computing and is the critical factor influencing the performance of cloud computing, is an NP-hard problem that can be solved with a heuristic algorithm. In this paper, we propose a novel heuristic algorithm, called biogeography-based optimization (BBO), and a new hybrid migrating BBO (HMBBO) algorithm, which integrates the migration strategy with particle swarm optimization (PSO). Both methods are proposed to solve the problem of scheduling-directed acyclic graph tasks in a cloud computing environment. The basic idea of our approach is to exploit the advantages of the PSO and BBO algorithms while avoiding their drawbacks. In HMBBO, the flight strategy under the BBO migration structure is hybridized to accelerate the search speed, and HEFT_D is used to evaluate the task sequence. Based on the WorkflowSim, a comparative experiment is conducted with the makespan of task scheduling as the objective function. In HMBBO, the flight strategy under the BBO migration structure is hybridized to accelerate the search speed, and HEFT_D is used to evaluate the task sequence. Based on the WorkflowSim, a comparative experiment is conducted with the makespan of task scheduling as the objective function. Both simulation and real-life experiments are conducted to verify the effectiveness of HMBBO. The experiment shows that compared with several classic heuristic algorithms, HMBBO has advantages in terms of global search ability, fast convergence rate and a high-quality solution, and it provides a new method for task scheduling in cloud computing.
Read moreCrossed Particle Swarm Optimization Algorithm
The particle swarm optimization (PSO) algorithm presents a new way for finding optimal solutions of complex optimization problems. In this paper a modified particle swarm optimization algorithm is presented. We modify the PSO algorithm in some aspects. Firstly, a contractive factor is introduced to the position update equation, and the particles are limited in search region. A new strategy for updating velocity is then adopted, in which the velocity is weakened linearly. Thirdly, using an idea of intersecting two modified PSO algorithms. Finally, adding an item of integral control in the modified algorithm can improve its global search ability. Based on these strategies, we proposed a new PSO algorithm named crossed PSO algorithm. Simulation results show that the crossed PSO is superior to the original PSO algorithm and can get overall promising performance over a wide range of problems.
Read moreOpposition-based learning inspired particle swarm optimization (OPSO) scheme for task scheduling problem in cloud computing
The problem of scheduling of tasks in distributed, heterogeneous, and multiprocessing computing environment like grid and cloud computing is considered as one of the most important issue from research perspective. As the performance of such kind of systems is highly depends upon the way, how tasks are allocated among the multiple processing units for their efficient execution. The underlying objective of any task scheduling mechanism is to minimize the overall makespan for the execution of given set of jobs/tasks and computing machines. Scheduling of tasks in cloud computing falls in the class of NP-hard optimization problem. As a result, many meta-heuristic algorithms have been applied and tested to solve this problem but still lot of scope is there for the better strategies. The characteristic of the good algorithm is that it must be adaptable to the dynamic environment. Through this paper, we are proposing task scheduling mechanism based on particle swarm optimization (PSO) in which opposition-based learning technique is used to avoid premature convergence and to accelerate the convergence of standard PSO and compared same with the well-established task scheduling strategies based on PSO, mPSO (modified PSO), genetic algorithm GA, max–min, minimum completion time and minimum execution time. The results obtained for the various class of experiments clearly establish that the proposed opposition-based learning inspired particle swarm optimization based scheduling strategy performs better in comparison to its peers which are taken into the consideration.
Read moreA benefit-aware on-demand provisioning approach for multi-tier applications in cloud computing
Dynamic resource provisioning is a challenging technique to meet the service level agreement (SLA) requirements of multi-tier applications in virtualization-based cloud computing. Prior efforts have addressed this challenge based on either a cost-oblivious approach or a cost-aware approach. However, both approaches may suffer frequent SLA violations under flash crowd conditions. Because they ignore the benefit gained that a multi-tier application continuously guarantees the SLA in the new configuration. In this paper, we propose a benefit-aware approach with feedback control theory to solve this problem. Experimental results based on live workload traces show that our approach can reduce resource provisioning cost by as much as 30% compared with a costoblivious approach, and can effectively reduce SLA violations compared with a cost-aware approach.
Read moreStudy on Rotor Speed Identification of DTC System Based on PSO Algorithms of BP Neural Network
To solve the strong randomicity and slow convergence of the Particle Swarm Optimization(PSO) algorithms, two new particle’s position renewal formulas were analyzed on the basis of extrapolation in mathematics. A new modified PSO algorithms (called Leading PSO algorithms) was put forward. The Direct Torque Control(DTC) System was built in the environment of Matlab(Simulink). The weight and threshold values of BP Neural Network were trained using the modified PSO algorithms. Some disadvantages such as slow convergence speed and easily plunging into the local solution were avoided effectively. The simulation result shows that the system works well, and the rotor speed identifier has great static and dynamic performance.
Read moreParticle Swarm Optimization: Technique, System and Challenges
Particle Swarm Optimization (PSO) is a biologically inspired computational search and optimization method developed in 1995 by Eberhart and Kennedy based on the social behaviors of birds flocking or fish schooling.A number of basic variations have been developed due to improve speed of convergence and quality of solution found by the PSO.On the other hand, basic PSO is more appropriate to process static, simple optimization problem.Modification PSO is developed for solving the basic PSO problem.The observation and review 46 related studies in the period between 2002 and 2010 focusing on function of PSO, advantages and disadvantages of PSO, the basic variant of PSO, Modification of PSO and applications that have implemented using PSO.The application can show which one the modified or variant PSO that haven't been made and which one the modified or variant PSO that will be developed.
Read moreParticle swarm optimization using dimension selection methods
Particle swarm optimization using dimension selection methods
Application Research of Cloud Computing in the Smart Grid Information Processing
With the rapid development of national economy, our demand for power resources has also increased rapidly. The traditional power grid can not be achieved operational status of equipment for effective monitoring and control, we will not be able to ensure the quality and quality of electricity service. Cloudbased build smart grid information platform enables gathering the parameter of grid operation state, greatly increasing the economic efficiency of power enterprises. Firstly, cloud computing and smart grid briefly described, and then pointed out that cloud computing applications in the smart grid information platform, and specialized of cloud-based smart grid information platform, in order for the power grid enterprises to enhance their level of service and provide effective reference. KEYWORD: cloud computing; smart power grids; information platform; Application 4th International Conference on Mechanical Materials and Manufacturing Engineering (MMME 2016) © 2016. The authors Published by Atlantis Press 202 3 THE MAIN PROBLEM IS STILL THE SMART GRID INFORMATION PLATFORM FACING The transition to a cloud computing data center. Our data center because of the different regions and the degree of information presents different characteristics, some data centers already have a basic cloud computing capabilities, but most data centers still remain in the initial level, to ensure the normal operation of the existing data center power under the premise, gradual transition to cloud computing data center in order to meet future requirements of the development of smart grid. Restricting data transmission problem. State Grid Corporation between provincial branches and there are a lot of data needs to be transmitted, will bring massive data transmission efficiency decreases, taking into account the load balancing device between the cloud node, thus building a wide area network channels to resolve data transmission problem. Security of data transmission. Data Center for Cloud Computing power companies to build internal private cloud, capable of self-maintenance and management, system wide area network data transmission services, according to the third security zone defined security partition, and install proprietary equipment production area and external public network isolation . 4 CLOUD COMPUTING APPLICATIONS IN THE SMART GRID INFORMATION POLICY PLATFORM Integrate and optimize the management of heterogeneous resources. Among the smart grid systems, data resources, information systems between various platforms and mutually dispersed, severe heterogeneity, thus leading to the integration of the quality of information sharing to increase difficulty, unable to effectively improve network management efficiency for the power distribution system electrical work quality management and marketing operations system maintenance upgrade will not be able to effectively meet demand (Jie Yang, 2014). Cloud computing technology enables the power system to effectively integrate the various business data and computing resources on the basis of information for business collaboration platform built on effective, able to satisfy the huge demand for smart grid information resource sharing. Cloud computing network virtualization and application virtualization technology, the server virtualization technology and other resources to achieve each service abstraction, and then realize the difference between the system and the software effectively eliminated by the appropriate method to achieve the effective integration of information resources, and then to optimize the management, greatly improving the efficiency of heterogeneous resources management applications. Distributed storage and management of large volume of data. After application of smart grid information platform construction, customer service requests varied, huge data volume information brought it to the storage and management of data provides a great challenge. Cloud computing technology in general face amount of data each smart grid system and unit collected using forms distributed storage of data to achieve the effective storage, greatly to ensure the security and reliability of data storage. GFS effective use of technology with each node, the master server is responsible for the effective management of the whole file system, the file system and complete the work of the metadata stored in the data block is the main server for data storage block sliced, and by saving three or more redundant backup storage. At the same time, client access and complete access to the main block server information. Fast Power System Parallel Computation and Treatment. Smart grids and information platform for the large volume of data to provide stable operation of the power grid data base, but more critical is the analysis and design of each system operating data, planning and decision-making, and even failures and transient stability, state estimation and intelligent a variety of computing and content analysis and decision-making process, its huge computing needs, general computing system can not reach its goal (Wang, Mengxue, 2015). Cloud computing technology through parallel computing technology has greatly enhanced parallel processing capability of the power system, which provides parallel programming model makes more simple and efficient parallel algorithms. MapReduce as Google made an important parallel programming model, and its role in large data sets in parallel computing plays a very prominent. Parallel processing job results by the client to achieve effective user submitted, via decomposition automated master role, the corresponding task scheduling to working nodes and nodes work completed by the specific calculations and perform the appropriate task. 5 SMART GRID INFORMATION PLATFORM CLOUD COMPUTING ANALYSIS Cloud Computing Smart Grid Information Platform Architecture. Smart grid technology information platform architecture cloud computing include the following several levels and aspects (Yan Cui, 2015): First, that the platform infrastructure layer is the integration of the various hardware resources and related management capabilities of virtualized using virtual technology to achieve the corresponding hardware devices such as computers and network storage devices abstraction, and then complete the automation and optimization of resource data and load management; secondly, the main platform for the integration of the various layers of software
Read more