Multi-Objective Deep Reinforcement Learning for Dynamic Task Scheduling Under Time-of-Use Electricity Price in Cloud Data Centers

High energy consumption in data center has become a key problem, and the Carbon (CO $$_2$$ ) emissions from data center have serious impacts on environment. To improve traditional performance-energy model and minimize energy consumption in cloud data center, an energy-efficient and QoS-aware (EEQoS) model is developed for virtual resources consolidation. The EEQoS model is designed to investigate the trade-off between energy and QoS. The user’s satisfaction degree and Euclidean distance of resources are also respectively applied to the QoS model and power model. In addition, this EEQoS model is combined with the particle swarm optimization algorithm by setting the power consumption per QoS value as the objective function to consolidate virtual resources in data center. Compared with traditional power model, the proposed model reduces response time by 27.2%, cost by 31.4%, SLA violations by 40.5% and improves throughput by 13.5% on average while increasing less than 3.8% energy consumption during the whole test period.

Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review

[Purpose] Server virtualization technology is the basic form for the cloud data center to serve customers. While the cloud data center reduces the SLA violations in the early stage, the increase in the utilization of resources such as virtual machine servers and network equipment and decrease in energy consumption have become an important issue for reduction of operating costs. Therefore, on the background of the cloud data center network based on SDN technology, this paper studies a cloud data center resource utilization and energy consumption optimization strategy through virtual machine migration and integration. [Method] The technology based on SDN is firstly introduced, the approximate optimal solution FFD algorithm for the multidimensional vector bin packing problem is then presented, the Partheno-Genetic Algorithm (PGA) is then recommended, finally a Hybrid Partheno genetic Algorithm (HPGA) based on the both is established and a mathematic model is created. [Results] By combining the advantages of FFD and PGA, this paper improves the utilization of the resources of the entire cloud data center, reduces energy consumption, and prevents the occurrence of computing “hot spots”. [Conclusion] Experiments in CloudSim prove the effectiveness of the algorithm. Compared with FFD and PGA algorithms, it is able to enhance the efficiency of the Data Center effectively, and obtain the optimal solution more quickly, thereby balancing the physical resources of the server.

Hybrid ant genetic algorithm for efficient task scheduling in cloud data centers

SummaryTo meet the ever‐increasing requirements of the applications, cloud service providers have further built and managed multiple cloud data centers in multiple regions across geographies with many physical machines (PMs). However, most of the existing resource allocation algorithms are developed for a single cloud data center, which normally cannot efficiently handle the load burst occasions where a single cloud data center may not be enough to satisfy the demands burst of applications. Therefore, it is necessary to consider how to efficiently manage multiple cloud data centers while meeting application requirements and reducing energy consumption. This paper first systematically analyzes multiple cloud data centers and energy consumption models. Then, an energy‐efficient method of Resource Allocation based on Request Prediction in multiple cloud data centers (RARP) is proposed. The RARP method constructs a resource allocation framework based on request prediction in multiple cloud data centers, which anticipates the application request volume in advance. At the same time, the RARP method allocates VMs and PMs based on the principle of minimum remaining resources available to achieve minimum usage of PMs, thus minimizing energy consumption to complete application requests. Extensive experiments are conducted on the proposed RARP method through the simulation platform CloudSim. Finally, the experimental test results show that the accuracy of request detection and the energy consumption of cloud data centers are significantly better than those of the comparison algorithms.

In the presence of latency sensitive geo-distributed applications, users require fast service for their queries. Cloud computing provides physical servers from its data center in order to process user requests. The cloud data center consumes a huge amount of energy due to lack of management of the data center servers as the container-based service consolidation is a nontrivial task. Since the containers require less resource footprint, consolidating it in servers might make resource availability sparse. In order to reduce the energy consumption of the cloud data center, we have proposed a green container-based consolidation of the services so that the maximum number of servers can be put into idle mode without affecting the application quality of experience. The service consolidation problem has been formulated as an optimization problem considering minimization of total energy consumption of the data center as the objective, and an algorithm named Energy Aware Service consolidation using baYesian optimization (EASY) has been proposed to solve the optimization. We have evaluated the EASY algorithm in simulation using python. The experimental results have shown that EASY improves the total energy consumption of the data centers. This improvement comes at the cost of a small increase of service response time as there exists a trade-off between energy consumption and service response time.

Background/Objective: Dynamic VM consolidation has been known as one from several ways to reduce energy consumption in cloud data center. The problem in reducing energy consumption with dynamic VM Consolidation has recognize as NP-Hard problem that divided into four subs, where VM selection is one of sub-problem. The objective VM selection is to choose the best VM that suitable to move from overload host and avoid oversubscription host. Methods: This research proposed novel VM selection model based on Fuzzy Logic, Markov Normal Algorithm (MA) and Existing VM Selection (FuMAEVMS) in dynamic VM consolidation. Moreover, RAM VM and max MIPS VM are consider as attribute to be used. The proposed VM selection model have been evaluated using Cloudsim with datasets from PlanetLabs in various condition of VM instance. The research measured the performance using several parameters such as Energy Consumption (EC), SLA Violation (SLAV), SLA Time per active host (SLATAH) and Performance Degradation Due Migration (PDM). FuMAEVMS were compared with existing VM selection such asconstant first selection (CFS), minimum migration time (MMT), random choice (RC) and maximum correlation (MC). Findings: FuMAEVMS as Novel VM selection capable to decide which VM that should be migrate from overload host in various condition VM instances that gives improvement of energy efficiency in cloud data center. We analyze the used of fuzzy logic in categorizing attribute VM capable to help in minimize rules production in Markov Normal Algorithm. This condition gives benefit to MA in deciding suitable existing VM selection such as CFS, MMT or MC to be used in migrating VM. Improvement: Results experiment has showed FuMAEVMS VM selection capable to reduced energy consumption in cloud data center significantly up to 4.45% when applied in dynamic VM consolidation compared with RC, MMT and MC.

Cloud computing is the combination of grid computing, distributed computing and utility computing. Cloud computing provides various types of services (servers and storage facility) in the on demand basis. The main goal of the cloud computing is to preserve and organize the very huge data center or data forms. The data forms are composed of thousands of servers that absorb the giant (ample) amount of electricity in the word of energy. The decreasing the energy consumption in datacenter is the major challenge in cloud computing now a day. This research article is going to address the problem of high energy consumption at datacenter. Concentrate on virtual machine scheduling in cloud datacenter with Dynamic Voltage Frequency Scaling (DVFS) approach. We have combined shortest job first and Round Robin algorithms with Vibrant Quantum. This combination of algorithm is considered as shortest round vibrant queue (SRVQ) algorithm. SRVQ reduces the waiting time of the scheduling process and minimize the starvation. The DVFS and SRVQ worked together and produced fruitful results in the final experiments. This work reduced the server’s energy consumption in the cloud data center. In the final results, our proposed framework exhibits 45% of energy efficiency compare to other previously proposed algorithms. 33% of QoS performance were enhanced by our framework.

Cloud computing is rapidly taking over the information technology industry because it makes computing a lot easier without worries of buying the physical hardware needed for computations, rather, these services are hosted by companies with provide the cloud services. These companies contain a lot of computers and servers whose main source of power is electricity, hence, design and maintenance of these companies is dependent on the availability of steady and cheap electrical power supply. Cloud centers are energy-hungry. With recent spikes in electricity prices, one of the main challenges in designing and maintenance of such centers is to minimize electricity consumption of data centers and save energy. Efficient data placement and node scheduling to offload or move storage are some of the main approaches to solve these problems. In this article, we propose an Extreme Gradient Boosting (XGBoost) model to offload or move storage, predict electricity price, and as a result reduce energy consumption costs in data centers. The performance of this method is evaluated on a real-world dataset provided by the Independent Electricity System Operator (IESO) in Ontario, Canada, to offload data storage in data centers and efficiently decrease energy consumption. The data is split into 70% training and 30% testing. We have trained our proposed model on the data and validate our model on the testing data. The results indicate that our model can predict electricity prices with a mean squared error (MSE) of 15.66 and mean absolute error (MAE) of 3.74% respectively, which can result in 25.32% cut in electricity costs. The accuracy of our proposed technique is 91% while the accuracy of benchmark algorithms RF and SVR is 89% and 88%, respectively.

The potential of different charging strategies for electricity cost reductions of electric buses is investigated while accounting for uncertain operational factors in electricity consumption such as ambient temperature, wind speed, and day of the week. A model is developed that calculates the total electricity costs for five different charging strategies by employing deterministic and stochastic optimisation approaches that are able to deal with uncertainty. The developed model is applied to a case study based on an operational area of a Dutch bus operator. The simulation results for the tested charging strategies indicate a significant potential for total electricity cost reduction up to 35% and peak power reduction up to 58% on a monthly basis, given the input data and assumptions. The analysis provides insights on various charging strategies for electric buses and potential operational cost reduction, which outweigh the high capital cost, and supports future applications.

Virtual machine (VM) consolidation is an effective way to improve resource utilization and reduce energy consumption in cloud data centers. Most existing studies have considered VM consolidation as a bin-packing problem, but the current schemes commonly ignore the long-term relationship between VMs and hosts. In addition, there is a lack of long-term consideration for resource optimization in the VM consolidation, which results in unnecessary VM migration and increased energy consumption. To address these limitations, a VM consolidation method based on multi-step prediction and affinity-aware technique for energy-efficient cloud data centers (MPaAFVMC) is proposed. The proposed method uses an improved linear regression prediction algorithm to predict the next-moment resource utilization of hosts and VMs, and obtains the stage demand of resources in the future period through multi-step prediction, which is realized by iterative prediction. Then, based on the multi-step prediction, an affinity model between the VM and host is designed using the first-order correlation coefficient and Euclidean distance. During the VM consolidation, the affinity value is used to select the migration VM and placement host. The proposed method is compared with the existing consolidation algorithms on the PlanetLab and Google cluster real workload data using the CloudSim simulation platform. Experimental results show that the proposed method can achieve significant improvement in reducing energy consumption, VM migration costs, and service level agreement (SLA) violations.

Energy intensity is one of the most important energy feature that has a dramatic value in energy system of Iran. Indeed, Iran is one of the most energy intensive countries in the world and its main reason is related to high energy consumption in household section. In this article, we present a non-linear model that considers three scenarios in management of household energy demand reducing. Therefore, a rational percentage of energy consumption reduction in the household sector, which firstly eliminates the imbalance between energy production and consumption, and secondly, derives a rational amount of profit from various reduction scenarios, will be presented. The mentioned rational profits in this article are obtained from three scenarios. In the first scenario, it is assumed that the percentage reduction in household energy consumption will be allocated to reducing energy demand in the industrial sector, resulting in profits from value-added creation in this sector. In the second scenario, all benefits from reducing energy consumption in the household sector will be devoted to energy exports, yielding profits from this source. Finally, in the third scenario, the reduction in energy consumption will lead to a decrease in energy supply and consequently a reduction in energy supply costs. To conduct a comprehensive study, a combination of the mentioned scenarios has also been modeled and investigated. The model results indicate that with a 25% reduction in household energy consumption in the 2024-2034 timeframe, the energy imbalance will be eliminated, and allocating 5% of this reduction entirely to the industrial sector will result in profits equivalent to $164.18 billion. However, it should be noted that in the considered combined scenarios, the greater the share of the first scenario, the higher the resulting profit, and the optimal point is achieved in the first scenario.

Energy-efficient resource allocation in cloud infrastructure using L3F-MGA and E-ANFIS

High energy consumption in data center has serious impacts on environment. Energy-efficient scheduling under Customer Satisfaction Level (CSL) constraint has become a key problem of cloud computing in data centers. In this paper, a CSL-driven and energy-efficient resource scheduling (CDEERS) framework has been designed to optimize energy efficiency and CSL in cloud data centers. To achieve different goals in different CSL states, three scheduling strategies (aiming to minimize energy saving, maximize CSL and maximize CSL per energy, respectively) are auto-adaptively applied to consolidate resources according to CSL states. To identify CSL states, a metric based on Service Level Agreement (SLA) violation rate (MSVR) is designed and applied in the proposed method. Additionally, the Weighted Moving Average (WMA) model is applied to predict the future state of CSL and optimize the resource allocation. Simulation result shows that the MSVR improves energy efficiency (CSL per energy) by 51.1% and 30.4% compared with traditional metric based on workload (MW) and metric based on response time (MRT), respectively, during the whole test period. It reduces the SLA violation rate by 7.9% and the number of host overloads by 9.6%, respectively, while prediction mechanism is applied. It shows that CDEERS has better energy efficiency than these static scheduling methods with single objection in the condition of dynamic state of CSL.

Per-user pricing is possible with cloud computing, a relatively new technology. It provides remote testing and commissioning services through the web, and it utilizes virtualization to make available computing resources. In order to host and store firm data, cloud computing relies on data centers. Data centers are made up of networked computers, cables, power supplies, and other components. Cloud data centers have always had to prioritise high performance over energy efficiency. The biggest obstacle is finding a happy medium between system performance and energy consumption, namely, lowering energy use without compromising system performance or service quality. These results were obtained using the PlanetLab dataset. In order to implement the strategy we recommend, it is crucial to get a complete picture of how energy is being consumed in the cloud. Using proper optimization criteria and guided by energy consumption models, this article offers the Capsule Significance Level of Energy Consumption (CSLEC) pattern, which demonstrates how to conserve more energy in cloud data centers. Capsule optimization's prediction phase F1-score of 96.7 percent and 97 percent data accuracy allow for more precise projections of future value.