Online Cloud Performance Prediction with Machine Learning

Virtual machine placement (VMP) technology is widely used in cloud computing systems. The existing VMP methods mainly aimed at improving the cloud resource utilization, such as load balancing among physical machines (PMs), but they may result in virtual machine (VM) performance degradation because of the great resource contention among VMs running on top of the same PM. In contract to existing VMP algorithms, this paper proposes a virtual machine (VM) Performance maximization and physical machine (PM) Load balancing Virtual Machine Placement method (PLVMP) in cloud, which tries to maximize VM performance and balance PM workload from both users’ and cloud providers’ perspectives. First, we study the relationship between PM workload and VM performance to train a new and improved VM performance model, which can predict VM performance more accurately and offer help to the following VMP. Second, we take VM performance maximization and PM workload balancing into account to formulate the VMP as an optimization problem, which tries to maximize VM performance for users and make load balancing among PMs for cloud providers. Third, we propose a greedy-based algorithm to solve the VMP problem efficiently. We then evaluate PLVMP with other VMP methods on CloudSim platform and a real OpenStack platform. The results show PLVMP can maximize the VM performance significantly and make a good load balancing among PMs.

This paper addresses the impact of Virtual Memory Streaming (VMS) technique in provisioning virtual machines (VMs) in cloud environment. VMS is a scaling virtualization technology that allows different virtual machines rapid scale, high performance, and increase hardware utilization. Traditional hypervisors do not support true no-downtime live migration, and its lack of memory oversubscription can hurt the economics of a private cloud deployment by limiting the number of VMs on each host. VMS brings together several advanced hypervisor memory management techniques including granular page sharing, dynamic memory footprint management, live migration, read caching, and a unique virtual machine cloning capability. An architecture model is described, together with a proof-of-concept implementation, that VMS dynamically scaling of virtualized infrastructure with true live migration and cloning of VMs. This paper argues that VMS for Cloud allows requiring significantly reduced server memory and reducing the time for virtualized resource scaling by instantly adding more virtual machines.

In virtualized environments, the customers who purchase virtual machines (VMs) from a third-party cloud would expect that their VMs run in an isolated manner. However, the performance of a VM can be negatively affected by co-resident VMs. In this paper, the authors propose vExplorer, a distributed VM I/O performance measurement and analysis framework, where one can use a set of representative I/O operations to identify the I/O scheduling characteristics within a hypervisor, and potentially leverage this knowledge to carry out I/O based performance attacks to slow down the execution of the target VMs. The authors evaluate their prototype on both Xen and VMware platforms with four server benchmarks and show that vExplorer is practical and effective. The authors also conduct similar tests on Amazon’s EC2 platform and successfully slow down the performance of target VMs.

In elastic cloud computing environment, multiple virtual machines may reside in the same physical machine for services consolidation. For the same residential guest domains or multi-tiered hosting services, the inter-domain communications are complex and frequent. However, traditional inter-domain communications are conducted through the virtual network interfaces of both sending and receiving virtual machines. Such TCP/IP networking communications involve lengthy communication path and frequent kernel interactions and thus downgrade the I/O performance of virtual machines. In this paper, we present an optimized inter-domain communication approach based on shared memory to improve the communication performance of multiple virtual machines residing in the same physical machine. In our approach, the sending data is shared in memory, not transferred via TCP/IP stack. The communication data are directly mapped into user space of the virtual machine and therefore it reduces useless system calls and context switches. The memory is shared via a customized shared device kernel module with bidirectional event channel resided in both communicating virtual machines. We use state flags in circular buffer to reduce wait and notify operations and thus reduce the system calls. Experiments show that our proposed approach can provide 5 time higher throughput and 2.5 times less latency compared to TCP/IP communication path.

Heating, ventilation, and air-conditioning (HVAC) systems are among the most energy-intensive components in commercial buildings. Accurate forecasting of HVAC energy consumption is essential for implementing energy-efficient control strategies. This study provides a detailed comparative analysis of classical machine learning (ML) and deep learning (DL) models for forecasting HVAC energy consumption using both predicted and actual indoor temperature data. Leveraging an open-source, high-resolution dataset from the Oak Ridge National Laboratory's FRP-2 multizone building, we implement a two-stage framework. The first stage involves temperature prediction using relative humidity and airflow data, while the second stage forecasts HVAC energy consumption using either predicted or actual temperature inputs. We evaluate Linear Regression, Random Forest, Support Vector Machine, GRU, and LSTM models. The results reveal that while models with actual temperature inputs yield superior accuracy (R² up to 0.884), models using predicted temperatures still achieve competitive performance. Our findings suggest that ML and DL models, particularly LSTM, offer promising capabilities for real-time energy forecasting in smart building environments.

A comprehensive deep learning model for motor phenotypes of Parkinson's disease using three-dimensional kinect V2 detectors.

Purpose – The physical server transition to virtualized infrastructure server have encountered crucial problems such as server consolidation, virtual machine (VM) performance, workload density, total cost of ownership (TCO), and return on investments (ROIs). In order to solve the problems mentioned above, the purpose of this paper is to perform the analysis of virtualized cloud server together with shared storage as well as the estimation of consolidation ratio and TCO/ROI in server virtualization. Design/methodology/approach – This paper introduces five distinct virtualized cloud computing servers (VCCSs), and provides the appropriate assessment to five well-known hypervisors built in VCCSs. The methodology the authors proposed in this paper will gives people an insight into the problem of physical server transition to virtualized infrastructure server. Findings – As a matter of fact, VM performance seems almost to achieve the same level, but the estimation of VM density and TCO/ROI are totally different among hypervisors. As a result, the authors have the recommendation to choose the hypervisor ESX server if you need a scheme with higher ROI and lower TCO. Alternatively, Proxmox VE would be the second choice if you like to save the initial investment at first and own a pretty well management interface at console. Research limitations/implications – In the performance analysis, instead of ESX 5.0, the authors adopted ESXi 5.0 that is free software, its function is limited, and does not have the full functionality of ESX server, such as: distributed resource scheduling, high availability, consolidated backup, fault tolerance, and disaster recovery. Moreover, this paper do not discuss the security problem on VCCS which is related to access control and cryptograph in VMs to be explored in the further work. Practical implications – In the process of virtualizing the network, ESX/ESXi has restrictions on the brand of the physical network card, only certain network cards can be detected by the VM. For instance: Intel and Broadcom network cards. The newer versions of ESXi 5.0.0 and above now support parts of Realtek series (Realtek 8186, Realtek 8169, and Realtek 8111E). Originality/value – How to precisely assess the hypervisor for server/desktop virtualization is also of hard question needed to deal with it crisply before deploying new IT with VCCS on site. The authors have utilized the VMware calculator and developed an approach to server/desktop consolidation, virtualization performance, VM density, TCO, and ROIs. As a result, in this paper the authors conducted a comprehensive approach to analyze five well-known hypervisors and will give the recommendation for IT manager to choose a right solution for server virtualization.

Public Clouds are the backbone of the modern IT Industry. The modern tech start-ups to are heavily dependent on the Public Clouds as save the capital expenditure. Public Clouds offer a wide range of Virtual Infrastructure beginning from single core 0.25 GB RAM virtual machines to 128 cored 3904 GB RAM Virtual Servers aided with GPUs. Apart from costing, The performance of the virtual machines can impact on the services offered. The paper tries to analyse the performance of the Light virtual machines provided by the different cloud vendors and maps their ability to handle certain set of tasks. The prime objective is to compare the entry level virtual machines that are mostly used across the industry for the multiple purposes and find which is the efficient and productive. The systems under Test are the 1 GB RAM machines provided by the most popular Cloud service providers.

Ambient air pollution affects human health, vegetative growth and sustainable socio-economic development. Therefore, air pollution data in Dezhou City in China are collected from January 2014 to December 2023, and multiple deep learning models are used to forecast air pollution PM2.5 concentrations. The ability of the multiple models is evaluated and compared with observed data using various statistical parameters. Although all eight deep learning models can accomplish PM2.5 forecasting assignments, the precision accuracy of the CNN-GRU-LSTM forecasting method is 34.28% higher than that of the ANN forecasting method. The result shows that CNN-GRU-LSTM has the best forecasting performance compared to the other seven models, achieving an R (correlation coefficient) of 0.9686 and an RMSE (root mean square error) of 4.6491 μg/m3. The RMSE values of CNN, GRU and LSTM models are 57.00%, 35.98% and 32.78% higher than that of the CNN-GRU-LSTM method, respectively. The forecasting results reveal that the CNN-GRU-LSTM predictor remarkably improves the performances of benchmark CNN, GRU and LSTM models in overall forecasting. This research method provides a new perspective for predictive forecasting of ambient air pollution PM2.5 concentrations. The research results of the predictive model provide a scientific basis for air pollution prevention and control.

The creation of a water quality monitoring by digital image analysis and developments in prawn farming and aquaculture in Kothapatnam, Ongole, Andhra Pradesh are both covered in this extensive research. In order to manage aquaculture in a sustainable and profitable manner, water quality prediction (WQP) is essential. This study presents new deep learning (DL) models for aquaculture WQP that combine CNN, LSTM, and GRU, and are specifically designed for this purpose. While GRU and LSTM are great at learning long-term relationships in time series data, CNNs are great at capturing the features of aquaculture water quality. By running trials on two separate water quality datasets, we were able to thoroughly examine how hyperparameters affected the performance of these hybrid DL models. The suggested CNN, LSTM & GRU hybrid models are tested against CNN, LSTM, and GRU models. In terms of computing speed and prediction accuracy, our research shows that the hybrid LSTM model is the best option for forecasting aquaculture water quality.

Cloud computing manages system resources such as processing, storage, and networking by providing users with multiple virtual machines (VMs) as needed. It is one of the rapidly growing fields that come with huge computational power for scientific workloads. Currently, the scientific community is ready to work over the cloud as it is considered as a resource-rich paradigm. The traditional way of executing scientific workloads on cloud computing is by using virtual machines. However, the latest emerging concept of containerization is growing more rapidly and gained popularity because of its unique features. Containers are treated as lightweight as compared to virtual machines in cloud computing. In this regard, a few VMs/containers-associated problems of performance and throughput are encountered because of middleware technologies such as virtualization or containerization. In this paper, we introduce the configurations of VMs and containers for cloud-based scientific workloads in order to utilize the technologies to solve scientific problems and handle their workloads. This paper also tackles throughput and efficiency problems related to VMs and containers in the cloud environment and explores efficient resource provisioning by combining four unique methods: hyperthreading (HT), vCPU cores selection, vCPU affinity, and isolation of vCPUs. The HEPSCPEC06 benchmark suite is used to evaluate the throughput and efficiency of VMs and containers. The proposed solution is to implement four basic techniques to reduce the effect of virtualization and containerization. Additionally, these techniques are used to make virtual machines and containers more effective and powerful for scientific workloads. The results show that allowing hyperthreading, isolation of CPU cores, proper numbering, and allocation of vCPU cores can improve the throughput and performance of virtual machines and containers.

The rapid development of urban industrialization has had many negative effects on the quality of water sources around cities. Long-term prediction of water quality can be of great help to the conservation of water environment. This case tries to use several popular deep learning models, such as RNN, LSTM, MLP, and Transformer-based models to predict the long-term integrated water quality index in the Chaohu Lake area. The dataset is derived from daily monitoring data from four monitoring sites within Chaohu Lake from 2019 to 2022, and the long-term prediction performance of the model is evaluated using MAE and MSE as evaluation metrics. The experimental results showed that all models selected in this case achieved good results within the study area, but Informer performed more prominently (MSE = 0.2455, MAE = 0.2449) as the length of the prediction series increased. Our results demonstrate the effectiveness of popular deep learning models in the field of WQI prediction, especially the significant advantage of transformer-based models represented by Informer in long-term water quality prediction, which will further provide an effective modern tool for water quality monitoring and management.

Cloud service providers offer virtual machines (VMs) as services to users over Internet. As VMs are running on physical machines (PMs), PM power consumption needs to be considered. Meanwhile, VMs running on the same PM share physical resources, and there exists great resource contention, which results in VM performance degradation. Therefore, how to place VMs to reduce PM power consumption and guarantee VM performance is still one major challenge. However, existing VMPs did not study VM performance degradation, so they could not guarantee VM performance. To solve the high power consumption and VMs performance degradation problems, this paper explores the balance between saving PM power and guaranteeing VM performance, and proposes a power-aware and performance-guaranteed VMP (PPVMP). First, we investigate the relationship between power consumption and CPU utilization to build a non-linear power model, which is helpful for the following VMP. Second, we construct VM performance models to present the VM performance degradation trend. Third, based on these models, we formulate VMP as a bi-objective optimization problem, which tries to minimize PM power consumption and guarantee VM performance. We then propose an algorithm based on ant colony optimization to solve it. Finally, the results show the efficiency of our algorithm.

The widely distributed “Step-type” landslides in the Three Gorges Reservoir (TGR) area have caused serious casualties and heavy economic losses. The prediction research of landslide displacement will be beneficial to the establishment of local geological hazard early warning systems for the realization of scientific disaster prevention and mitigation. However, the number of observed data like landslide displacement, rainfall, and reservoir water level in this area is very small, which results in difficulties for the training of advanced deep learning model to obtain more accurate prediction results. To solve the above problems, a Two-stage Combined Deep Learning Dynamic Prediction Model (TC-DLDPM) for predicting the typical “Step-type” landslides in the TGR area under the condition of small samples is proposed. The establishment process of this method is as follows: (1) the Dynamic Time warping (DTW) method is used to enhance the small samples of cumulative displacement data obtained by the Global Positioning System (GPS); (2) A Difference Decomposition Method (DDM) based on sequence difference is proposed, which decomposes the cumulative displacement into trend displacement and periodic displacement, and then the cubic polynomial fitting method is used to predict the trend displacement; (3) the periodic displacement component is predicted by the proposed TC-DLDPM model combined with external environmental factors such as rainfall and reservoir water level. The TC-DLDPM model combines the advantages of Convolutional Neural Network (CNN), Attention mechanism, and Long Short-term Memory network (LSTM) to carry out two-stage learning and parameter transfer, which can effectively realize the construction of a deep learning model for high-precision under the condition of small samples. A variety of advanced prediction models are compared with the TC-DLDPM model, and it is verified that the proposed method can accurately predict landslide displacement, especially in the case of drastic changes in external factors. The TC-DLDPM model can capture the spatio-temporal characteristics and dynamic evolution characteristics of landslide displacement, reduce the complexity of the model, and the number of model training calculations. Therefore, it provides a better solution and exploration idea for the prediction of landslide displacement under the condition of small samples.

As the size of data increases and computation becomes complicated in fog computing environments, the need for highperformance computation is increasing. One of the most popular ways to improve the performance of a virtual machine (VM) is to allocate a graphic processing unit (GPU) to the VM for supporting general purpose computing on graphic processing unit (GPGPU) operations. The direct pass-through, often used for GPUs in VMs, is popular in the cloud because VMs can use the full functionality of the GPU and experience virtually no performance degradation owing to virtualization. Direct pass-through is very useful for improving the performance of VMs. However, since the GPU usage time is not considered in the VM scheduler that operates based on the central processing unit (CPU) usage time of the VM, the VM performing the GPGPU operation degrades the performance of other VMs. In this paper, we analyze the effect of the VM performing the GPGPU operation (GPGPU-intensive VM) on other VMs through experiments. Then, we propose a method to mitigate the performance degradation of other VMs by dynamically allocating the resource usage time of the VM and preventing the priority preemption of the GPGPU-intensive VM.