Multi-processor architectural support for protecting virtual machine privacy in untrusted cloud environment

In cloud computing, it is often assumed that cloud vendors are trusted; the guest Operating System (OS) and the Virtual Machine Monitor (VMM, also called Hypervisor) are secure. However, these assumptions are not always true in practice and existing approaches cannot protect the data privacy of applications when none of these parties are trusted. We investigate how to cope with a strong threat model which is that the cloud vendors, the guest OS, or the VMM, or both of them are malicious or untrusted, and can launch attacks against privacy of trusted user applications. This model is relevant because applications may be small enough to be formally verified, while the guest OS and VMM are too complex to be formally verified. Specifically, we present the design and analysis of an architectural solution which integrates a set of components on-chip to protect the memory of trusted applications from potential software and hardware based attacks from untrusted cloud providers, compromised guest OS, or malicious VMM. Full-system performance evaluation results show that the design only incurs 9 percent overhead on average, which is a small performance price that is paid for the substantial security gain.

In conventional virtualized systems, a hypervisor can access the memory pages of guest virtual machines without any restriction, as the hypervisor has a full control over the address translation mechanism. In this paper, we propose Secure MMU, a hardware-based mechanism to isolate the memory of guest virtual machines from unauthorized accesses even from the hypervisor. The proposed mechanism extends the current nested paging support for virtualization with a small hardware cost. With Secure MMU, the hypervisor can flexibly allocate physical memory pages to virtual machines for resource management, but update nested page tables only through the secure hardware mechanism, which verifies each mapping change. With the hardware-rooted memory isolation among virtual machines, the memory of a virtual machine in cloud computing can be securely protected from a compromised hypervisor or co-tenant virtual machines.

Aiming at the problem that virtual machine information cannot be extracted incompletely, we extend the typical information extraction model of virtual machine and propose a perception mechanism in virtualization system based on storage covert channel to overcome the affection of the semantic gap. Taking advantage of undetectability of the covert channel, a secure channel is established between Guest and virtual machine monitor to pass data directly. The Guest machine can pass the control information of malicious process to virtual machine monitor by using the VMCALL instruction and shared memory. By parsing critical information in process control structure, virtual machine monitor can terminate the malicious processes. The test results show that the proposed mechanism can clear the user-level malicious programs in the virtual machine effectively and covertly. Meanwhile, its performance overhead is about the same as that of other mainstream monitoring mode.

The container as a service is a new trend in the world of technology before the virtual machines were used but now, the CaaS has replaced all these and now it is gaining immense popularity. The researchers conducted before concentrated on virtual machines placed over physical machines or containers. But now this practice leads to the underutilized or over-utilized physical machines and virtual machines too. The main objective of this examination is to the usage of the assets as far as CPU's and memory size of the Virtual machine and Physical machines and instantly minimizes the number of used physical machines and virtual machines in the cloud environment. This proposed architecture will analyze the good fit (GF) and large fit (LF) based on a good fit with a given fitness function. And as a resultant the proposed Ant colony optimization (ACO) – GF placement algorithm performs when compared to GF and LF and maintains significant improvements and positive results.

Multi-tenant clouds enhance resource sharing among Virtual Machines (VMs) to boost overall utilization and reduce power consumption. However, this also introduces interference among workloads from different tenants and impedes VM performance isolation. In this paper, we first demonstrate that the last-level cache (LLC) in CPUs, which is inherently shared by all VMs on the same physical machine, becomes a significant contending resource for LLC-critical workloads, leading to notable performance imbalances under the default hardware caching strategy. Although recent studies on LLC scheduling have progressed, they often require detailed profiling of user workloads or rely on hyperparameter tuning, limiting their applicability to private clusters or specific scenarios. We propose SpiderSense, a software-initiated LLC partitioner for managing Virtual Machine Monitors (VMM), to address these limitations. SpiderSense leverages modern yet off-the-shelf server CPU features to adaptively orchestrate LLC allocation among running black-boxed user VMs. SpiderSense dynamically samples VMs and calculates their fair share of LLC to allocate them while fully improving performance isolation among VMs. We experiment with SpiderSense using typical LLC-critical workloads, representative of the types of applications that stress LLC performance, such as Memcached and Llama. Our results show that SpiderSense improves performance by up to 40% in numerous colocation scenarios compared to current solutions.

Cloud computing systems routinely process users' confidential data, but the underlying virtualization software in use today is not constructed to minimize the exposure of such data. For instance, virtual machine (VM) checkpointing can drastically prolong the lifetime and vulnerability of confidential data without users' knowledge by storing such data as part of a persistent snapshot. A key requirement for minimizing the exposure of any data is the ability to cleanly isolate such data for either exclusion or processing. Traditional mechanisms for memory taint tracking are expensive whereas those for isolating application footprint in VM-based sandboxes are not transparent. In this paper, we propose a transparent and lightweight mechanism for isolating a confidential application's memory footprint in a VM. The key idea is for a parent VM to spawn a child VM, called a Privacy-preserving Virtual Machine (PPVM) within which the confidential application executes. Hypervisor features, such as VM checkpointing, that need to exclude the memory of a confidential application can safely ignore the child VM's memory footprint. Alternatively, features such as checkpoint encryption or malware tracking can operate only on the child VM's memory. We implement memory isolation for PPVM through a lightweight VM fork operation that uses copy-on-write to reduce the memory and filesystem overhead of the PPVM. Transparency is achieved through a confidential shell that allows the parent VM to spawn the confidential application in the PPVM and exercise control over it during runtime. We demonstrate the effectiveness of PPVM through its use with VM checkpointing, which can safely checkpoint the parent VM while excluding or encrypting the associated PPVM. We show that our PPVM implementation achieves effective memory isolation with low overheads on memory, CPU, and network performance.

In this paper, we consider virtual machine (VM) placement problem for cloud data centers. Different from previous works, the VMs considered need to be conducted within a finite duration. However, due to the limited resource at physical machines (PMs), the VM may be unable to place on a single PM within duration. To make sure the successful placement, the VM may undergo several PMs for service, e.g., it is run on one PM at this time, while migrated to another PM next time. Migrating the VM from one PM to another incurs extra cost, e.g., the bandwidth. In this paper, we formulate a joint optimization problem, which maximizes the revenue of successfully placing the VMs, and minimizes the total number of migrations for the VMs. We prove it is NP-hard, and show that the minimum number of migrations for each VM under the resource constraint of PMs is equivalent to finding a shortest path problem. We then design a heuristic algorithm, which considers both the revenue and the minimum number of migrations required for the VM. We also design a 1 over 2-approximation algorithm for a special case of the problem. Finally, we demonstrate the effectiveness of the proposed scheme through simulations.

Modern data centers use virtual machine based implementation for numerous advantages like resource isolation, hardware utilization, security and easy management. Applications are generally hosted on different virtual machines on a same physical machine. Virtual machine monitor like Xen is a popular tool to manage virtual machines by scheduling them to use resources such as CPU, memory and network. Performance isolation is the desirable thing in virtual machine based infrastructure to meet service level objectives. Many experiments in this area measure the performance of applications while running the applications in different domains, which gives an insight into the problem of isolation. In this paper we run different kind of benchmarks simultaneously in Xen environment to evaluate the isolation strategy provided by Xen. Results are presented and discussed for different combinations and a case of I/O intensive applications with low response latency has been presented.

Scheduling virtual machines is a major research topic for cloud computing, because it directly influences the performance, the operation cost and the quality of services. A large cloud center is normally equipped with several hundred thousand physical machines. The mission of the scheduler is to select the best one to host a virtual machine. This is an NPhard global optimization problem with grand challenges for researchers. This work studies the Virtual Machine (VM) scheduling problem on the cloud. Our primary concern with VM scheduling is the energy consumption, because the largest part of a cloud center operation cost goes to the kilowatts used. We designed a scheduling algorithm that allocates an incoming virtual machine instance on the host machine, which results in the lowest energy consumption of the entire system. More specifically, we developed a new algorithm, called vision cognition, to solve the global optimization problem. This algorithm is inspired by the observation of how human eyes see directly the smallest/largest item without comparing them pairwisely. We theoretically proved that the algorithm works correctly and converges fast. Practically, we validated the novel algorithm, together with the scheduling concept, using a simulation approach. The adopted cloud simulator models different cloud infrastructures with various properties and detailed runtime information that can usually not be acquired from real clouds. The experimental results demonstrate the benefit of our approach in terms of reducing the cloud center energy consumption

Cloud computing is a very well known technology for all business people, software developers, end-users, and so on. Significant researches are going on to balance the cloud load. The migration of heavily loaded Virtual Machines (VMs) into lightly loaded Physical Machines (PMs) balances the Cloud load. In Resource Intensity Aware Load Balancing (RIAL) method, based on the weight of resources under utilization, it selected the VMs from heavily loaded PMs for migration and chosen the lightly loaded PMs as destination. An Improved RIAL was proposed to consider both lightly and heavily loaded PMs as destination. Later it was enhanced in the proposed Power Consumption Aware- Traffic Aware- IRIAL (PT-IRIAL) method with the consideration of power consumption, temperature and traffic measures to select the VMs for migration and select PMs for destination. From all these, in this current paper, the crossover and mutation process of GA is utilized to optimally select the migration VMs and choose the destination PMs. Thus this GA based load optimization algorithm optimally maps the migration VMs with the destination PMs efficiently.

High availability is the most important and challenging problem for cloud providers. However, virtual machine monitor (VMM), a crucial component of the cloud infrastructure, has to be frequently updated and restarted to add security patches and new features, undermining high availability. There are two existing live update methods to improve the cloud availability: kernel live patching and Virtual Machine (VM) live migration. However, they both have serious drawbacks that impair their usefulness in the large cloud infrastructure: kernel live patching cannot handle complex changes (e.g., changes to persistent data structures); and VM live migration may incur unacceptably long delays when migrating millions of VMs in the whole cloud, for example, to deploy urgent security patches. In this paper, we propose a new method, VMM live upgrade, that can promptly upgrade the whole VMM (KVM & QEMU) without interrupting customer VMs. Timely upgrade of the VMM is essential to the cloud because it is both the main attack surface of malicious VMs and the component to integrate new features. We have built a VMM live upgrade system called Orthus. Orthus features three key techniques: dual KVM, VM grafting, and device handover. Together, they enable the cloud provider to load an upgraded KVM instance while the original one is running and cut-and-paste'' the VM to this new instance. In addition, Orthus can seamlessly hand over passthrough devices to the new KVM instance without losing any ongoing (DMA) operations. Our evaluation shows that Orthus can reduce the total migration time and downtime by more than $99%$ and $90%$, respectively. We have deployed Orthus in one of the largest cloud infrastructures for a long time. It has become the most effective and indispensable tool in our daily maintenance of hundreds of thousands of servers and millions of VMs.

Infrastructure-as-a-Service (IaaS) clouds have become more popular enabling users to run applications under virtual machines. This paper investigates the energy-aware virtual machine (VM) allocation problems in IaaS clouds along characteristics: multiple resources, and fixed interval times and non-preemption of virtual machines. Many previous works proposed to use a minimum number of physical machines, however, this is not necessarily a good solution to minimize total energy consumption in the VM placement with multiple resources, fixed interval times and non-preemption. We observed that minimizing total energy consumption of physical machines is equivalent to minimize the sum of total completion time of all physical machines. Based on the observation, we propose EMinRET algorithm. The EMinRET algorithm swaps an allocating VM with a suitable overlapped VM, which is of the same VM type and is allocated on the same physical machine, to minimize total completion time of all physical machines. The EMinRET uses resource utilization during executing time period of a physical machine as the evaluation metric, and will then choose a host that minimizes the metric to allocate a new VM. In addition, this work studies some heuristics for sorting the list of virtual machines (e.g., sorting by the earliest starting time, or the longest duration time first, etc.) to allocate VM. Using the realistic log-trace in the Feitelson's Parallel Workloads Archive, our simulation results show that the EMinRET algorithm could reduce from 25% to 45% energy consumption compared with power-aware best-fit decreasing (PABFD) [1]) and vector binpacking norm-based greedy algorithms (VBP-Norm-L1/L2 [2]). Moreover, the EMinRET heuristic has also less total energy consumption than our previous heuristics (e.g. MinDFT and EPOBF) in the simulations (using same virtual machines sorting method).

Multiple instances of virtual machines can run on a single physical host sharing hardware and software resources in cloud computing. One of the resources that is shared among multiple Virtual Machines (VM) in the cloud is Cache. Such Virtual machines are targeted for an abnormal activity like side channel attack. Cache-based side channel attack is one of the side channel attack in cloud environment which leaks the private information of the client. The proposed approach includes the detection and mitigation of cache-based side channel attack in cloud infrastructure. The proposed approach comprises of three components: a collection of virtual machine status, the Fuzzy controller to detect attack and mitigation. The fuzzy rule-based controller is incorporated in this approach to identify the cache-attack on the log file. This system works dynamically to prevent cache attacks on the cloud environment and will incur very small overhead in performance.

By employing the virtual machines (VMs) consolidation technique at a virtualized data center, optimal mapping of VMs to physical machines (PMs) can be performed. The type of optimization approach and the policy of detecting the appropriate time to implement the consolidation process are influential in the performance of the consolidation technique. In a majority of researches, the consolidation approach merely focuses on the management of underloaded or overloaded PMs, while a number of VMs could also be in an underload or overload state. Managing an abnormal state of VM results in the postponement of PM getting into an abnormal state as well and affects the implementation time of the consolidation process. For the aim of optimal VM consolidation in this research, a self-adaptive architecture is presented to detect and manage underloaded and overloaded VMs /PMs in reaction to workload changes in the data center. The goal of consolidation process is employing the minimum number of active VMs and PMs, while guaranteeing the quality of service (QoS). Assessment criteria of QoS are two parameters including average number of requests in the PM buffer and average waiting time in the VM. To evaluate these two parameters, a probabilistic model of the data center is proposed by applying the queuing theory. The assessment results of the probabilistic model form a basis for decision-making in the modules of the proposed architecture. Numerical results obtained from the assessment of the probabilistic model via discrete-event simulator under various parameter settings confirm the efficiency of the proposed architecture in achieving the aims of the consolidation process.

In virtualized datacenters (vDCs), dynamic consolidation of virtual machines (VMs) is used to achieve both energy-efficiency and load balancing among different physical machines (PMs). Using VM live migrations, we can consolidate VMs on a smaller number of hosts to power down unused PMs and save energy. Most migration schemes are however oblivious to the characteristics of services that run inside VMs, and thus may lead to migrations where VMs competing for the same resource type are packed on the same PM. As a result, VMs may suffer from significant resource contention and noticeable degradation in their performance. Using resource sensitivity values of VMs (i.e., quantitative measures to reflect how much a VM is sensitive to its requested resources such as CPU, Mem, and Disk), we have designed a novel VM consolidation approach to optimize placement of VMs on available PMs. We validated our approach using five well-known applications/benchmarks with various resource demand signatures: varying from pure CPU/Mem/Disk-intensive to mixtures of them. Our extensive numerical evaluation illustrates that, for the same power consumption, our approach improve the performance of cloud services by 9 - 12%, on average, when compared with current sensitivity oblivious approaches.