Online Flow Scheduling with Deadline for Energy Conservation in Data Center Networks

Data Center Networks (DCNs) suffer from the congestions caused by unbalanced traffic distributions. Nevertheless, it is difficult to address such a challenge with the existent Ethernet-based DCN architecture. Wireless networking has been considered as a viable approach with a high potential to tackle the problem due to its flexibility. This paper presents Wireless Link Scheduling for Data Center Networks (WLS-DCN) to provide a feasible wireless DCN. More specifically, we propose a wireless DCN architecture as well as a scheduling mechanism. In our wireless scheduling, two different optimization objectives are considered, with one targeting the unbalanced traffic distribution and one maximizing the total network utility, under the constraints of limited wireless resources and co-channel interference. We propose two heuristics for the two problems and carry out extensive simulation study to validate the performance of our design. Our results demonstrate that WLSDCN can significantly improve the performance of DCN.

Online social networks (OSN) have become a prevalent communication tool with a user scale of billions. Users send messages and share photos and videos to their friends every day. As a consequence, a large amount of flows are produced by file storage and backup in the back end. Most flows are deadline intensive, and the scale of flow account is large; these characteristics create new challenges for flow scheduling in data center networks. In this study, we conclude the flow distribution of OSN based on previous studies. OSN flow can be classified into a large amount of bursty flow and a limited amount of large flow. The bursty mice flows are mostly critical real-time requirements, which support instant messages and routing information; the large flows seldom require real-time transmission, because they mainly support file transferring and updating. A mixed flow causes bottlenecks in rack switches easily, thereby resulting in deadline loss for real-time applications and lower throughput. The study divides flow based on different metrics and provides priority-based flow scheduling for OSN datacenter (PFO). PFO allocates rate for different flows on the basis of flow size and deadline information. Our objective is to decrease the average completion time for bursty flows and ensure a high throughput. The analysis and evaluation shows that the proposed scheduling increases the goodput more than DCTCP and D2TCP, and decreases the fraction of missed deadlines.

Traffic in today’s data center networks grows rapidly. Traditional routing and forwarding protocols in data center usually rely on static hashing, and may cause avoidable bottlenecks. We present a genetic algorithm to make better use of the resources. Our goal is to minimize the maximum single link utilization of the network. And results show that our algorithm performs better than a recent greedy algorithm.

Numerous scheduling approaches have been proposed to improve user experiences in a data center network (DCN) by reducing flow completion time (FCT). Mimicking the shortest job first (SJF) has been proved to be the prominent way to improve FCT. To do so, some approaches require flow size or completion time information in advance, which is not possible in scenarios like HTTP chunk transfer or database query response. Some information-agnostic schemes require involving end-hosts for counting the number of bytes sent. We present Longer Stay Less Priority (LSLP), an information-agnostic flow scheduling scheme, like Multi-Level Feedback Queue (MLFQ) scheduler in operating systems, that aims to mimic SJF using P4 switches in a DCN. LSLP considers all the flows as short flows initially and assigns them to the highest priority queue, and flows get demoted to the lower priority queues over time. LSLP estimates the active time of a flow by leveraging the state-of-the-art P4 switch’s programmable nature. LSLP estimates the active time of a group of new flows that arrive during a time interval and assigns their packets to the highest priority. At the beginning of the next time interval, arriving packets of old flows are placed one priority lower except for those already in the lowest priority queue. Therefore, short flows can be completed in the few higher priority queues while long flows are demoted to lower priority queues. We have evaluated LSLP via a series of tests and shown that its performance is comparable to the existing scheduling schemes.

The advent and continued growth of large data centers has led to much interest in switch architectures that can economically meet the high capacities needed for interconnecting the thousands of servers in these data centers. Various multilayer architectures employing thousands of switches have been proposed in the literature. We make use of the observation that the traffic in a data center is a mixture of relatively static and rapidly fluctuating components, and develop a combined scheduler for both these components using a generalization of the load-balanced scheduler. The presence of the known static component introduces asymmetries in the ingress-egress capacities, which preclude the use of a load-balanced scheduler as is. We generalize the load-balanced scheduler and also incorporate an opportunistic scheduler that sends traffic on a direct path when feasible to enhance the overall switch throughput. Our evaluations show that this scheduler works very well despite avoiding the use of a central scheduler for making packet-by-packet scheduling decisions.

Cloud applications have reshaped the model of services and infrastructure of the Internet. Search engines, social networks, content delivery and retail and e-commerce sites belong to this group of applications. An important element in the architecture of data centers where these applications run is the communication infrastructure, commonly known as data center networks (DCNs). A critical challenge DCNs have to address is the processing of the traffic of cloud applications, which due to its properties is essentially different to the traffic of other Internet applications. In order to improve the responsiveness and throughput of applications, DCNs should be able to prioritize short flows (a few kB) over long flows (several MB). However, given the time and space variations the traffic presents, the information about flow sizes is not available in advance in order to plan the flow scheduling. There has been a wealth of solutions developed in this space, and prior work includes flow scheduling mechanisms optimizing for a specific workload but fall short when workloads are not known in advance, or comprise a collection of applications changing dynamically. In this paper, we present an adaptable mechanism called Adaptable Workload-Agnostic Flow Scheduling (AWAFS). It is an adaptable approach that can adjust in an agnostic way the scheduling configuration of DCN forwarding devices. This agnostic adjustment contributes to reduce the Flow Completion Time (FCT) of those short flows, representing around 85% of the traffic handled by cloud applications. AWAFS operates by observing the traffic and detecting statistical properties that provide a hint to adapt the scheduling parameters. Our evaluation results based on simulation show that AWAFS can reduce the average FCT of short flows between 16.9% and 45.2% when compared to the best existing agnostic non-adaptable solution, without inducing starvation on long flows. Indeed, it can provide improvements as high as 39% for long flows. Additionally, AWAFS can improve the FCT for short flows in scenarios with high heterogeneity in the traffic present in the network, with a reduction up to 5% for the average FCT and 15% for the tail FCT.

In the data center network, mixed flows which have contradictory service requirements are transmitted simultaneously. Switches usually aggregate similar flows to the same queue after flow classification and schedule them using fair queuing and its extension schemes capable of flow isolation. These schemes implement diverse bandwidth allocation by assigning different weights to queues. Existing solutions rely on rich statistics such as packet arrival rate and delay to realize dynamic bandwidth allocation. However, many statistics are difficult to accurately measure or even obtain in real switches due to resource limitations. Providing differentiated services for mixed flows under such restrictions is still a challenge. To solve this issue, this paper proposed a reinforcement learning-based scheduling optimization (RLSO) mechanism. First, mixed flows scheduling is modeled as the Markov decision process (MDP) and Q-learning is used to find the approximate optimal solution with a few statistics. Second, the solution space is compressed to reduce the complexity of the algorithm and adapt to the limited performance of switches. Finally, the performance of the proposed mechanism is evaluated on a hardware testbed with workloads that include coarsegrained and fine-grained flows. The results show that RLSO can effectively schedule mixed flows.

Many data center applications perform rich and complex tasks (e.g., executing a search query or generating a user's news-feed). From a network perspective, these tasks typically comprise multiple flows, which traverse different parts of the network at potentially different times. Most network resource allocation schemes, however, treat all these flows in isolation -- rather than as part of a task -- and therefore only optimize flow-level metrics. In this paper, we show that task-aware network scheduling, which groups flows of a task and schedules them together, can reduce both the average as well as tail completion time for typical data center applications. To achieve these benefits in practice, we design and implement Baraat, a decentralized task-aware scheduling system. Baraat schedules tasks in a FIFO order but avoids head-of-line blocking by dynamically changing the level of multiplexing in the network. Through experiments with Memcached on a small testbed and large-scale simulations, we show that Baraat outperforms state-of-the-art decentralized schemes (e.g., pFabric) as well as centralized schedulers (e.g., Orchestra) for a wide range of workloads (e.g., search, analytics, etc).

We propose a deadline-aware flow scheduling scheme, called Preemptive Efficient Queuing (PEQ), which takes both the deadlines and sizes of the flows into account for efficient flow scheduling of flows in a data-center network in this paper. PEQ benefits from evaluating the deadlines and flow sizes of flows to improve application throughput. Our results show that PEQ outperforms the state-of-the-art deadline-aware transport schemes in terms of the application throughput and average flow completion time, under traffic with different deadline distributions. Results also show that PEQ yields a near-optimal application throughput in cases where short flows have long deadlines and long flows have strict deadlines. In other words, PEQ attains higher performance than the counterpart schemes on traffic with broader distribution of deadlines and flow sizes.

With the rapid development of data center network, the traditional traffic scheduling method can easily cause problems such as link congestion and load imbalance. Therefore, this paper proposes a novel dynamic flow scheduling algorithm GA-ACO (Genetic Algorithm and Ant COlony algorithms). GA-ACO algorithm obtains the global perspective of the network under the SDN (Software defined network) architecture. It then calculates the global optimal path for the elephant flow on the congestion link, and reroutes it. Extensive experiments have been executed to evaluate the performance of the proposed GA-ACO algorithm. The simulation results show that, in comparison with ECMP and ACO-SDN algorithm, GA-ACO can not only reduce the maximum link utilization, but also improve the bandwidth effectively.

Data center networks are characterized by high link speeds, low propagation delays, small switch buffers, and temporally clustered arrivals of many concurrent TCP flows fulfilling data transfer requests. However, the combination of these features can lead to transient buffer overflow and bursty packet losses, which in turn lead to TCP retransmission timeouts that degrade the performance of short-lived flows. This so-called TCP-incast problem can cause TCP throughput collapse. In this paper, we explore an application-level approach for solving this problem. The key idea of our solution is to coordinate the scheduling of short-lived TCP flows so that no data loss happens. We develop a mathematical model of lossless data transmission, and estimate the maximum good put achievable in data center networks. The results indicate non-monotonic good put that is highly sensitive to specific parameter configurations in the data center network. We validate our model using ns-2 network simulations, which show good correspondence with the theoretical results.

The rapid increasing traffic in data centers (DCs) puts tremendous pressure to the present multi-tier network architectures and electrical switching techniques. Switching traffic in the optical domain featuring ultra-high bandwidth, therefore, has been intensively investigated to build the high capacity data center networks (DCNs). To handle the variable traffic pattern in DCs, the network reconfigurability with adaptable optical bandwidth allocation is of key importance to flexibly assign the optical bandwidth. To this end, we propose and experimentally evaluate a software-defined networking enabled reconfigurable optical DCN with dynamic bandwidth allocation in this work, based on novel optical top of racks exploiting a wavelength selective switch. Experimental assessments show that the proposed solution can automatically reallocate the optical bandwidth in real-time to adapt the dynamic traffic pattern. Compared with the conventional optical DCN with static bandwidth provision, the end-to-end latency performance of the reconfigurable scheme with adaptable bandwidth allocation improves of 58.3% and the average packet loss decreases one order of magnitude. Moreover, the reconfigurable optical DCN features deterministic latency performance, with much lower time variations of packets delivery completion. Based on the experimental parameters, the simulation platform is also built to validate the good scalability of the proposed reconfigurable DCN. Numerical results illustrate the negligible performance degradation (11%) as the network scales from 2560 to 40 960 servers.

Today’s datacenter networks (DCNs) have been built upon multipath topologies where each path contains multiple links. However, flow scheduling schemes proposed to minimize flow completion times (FCT) in DCNs are based on algorithms which are optimum or close-to-optimum only over single link. Moreover, most of these scheduling schemes seek either fully centralized approaches having overhead of communicating to a central entity or fully distributed approaches requiring changes in the fabric.Motivated by these shortcomings, we present HyLine a simple scheduling design for commodity DCNs which is equipped with a joint load-balancing and flow scheduling (path-aware) design exploiting the multipath nature of DCNs. HyLine takes a hybrid approach and uses the global-awareness of centralized and agility of distributed techniques without requiring any changes in the fabric. To that end, it determines a threshold margin identifying flows for which using centralized approach is beneficial.We have shown through extensive ns2 simulations that despite HyLine’s simplicity, it significantly outperforms existing schemes and achieves lower average and 99th percentile FCTs. For instance, compared to Qjump–state-of-the-art practical scheme– and pFabric–one of the best performing flow scheduling schemes– HyLine reduces average FCT up to 68% and 31%, respectively, under a production datacenter workload.

This paper proposes an algorithm to minimize weighted service latency for different classes of tenants (or service classes) in a data center network where erasure-coded files are stored on distributed disks/racks and access requests are scattered across the network. Due to limited bandwidth available at both top-of-the-rack and aggregation switches and tenants in different service classes need differentiated services, network bandwidth must be apportioned among different intra- and inter-rack data flows for different service classes in line with their traffic statistics. We formulate this problem as weighted queuing and employ a class of probabilistic request scheduling policies to derive a closed-form upper-bound of service latency for erasure-coded storage with arbitrary file access patterns and service time distributions. The result enables us to propose a joint weighted latency (over different service classes) optimization over three entangled "control knobs": the bandwidth allocation at top-of-the-rack and aggregation switches for different service classes, dynamic scheduling of file requests, and the placement of encoded file chunks (i.e., data locality). The joint optimization is shown to be a mixed-integer problem. We develop an iterative algorithm which decouples and solves the joint optimization as 3 sub-problems, which are either convex or solvable via bipartite matching in polynomial time. The proposed algorithm is prototyped in an open-source, distributed file system, {\em Tahoe}, and evaluated on a cloud testbed with 16 separate physical hosts in an Openstack cluster using 48-port Cisco Catalyst switches. Experiments validate our theoretical latency analysis and show significant latency reduction for diverse file access patterns. The results provide valuable insights on designing low-latency data center networks with erasure coded storage.

In data center networks (DCNs), the flow size is a crucial factor to schedule the traffic, as small flows are usually latency-sensitive (e.g., web search from users) while large flows are not (e.g., backup between two sites). Some existing flow scheduling schemes try to schedule flows based on the prior knowledge of flows, such as flow size and deadline. However, it may be unpractical to obtain the prior information in some scenarios. In this paper, we propose START to minimize the flow completion time (FCT) and guarantee the priority of small flows in DCNs. We control the priorities of packets by leveraging the multiple priority queues based on the amount of data a flow has sent. Switches schedule flows according to their priorities. In addition, to schedule the flows more intelligently, we adjust the threshold of each priority dynamically according to the network loads. A prototype of START has been implemented with ns2 simulations. START is compatible with legacy TCP/IP stacks and deployable with existing commodity switches. The results show that START significantly outperforms existing flow scheduling schemes DCTCP and L2DCT up to 40% and 45% for small flows in changing network status. In some scenarios, START can even achieve better performance than pFabric.