Poisson shot-noise process based flow-level traffic matrix generation for data center networks

The information and communication technology nowadays more than ever depends on the Internet and cloud computing, so that the data centers (DCs) have been converted to a constitutive unit of the cloud computing. A DC is composed of two primary parts: servers and Data Center Networks (DCNs). Robustness and scalability are two major challenges of the DCNs that are expanded based on two strategies, scale-out, and scale-up. This paper is distinctive from the related studies in two aspects. The first one is to simultaneously focus on both the scalability and the robustness challenges of the DCNs. For this purpose, we will concentrate on the comparison of robustness in the scalable models of these networks. The second one is, despite the previous work that only evaluated the DCN robustness under topological changes, we evaluated the robustness and fault tolerance against three types of unexpected changes in topology, traffic, and COI (community of interest) in the present work. Hence, we have chosen the network criticality (NC) as a graph-theoretic metric for analyzing DCN robustness. Afterward, we compare some structural and spectral graph metrics with NC among some well-known DCNs, and their scale-out and scale-up. Our results are useful to select the appropriate scaling strategy with the goal of maximizing the robustness of existing DCNs and provide a guideline for designing the new robust and scalable DCN.

Network emulations are widely used for testing novel network protocols and routing algorithms in realistic scenarios. Up to now, there is no emulation tool that is able to emulate large software-defined data center networks that consist of several thousand nodes. Mininet is the most common tool to emulate Software-Defined Networks of several hundred nodes. We extend Mininet to span an emulated network over several physical machines, making it possible to emulate networks of several thousand nodes on just a handful of physical machines. This enables us to emulate, e.g., large data center networks. To test this approach, we additionally introduce a traffic generator for data center traffic. Since there are no data center traffic traces publicly available we use the results of two recent traffic studies to create synthetic traffic. We show the design and discuss some challenges we had in building our traffic generator. As a showcase for our work we emulated a data center consisting of 3200 hosts on a cluster of only 12 physical machines. We show the resulting workloads and the trade-offs involved.

A survey on architectures and energy efficiency in Data Center Networks

Data centers (DCs), owing to the exponential growth of Internet services, have emerged as an irreplaceable and crucial infrastructure to power this ever-growing trend. A DC typically houses a large number of computing and storage nodes, interconnected by a specially designed network, namely, DC network (DCN). The DCN serves as a communication backbone and plays a pivotal role in optimizing DC operations. However, compared to the traditional network, the unique requirements in the DCN, for example, large scale, vast application diversity, high power density, and high reliability, pose significant challenges to its infrastructure and operations. We have observed from the premium publication venues (e.g., journals and system conferences) that increasing research efforts are being devoted to optimize the design and operations of the DCN. In this paper, we aim to present a systematic taxonomy and survey of recent research efforts on the DCN. Specifically, we propose to classify these research efforts into two areas: 1) DCN infrastructure and 2) DCN operations. For the former aspect, we review and compare the list of transmission technologies and network topologies used or proposed in the DCN infrastructure. For the latter aspect, we summarize the existing traffic control techniques in the DCN operations, and survey optimization methods to achieve diverse operational objectives, including high network utilization, fair bandwidth sharing, low service latency, low energy consumption, high resiliency, and etc., for efficient DC operations. We finally conclude this survey by envisioning a few open research opportunities in DCN infrastructure and operations.

The network of traditional data center has been usually designed and constructed for the provision of user's equal access of data centre's resource or data. Therefore, network administrators have a strong tendency to manage user traffic from the viewpoint that the traffic has a similar size and characteristics. But, the emersion of big data begins to make data centers have to deal with 1015 byte-data transfer at once. Such a big data transfer can cause problems in network traffic management in the existed data center. And, the tiered network architecture of the legacy data center magnifies the magnitude of the problems. One of the well-known big data in science is from large hadron collider such as LHC in Swiss CERN. CERN LHC generates multi-peta byte data per year. From our experience of CERN data service, this paper showed the impact of network traffic affected by large-scale data stream using NS2 simulation, and then, suggested the evolution direction based on separating of large-scale data stream for the big data center's network architecture.

Today, there is a generalized standard usage of internet for all.The devices via multiple technologies that facilitates to provide few communication methods to scholars to work with. By forming multiple paths in the data center network, latest generation data centers offer maximum bandwidth with robustness. To utilize this bandwidth, it is necessary that different data flows take separate paths. In brief, a single-path transport seems inappropriate for such networks. By using Multipath TCP, we must reconsider data center networks, with a diverse approach as to the association between topology, transport protocols, routing. Multipath TCP allows certain topologies that single path TCP cannot use. In newer generation data centers, Multipath TCP is already deployable using extensively deployed technologies such as Equal-cost multipath routing. But, major benefits will come when data centers are specifically designed for multipath transports. Due to manifold of technologies like Cloud computing, social networking, and information networks there is a need to deploy the number of large data centers. While Transport Control Protocol is the leading Layer-3 transport protocol in data center networks, the operating conditions like high bandwidth, small-buffered switches, and traffic patterns causes poor performance of TCP. Data Center TCP algorithm has newly been anticipated as a TCP option for data centers which address these limitations. It is worth noting that traditional TCP protocol.

Data center networks, using a reliable, high speed communication network, is a core component of cloud computing. Recently, optical networks using Space Division Multiplexing has been proposed as a solution to the speed bottleneck anticipated in data center networks. To our knowledge the new challenges of designing such communication systems have not been addressed yet. In this paper we have proposed an optimal approach to the problem of developing a path-protection scheme to handle communication requests in data center (DC) networks using elastic optical networking and space division multiplexing. We have formulated our problem as an Integer Linear Program (ILP). We have also proposed a heuristic that can handle problems of practical size. Our simulations explore important features of our approach.

Given the current expansion of cloud computing, the expected advent of the Internet of Things, and the requirements of future fifth‐generation network infrastructures, significantly larger pools of computational and storage resources will soon be required. This emphasizes the need for more scalable data centers that are capable of providing such an amount of resources in a cost‐effective way. A quick look into today's commercial data centers shows that they tend to rely on variations of well‐defined leaf‐spine/Clos data center network (DCN) topologies, offering low latency, ultrahigh bisectional bandwidth, and enhanced reliability against concurrent failures. However, DCNs are typically restricted by the use of the Transmission Control Protocol/Internet Protocol (TCP/IP) suite, thus suffering limited routing scalability. In this work, we study the benefits that replacing TCP/IP with the recursive internetwork architecture (RINA) can bring into commercial DCNs, focusing on forwarding and routing scalability. We quantitatively evaluate the benefits that RINA solutions can yield against those based on TCP/IP and highlight how, by deploying RINA, topological routing solutions can improve even more the efficiency of the network. To this goal, we propose a rule‐and‐exception forwarding policy tailored to the characteristics of several DCN variants, enabling fast forwarding decisions with merely neighbors' information. Upon failures, few exceptions are necessary, whose computation can also profit from the known topology. Extensive numerical results show that the proposed policy requirements depend mainly on the number of neighbors and concurrent failures in the DCN rather than its size, dramatically reducing the amount of forwarding and routing information stored at DCN nodes.

Data center networks (DCNs) are at the forefront of a radical transformation, fueled by the rapid rise of artificial intelligence (AI), cloud-native adoption, and enterprise digitalization, which together place unprecedented demands on their design and performance. From healthcare AI and intelligent transportation to business analytics, modern DCNs are expected to support a diverse and evolving mix of bandwidth-demanding applications, each with distinct quality of service (QoS) requirements. Yet, most state-of-the-art DCN solutions rely on oversimplified DCN data traffic models, failing to address the required application-level differentiation in terms of end-to-end (E2E) latency demands. In response, we propose ALAS-DCN, a novel, to our knowledge, application-aware, low-latency, scalable DCN architecture, based on optical packet switching in the intra-rack and inter-rack domains that is both designed and rigorously evaluated using commercial QoS specifications and realistic traffic patterns of different applications coexisting within the same DCN. ALAS-DCN integrates three hierarchical optical sub-networks: intra-rack, inter-rack, and bridge, each governed by a custom wavelength division multiplexing (WDM) medium access control (MAC) protocol that dynamically prioritizes critical traffic packets, according to the specific application E2E latency demands. Unlike prior approaches, our evaluation leverages realistic workload traces generated by established traffic generators, capturing the application diversity within modern data center (DC) environments. Extensive experimental simulations across five representative DC categories, each hosting a different mix of modern applications, demonstrate that ALAS-DCN consistently achieves up to 95% throughput efficiency and sub-µs latency for high priority traffic across a variety of applications, consistently meeting their differentiated latency constraints. Scalable up to 20,000 servers, ALAS-DCN redefines the DCN as not just a transport layer but an intelligent enabler of next-generation application performance.

In the era of cloud computing, data center network (DCN) can consume a significant amount of power (e.g., 10 to 20 percent) in large-scale data centers. To reduce the power consumption of DCN, traffic consolidation has been recently proposed as an effective approach to reduce the number of DCN devices in use. However, existing consolidation approaches do not sufficiently consider the flow completion time (FCT) requirement. On one hand, missing the FCT deadlines can cause serious violation of service-level agreement, especially for delay-sensitive networking services, such as web search and E-commerce. On the other hand, keeping all the devices on to make FCTs much shorter than the desired requirements is unnecessary because 1) users may not be able to perceive the difference, and 2) such a greedy strategy can lead to unnecessarily high DCN power consumption and thus more electricity costs. In this paper, we propose FCTcon, a dynamic FCT control strategy for DCN power optimization. FCTcon is designed rigorously based on control theory to dynamically control the FCT of delay-sensitive traffic flows exactly to the requirements, such that the desired FCT performance is guaranteed while the maximum amount of DCN power savings can be achieved. Results from both hardware experiments and simulation evaluation demonstrate that, compared to the state-of-the-art DCN power optimization schemes, FCTcon can improve the DCN FCT performance, while achieving nearly the same or even more power savings. Consequently, FCTcon can result in more than 22.0 to 62.2 percent extra net profits for a data center with 50K servers. In addition, we further propose two extended designs of FCTcon to handle the coflow abstraction recently proposed for DCN, which successfully reduce the coflow deadline miss ratio by 12 to 15 percent.

Bandwidth-hungry applications such as Cloud computing, video sharing and social networking drive the creation of more powerful Data Centers (DCs) to manage the large amount of packetized traffic. Data center network (DCN) topologies rely on thousands of servers that exchange data via the switching backbone. Cluster switches and routers are employed to provide interconnectivity between elements of the same DC and inter DCs and must be able to handle the continuously variable loads. Hence, robust and scalable switching modules are needed. Conventional DCNs adopt multistage switches that are crossbar or/and memory based. However, current multistage packet switch architectures, with their space-memory variants, are either too complex to implement, have poor performance, or not cost effective. In this paper, we propose a novel and highly scalable multistage packet- switch design based on Network-on-Chip (NoC) fabrics for DCNs. In particular, we describe a novel three-stage packet-switch fabric with a Round-Robin packets dispatching scheme where each central stage module is based on a multihop Unidirectional NoC (UDN), instead of a classic singlehop crossbar fabric. The proposed design, referred to as Clos-UDN, overcomes all the shortcomings of conventional multistage architectures. In particular, as we shall demonstrate, the proposed Clos-UDN architecture: (i) Obviates the need for a complex and costly input modules, by means of few, yet simple, input FIFO queues. (ii) Avoids the need for a complex and synchronized scheduling process over a high number of input- output modules and/or port pairs. (iii) Provides speedup, load balancing and path- diversity thanks to a dynamic dispatching scheme as well as the NoC based fabric nature. Extensive simulation studies are conducted to compare the proposed Clos-UDN switch to traditional multistage switches. Simulation results show that the Clos-UDN outperforms previous designs under a wide range of input traffic scenarios, making it highly appealing for ultra-high capacity DC networks.

We present a control plane architecture to enable software-addressable optical acceleration from the application layer. The architecture is experimentally examined on a cluster-computing test-bed by enabling physical layer optical multicasting on-demand for the application layer to achieve non-blocking performance.

The rise of Cloud Computing and Big Data has created the need for morepowerful warehouse-scale cloud data centers, which usually comprise hundreds of thousands ofservers with highaccess bandwidth (>10Gb/s) or more, and cost-effective intra- and inter- data center networks(DCNs) to provide switching and interconnect among all servers. However, the current DCNs sufferfrom limited throughput, large latencies and highpower consumption, and will not be able to sustainthe projected future DCN traffic demandswithout consuming excessive amounts of power. Optical interconnection networks capable of supporting high throughput, high bandwidth, low latency, low power consumptionand full-bandwidth communication among all servers have been proposedas a promising solution by performing switchingat the optical domain, thus greatly improving the performance of the cloud data centers.

As the infrastructure of cloud computing and big data, data centers have been deployed widely. Then, how to make full use of the computing and storage resources in data centers will be the focus. Data center networks are considered important solution for the problem above, which include intra-data center and inter-data center networks. Both of them will depend on the optical networking due to its advantages, such as high bandwidth, low latency, and low energy consumption. Data center interconnected by flexi-grid optical networks is a promising scenario to allocate spectral resources for applications in a dynamic, tunable and efficient control manner. Compared with inter-data center, optical interconnect in intra-data center networks is a more pressing need and promising scenario to accommodate these applications in a dynamic, flexible and efficient manner. OpenFlow based Software Defined Networking (SDN) is considered as a good technology, which is very suitable for data center networks. This paper mainly focuses on the data center optical networks based on software defined networking (SDN), which can control the heterogeneous networks with unified resource interface. Architecture and experimental demonstration of OpenFlow-based optical interconnects in intra-data center Networks and OpenFlow-based flexi-grid optical networks for inter-data center are presented in the paper respectively. Some future works are listed finally.

CoMap: An efficient virtual network re-mapping strategy based on coalitional matching theory