On the Latencies in a Hybrid Optical Packet Switching Network in Data Center

Multi-tenancy is a key feature of modern data centers. It allows for the existence of multiple independent virtual infrastructures, called virtual slices, on top of the same physical infrastructure, each of them specially tailored to the tenants' needs. In such a scenario, an optimal mapping of the virtual slices plays a capital role toward an efficient utilization of the data center network resources, potentially saving costs for the data center owner. However, due to the increasing trend of bringing optics to data center networks, specific virtual slice mapping mechanisms accounting for the particularities of the optical medium (e.g., wavelength continuity constraint) have to be investigated. For this, we present an integer linear programming (ILP) model for optimally mapping a set of virtual slices from different tenants in a hybrid optical circuit switching (OCS)/optical packet switching (OPS) data center network with the aim to minimize the necessary optical transponders to be equipped in the network. Additionally, we also present a lightweight heuristic for the cases in which the ILP model scalability is compromised. The benefits of the proposals are highlighted by benchmarking them against a pure OCS solution through extensive simulations.

This paper presents performance evaluations and comparisons of different sharing approaches applied to the available optical bandwidth in data center networks. The recently proposed hybrid optical network concept, which combines multi-wavelength optical packet switching (OPS) and optical circuit switching (OCS) in WDM networks, is compared with a service-specific sharing model. Simulation results show that a careful design of dedicated channel allocation gives similar performance to a complete channel sharing with prioritized scheduling, which is however more flexible.

Data center networks (DCNs) are at the forefront of a radical transformation, fueled by the rapid rise of artificial intelligence (AI), cloud-native adoption, and enterprise digitalization, which together place unprecedented demands on their design and performance. From healthcare AI and intelligent transportation to business analytics, modern DCNs are expected to support a diverse and evolving mix of bandwidth-demanding applications, each with distinct quality of service (QoS) requirements. Yet, most state-of-the-art DCN solutions rely on oversimplified DCN data traffic models, failing to address the required application-level differentiation in terms of end-to-end (E2E) latency demands. In response, we propose ALAS-DCN, a novel, to our knowledge, application-aware, low-latency, scalable DCN architecture, based on optical packet switching in the intra-rack and inter-rack domains that is both designed and rigorously evaluated using commercial QoS specifications and realistic traffic patterns of different applications coexisting within the same DCN. ALAS-DCN integrates three hierarchical optical sub-networks: intra-rack, inter-rack, and bridge, each governed by a custom wavelength division multiplexing (WDM) medium access control (MAC) protocol that dynamically prioritizes critical traffic packets, according to the specific application E2E latency demands. Unlike prior approaches, our evaluation leverages realistic workload traces generated by established traffic generators, capturing the application diversity within modern data center (DC) environments. Extensive experimental simulations across five representative DC categories, each hosting a different mix of modern applications, demonstrate that ALAS-DCN consistently achieves up to 95% throughput efficiency and sub-µs latency for high priority traffic across a variety of applications, consistently meeting their differentiated latency constraints. Scalable up to 20,000 servers, ALAS-DCN redefines the DCN as not just a transport layer but an intelligent enabler of next-generation application performance.

We highlight the advantages of dynamic wavelength allocation and path rerouting in hybrid optical flow-switched data center networks compared with static electronic packet-switched data center networks. Current electronic packet-switched networks perform routing based on lookup tables and shortest path routing over high speed optical connections. However, load balancing and path rerouting are not designed in coordination with the optical data plane. In this work, we design and analyze the performance of load balancing and resource allocation in hybrid flow data center architectures. In the hybrid flow architecture, the transport layer and control plane are responsible for load balancing, congestion control and reliable data delivery in wavelength division multiplexed networks. The transport layer abstracts the underlying network and data link layers from user applications. Applications are unaware of whether flows are transmitted via the electronic data plane, optical data plane, or both, where the relevant metric for applications is transaction delay. We show that the data center architecture that minimizes delay in the presence of elephant flows and dynamic loads is the hybrid flow architecture with dynamic resource allocation.

The explosive growth of data center (DC) traffic imposes unprecedented challenges on the current electrical switch-based data center networks (DCNs) with the bottleneck of limited bandwidth and high latency. Benefitting from transparency to the data rate and format, optical switching with theoretically infinite bandwidth could overcome the bandwidth bottleneck of electrical switching DCNs. However, DCNs normally deploy multitenant applications with a variety of DC traffic. It is hard to reconfigure the optical interconnections in real-time to provide adaptable bandwidth to the traffic with heterogeneous characteristics. Moreover, to improve the bandwidth utilization, statistical multiplexing is generally deployed in optical DCNs to forward the traffic flow in a time slot, which requires the network time to be precisely synchronized to all network nodes. For fast optical switches with a nanosecond switching configuration time, overall end node times must be synchronized at subnanosecond magnitude. In this paper, we propose and experimentally investigate a reconfigurable and picosecond-synchronized optical DCN (ReSAW) based on an arrayed waveguide grating router (AWGR) and the White Rabbit (WR) protocol. A scheduler based on a distributed field-programmable gate array is implemented in the proposed ReSAW to realize flexible wavelength configuration by controlling the fast laser array based on semiconductor optical amplifiers (SOAs) according to time slot and traffic priority. Moreover, the WR protocol is implemented in optical DCNs for what we believe is the first time to synchronize the time of the distributed top of racks (ToRs). The experimental demonstration validates that ReSAW achieves an average end-to-end latency of 317.44 ns and a precise synchronized time with an average 386 ps skew. When the load is 0.4, the packet loss after ReSAW reconfiguration is less than 1.83 × 10 − 6 , and the network latency is less than 1.73 µs. Based on the experimental parameters and results, the OMNeT++ simulation model is built to further verify the reconfigurability and scalability of the ReSAW network. Results show that the packet loss rate and latency performance increase 8.24% and 12.47%, respectively, at a load of 0.6 as the ReSAW network scales from 2560 to 40,960 servers compared to before the reconfiguration.

In the recent past, there has been an explosive growth in data traffic within data center systems. This rapid increase in data volume has put significant constraints on the speed of current data communication networks, which are predominantly based on electronic controllers and memory. The speed limitations of electronic devices hinder their ability to process data at higher rates efficiently. To address this issue and enable faster data processing, the use of optical communication emerges as the most promising solution. Optical communication leverages the capabilities of light signals and optical components, which can handle data at much higher rates compared to their electronic counterparts. One key element in optical communication systems is the utilization of fiber delay lines (FDLs) as optical storage for packets. FDLs offer the ability to temporarily store and delay optical signals, providing buffering capabilities within optical networks. These FDLs can be configured in various setups, including feed forward, feed backward, and recirculating configurations, each with its own set of advantages and disadvantages. In this context, this article explores several state-of-the-art arrayed waveguide grating (AWG)-based optical packet switch (OPSW) architectures. These switches are designed to efficiently route and manage optical packets within data center networks. Each architecture is summarized, highlighting its unique features and capabilities. To compare the different AWG-based OPSW architectures, various key parameters are considered, such as the cost, physical losses, bit error rate (BER), and the number of tunable components required. These parameters are critical in determining the performance, efficiency, and cost-effectiveness of the switches.

Hybrid optical switching (HOS) is a switching paradigm that aims to combine optical circuit switching, optical burst switching, and optical packet switching on the same network. This paper proposes a novel integrated control plane for an HOS core node. The control plane makes use of a unified control packet able to carry the control information for all the different data formats and employs an appropriate scheduling algorithm for each incoming data type. Three possible node architectures are presented and an analytical model is introduced to analyze their power consumption. Also, the concept of increase in power efficiency is introduced to compare the considered architectures. The performance and power consumption analysis of the node have been carried out through the use of a simulation model developed specifically for the scope. The obtained results show the effectiveness of HOS networks.

Data center networks, using a reliable, high speed communication network, is a core component of cloud computing. Recently, optical networks using Space Division Multiplexing has been proposed as a solution to the speed bottleneck anticipated in data center networks. To our knowledge the new challenges of designing such communication systems have not been addressed yet. In this paper we have proposed an optimal approach to the problem of developing a path-protection scheme to handle communication requests in data center (DC) networks using elastic optical networking and space division multiplexing. We have formulated our problem as an Integer Linear Program (ILP). We have also proposed a heuristic that can handle problems of practical size. Our simulations explore important features of our approach.

Scheduling traffic for maximum switch lifetime in optical data center fabrics

As the performance requirements and scale of high-performance computing (HPC) systems grow rapidly, systems with such a large number of computing nodes present significant challenges in network architecture design because their peak performance is increasingly limited by communication rather than computation. Moreover, certain HPC application always shows some specific communication patterns, and different topologies have various performances with these patterns. To implement a traffic pattern adaptive HPC system, we propose a topology reconfigurable hybrid network architecture based on optical circuit switching (OCS), which could be adjusted into different classical topologies. And an algorithm of topology calculating and a permutation matrix-based optical switch configuration mechanism are proposed to construct network. We discuss network performances with limited OCS switches occupation, and results show that traffic pattern adaptive network improves the performance of latency and throughput to a large extent.

As data centers enter the exascale computing era, the traffic exchanged between internal network nodes, increases exponentially. Optical networking is an attractive solution to deliver the high capacity, low latency, and scalable interconnection needed. Among other switching methods, packet switching is particularly interesting as it can be widely deployed in the network to handle rapidly-changing traffic of arbitrary size. Nanosecond-reconfigurable photonic integrated switch fabrics, built as multi-stage architectures such as the Clos network, are key enablers to scalable packet switching. However, the accompanying control plane needs to also operate on packet timescales. Designing a central scheduler, to control an optical packet switch in nanoseconds, presents a challenge especially as the switch size increases. To this end, we present a highly-parallel, modular scheduler design for Clos switches along with a proposed routing scheme to enable nanosecond scalable scheduling. We synthesize our scheduler as an application-specific integrated circuit (ASIC) and demonstrate scaling to a 256 × 256 size with an ultra-low scheduling delay of only 6.0 ns. In a cycle-accurate rack-scale network emulation, for this switch size, we show a minimum end-to-end latency of 30.8 ns and maintain nanosecond average latency up to 80% of input traffic load. We achieve zero packet loss and short-tailed packet latency distributions for all traffic loads and switch sizes. Our work is compared to state-of-the-art optical switches, in terms of scheduling delay, packet latency, and switch throughput.

Hybrid optical switching networks make full use of the advantages of Optical Circuit Switching (OCS) and Optical Burst Switching (OBS). In parallel hybrid optical switching networks, edge nodes choose a switching mode for traffic and no longer change. The inflexible decision making of the traffic transfer mode leads to low resource utilization when the arrival rate of the OCS traffic is lower than the capacity of the light path. In this paper, a new transmission scheme is proposed to improve resource utilization for hybrid optical switching networks. When the traffic arrival rate of the light path is lower than the transmission rate of the light path, the OCS traffic flow is reshaped at the edge nodes to generate a series of voids. Then, several message packets are sent along the light path to inform the core nodes of the voids of the light paths that represent the unused bandwidth resources. To improve the resource utilization, the voids can be filled with data bursts by core nodes. The simulation results show that the new scheme can effectively reduce the burst loss rate and improve the link utilization of the hybrid optical switching network on the premise of a providing service quality guarantee for OCS traffic.

This book presents an in-depth deliberation on optical networks in four parts, capturing the past, present, and ensuing developments in the field. Part I has two chapters presenting an overview of optical networks and the enabling technologies. Part II has three chapters dealing with the single-wavelength optical networks: optical LANs/MANs, optical access networks using passive optical network architecture, SONET/SDH, optical transport network and resilient packet ring. Part III consists of four chapters on WDM-based optical networks, including WDM-based local/metropolitan networks (LANs/MANs) using single and multihop architectures over passive-star couplers, WDM/TWDM access networks as an extension of PONs with WDM transmission, WDM metro ring networks covering circuit-switched (using point-to-point WDM and wavelength-routed transmission) plus packet-switched architectures and WDM long-haul backbone networks presenting the offline and online design methodologies using wavelength-routed transmission. Part IV deals with some selected topics in six chapters. The first deals with transmission impairments and power-consumption issues in optical networks, while the next three chapters deal with the survivable optical networks, network control and management techniques, including GMPLS, ASON, and SDN/SDON, and datacenter networks using electrical, optical, and hybrid switching techniques. The final two chapters present elastic optical networks using flexible grid for better utilization of the optical-fiber spectrum and optical packet and burst-switched networks. The three appendices present the basics of the linear programming techniques, noise processes encountered in the optical communication systems, and the fundamentals of queuing theory and its applications in telecommunication networks. (238 words)

Optical Circuit Switching (OCS) provides a good support for the services requiring high bandwidth and Quality of Service (QoS). When the character of network traffic changes from voice-oriented to data-oriented, OCS must cooperate with new switching mechanisms such as Optical Burst Switching (OBS) to improve performance. So a Hybrid Optical Switching (HOS) system is proposed. In HOS, different traffics are classified and both OBS and OCS can be processed. At the same time, delay buffer mechanisms, which are Fiber Delay Line (FDL) and electronic buffering, are introduced in HOS to solve the contention of OBS bursts. And a wavelengths classification mechanism, which assigns some wavelengths dedicated to OCS traffics, is provided to guarantee the QoS of OCS. To analyze the performance in theory, models based on Markovian theory and iterative method are provided. The results got by theory are accurate compared with simulations. The use of delay buffer can decrease the blocking probability of OBS and increase resource utilization. Wavelength classification mechanism benefits to improve OCS's performance.

Data centers (DCs), owing to the exponential growth of Internet services, have emerged as an irreplaceable and crucial infrastructure to power this ever-growing trend. A DC typically houses a large number of computing and storage nodes, interconnected by a specially designed network, namely, DC network (DCN). The DCN serves as a communication backbone and plays a pivotal role in optimizing DC operations. However, compared to the traditional network, the unique requirements in the DCN, for example, large scale, vast application diversity, high power density, and high reliability, pose significant challenges to its infrastructure and operations. We have observed from the premium publication venues (e.g., journals and system conferences) that increasing research efforts are being devoted to optimize the design and operations of the DCN. In this paper, we aim to present a systematic taxonomy and survey of recent research efforts on the DCN. Specifically, we propose to classify these research efforts into two areas: 1) DCN infrastructure and 2) DCN operations. For the former aspect, we review and compare the list of transmission technologies and network topologies used or proposed in the DCN infrastructure. For the latter aspect, we summarize the existing traffic control techniques in the DCN operations, and survey optimization methods to achieve diverse operational objectives, including high network utilization, fair bandwidth sharing, low service latency, low energy consumption, high resiliency, and etc., for efficient DC operations. We finally conclude this survey by envisioning a few open research opportunities in DCN infrastructure and operations.