• Home
  • Search
  • Zero+: Monitoring Large-Scale Cloud-Native Infrastructure Using One-Sided RDMA
  • Cite Icon1
  • https://doi.org/10.1109/tnet.2024.3394514Copy DOI Icon

Zero+: Monitoring Large-Scale Cloud-Native Infrastructure Using One-Sided RDMA

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Cloud services have shifted from monolithic designs to microservices running on cloud-native infrastructure with monitoring systems to ensure service level agreements (SLAs). However, traditional monitoring systems no longer meet the demands of cloud-native monitoring. In Alibaba’s “double eleven” shopping festival, it is observed that the monitor occupies resources of the monitored infrastructure and even disrupts services. In this paper, we propose a novel monitoring system named for cloud-native monitoring. achieves zero overhead in collecting raw metrics using one-sided remote direct memory access (RDMA) and remedies network congestion by adopting a receiver-driven flow control scheme. also features a priority queue mechanism to meet different quality of service requirements and an efficient batch processing design to relieve CPU occupation. has been deployed and evaluated in four different clusters with heterogeneous RDMA NIC devices and architectures in Alibaba Cloud. Results show that achieves no CPU occupation at the monitored host and supports <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$1\sim10k$</tex-math> </inline-formula> hosts with <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$0.1\sim1s$</tex-math> </inline-formula> sampling interval using a single thread for network I/O. significantly relieves the incast issue and maintains <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$80\sim95\%$</tex-math> </inline-formula> of bandwidth utilization in several clusters when monitoring <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$1k$</tex-math> </inline-formula> hosts. also ensures services with high priority accomplish collecting metrics earlier than low priority ones by at least <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$400 \mu s$</tex-math> </inline-formula> when monitoring <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$1k$</tex-math> </inline-formula> hosts.

Similar Papers
  • Book Chapter
  • Citations5

Evaluation of RDMA Opportunities in an Object-Oriented DSM

  • Oct 01, 2007
  • Ronald Veldema +1
  • Research Article

A Verified High-Performance Composable Object Library for Remote Direct Memory Access

  • Jan 08, 2026
  • Proceedings of the ACM on Programming Languages
  • Guillaume Ambal +7
  • Conference Article
  • Citations6

Implementation of an efficient RDMA mechanism tightly coupled with a TCP/IP offload engine

  • Jun 01, 2008
  • Hankook Jang +2
  • Research Article
  • Citations29

Swing: Providing Long-Range Lossless RDMA via PFC-Relay

  • Jan 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Yanqing Chen +9
  • Research Article
  • Citations5

RXIO: Design and implementation of high performance RDMA-capable GridFTP

  • Dec 21, 2011
  • Computers &amp; Electrical Engineering
  • Yuan Tian +2
  • Research Article
  • Citations12

RF-RPC: Remote Fetching RPC Paradigm for RDMA-Enabled Network

  • Jul 01, 2019
  • IEEE Transactions on Parallel and Distributed Systems
  • Yongwei Wu +5
  • Research Article
  • Citations4

Reliable multicast using remote direct memory access (RDMA) over a passive optical cross-connect fabric enhanced with wavelength division multiplexing (WDM)

  • Jan 01, 2019
  • APSIPA Transactions on Signal and Information Processing
  • Kin-Wai Leong +2
  • Conference Article
  • Citations53

Remote Direct Memory Access over the Converged Enhanced Ethernet Fabric: Evaluating the Options

  • Aug 01, 2009
  • David Cohen +8
  • Book Chapter
  • Citations2

Design and Implementation of HDFS over Infiniband with RDMA

  • Jan 01, 2013
  • Dong Buyun +4
  • Conference Article
  • Citations12

Toward Effective and Fair RDMA Resource Sharing

  • Aug 01, 2018
  • Haonan Qiu +7
  • Conference Article
  • Citations53

Memory Management Strategies for Data Serving with RDMA

  • Aug 01, 2007
  • Dennis Dalessandro +1
  • Conference Article
  • Citations4

RDMA Load Balancing via Data Partition

  • Jul 01, 2019
  • Yi Wang +5
  • Conference Article
  • Citations11

RDMA control support for fine-grain parallel computations

  • Jan 01, 2004
  • A Smyk +1
  • Conference Article
  • Citations2

RDMA vs. RPC for Implementing Distributed Data Structures

  • Nov 01, 2019
  • Benjamin A Brock +5
  • Conference Article
  • Citations5

Review of RDMA-enabled Consensus Protocols

  • Jun 01, 2019
  • Karim Sonbol +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.