• Cite Icon39
  • https://doi.org/10.1145/2901318.2901332Copy DOI Icon

ZExpander

  • Apr 18, 2016
  • Xingbo Wu +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

While key-value (KV) cache, such as memcached, dedicates a large volume of expensive memory to holding performance-critical data, it is important to improve memory efficiency, or to reduce cache miss ratio without adding more memory. As we find that optimizing replacement algorithms is of limited effect for this purpose, a promising approach is to use a compact data organization and data compression to increase effective cache size. However, this approach has the risk of degrading the cache's performance due to additional computation cost. A common perception is that a high-performance KV cache is not compatible with use of data compacting techniques.

Similar Papers
  • Conference Article

KVO-LLM: Boosting Long-Context Generation Throughput for Batched LLM Inference

  • Jun 22, 2025
  • Zhenyu Li +8
  • Conference Article

Dispenser: Hierarchical KV Cache Management for Efficient LLM Generative Inference

  • Dec 14, 2025
  • Beiquan Cao +3
  • Research Article

Asymmetric KV Cache Compression using State-Aware Sparsity and Quantization

  • Jan 01, 2026
  • IEEE Transactions on Circuits and Systems for Artificial Intelligence
  • Myeongji Yun +3
  • Conference Article

TARDIS: A GPU-Centric KV Cache Service for Efficient LLM Inference

  • Oct 11, 2025
  • Yifan Hu +7
  • Conference Article
  • Citations1

Disk-Based Shared KV Cache Management for Fast Inference in Multi-Instance LLM RAG Systems

  • Jul 07, 2025
  • Hyungwoo Lee +7
  • Conference Article

BitDecoding: Unlocking Tensor Cores for Long-Context LLMs with Low-Bit KV Cache

  • Jan 31, 2026
  • Dayou Du +5
  • Research Article

Mapping strategy of quantized KV cache of LLMs into mixture of SLC and MLC ReRAM among various quantization methods

  • Feb 09, 2026
  • Japanese Journal of Applied Physics
  • Shota Suzuki +3
  • Conference Article

RTT- or Bandwidth-Bound? Demystifying the KV Cache Transfer in Large Language Model Serving

  • Sep 02, 2025
  • Shengnan Yue +5
  • Research Article
  • Citations348

GeTe Thermoelectrics

  • Apr 02, 2020
  • Joule
  • Xinyue Zhang +5
  • PDF
  • Research Article
  • Citations6

A Family of Fast and Memory Efficient Lock- and Wait-Free Reclamation

  • Jun 20, 2024
  • Proceedings of the ACM on Programming Languages
  • Ruslan Nikolaev +1
  • Conference Article

High efficiency and low noise quantum memory with warm atomic cell inside a cavity

  • Dec 31, 2022
  • Zhihui Yan
  • Research Article
  • Citations135

Data page layouts for relational databases on deep memory hierarchies

  • Nov 01, 2002
  • The VLDB Journal The International Journal on Very Large Data Bases
  • Anastassia Ailamaki +2
  • Conference Article
  • Citations118

Cache contention and application performance prediction for multi-core systems

  • Mar 01, 2010
  • Chi Xu +3
  • Conference Article
  • Citations6

A framework for efficient cache resizing

  • Jul 01, 2012
  • Georgios Keramidas +2
  • PDF
  • Preprint Article

Performance analysis of coalesce private or spill shared (CPOSS) replacement strategy overLRU to handle directory entry evictions from the slice last level cache (LLC) using a scalable coherent sparse directory in Multicore processor

  • May 06, 2024
  • Research Square
  • Narottam Sahu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.