• Home
  • Search
  • Enabling efficient low-bit quantization based on matrix product operators for KV cache compression.
  • https://doi.org/10.1016/j.neunet.2025.108467Copy DOI Icon

Enabling efficient low-bit quantization based on matrix product operators for KV cache compression.

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Enabling efficient low-bit quantization based on matrix product operators for KV cache compression.

Similar Papers
  • Conference Article
  • Citations1

Disk-Based Shared KV Cache Management for Fast Inference in Multi-Instance LLM RAG Systems

  • Jul 07, 2025
  • Hyungwoo Lee +7
  • Conference Article

Dispenser: Hierarchical KV Cache Management for Efficient LLM Generative Inference

  • Dec 14, 2025
  • Beiquan Cao +3
  • Research Article
  • Citations5

A survey of low-bit large language models: Basics, systems, and algorithms.

  • Dec 01, 2025
  • Neural networks : the official journal of the International Neural Network Society
  • Ruihao Gong +12
  • Research Article

Asymmetric KV Cache Compression using State-Aware Sparsity and Quantization

  • Jan 01, 2026
  • IEEE Transactions on Circuits and Systems for Artificial Intelligence
  • Myeongji Yun +3
  • Conference Article

TARDIS: A GPU-Centric KV Cache Service for Efficient LLM Inference

  • Oct 11, 2025
  • Yifan Hu +7
  • Research Article
  • Citations10

PQCache: Product Quantization-based KVCache for Long Context LLM Inference

  • Jun 17, 2025
  • Proceedings of the ACM on Management of Data
  • Hailin Zhang +7
  • Research Article

TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMs

  • Apr 29, 2025
  • ACM Transactions on Intelligent Systems and Technology
  • Shuyi Xie +15
  • Research Article

Methodology for Creating a Benchmark to Evaluate LLM Performance on Numerals

  • Dec 04, 2025
  • Информатика и автоматизация
  • Sergey Karpovich +2
  • Conference Article

KVO-LLM: Boosting Long-Context Generation Throughput for Batched LLM Inference

  • Jun 22, 2025
  • Zhenyu Li +8
  • Research Article
  • Citations1

Large Language Model Powered Symbolic Execution

  • Oct 09, 2025
  • Proceedings of the ACM on Programming Languages
  • Yihe Li +2
  • Conference Article
  • Citations4

NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimuli

  • Aug 01, 2024
  • Xu Wang +2
  • Conference Article
  • Citations1

Intuitive or Dependent? Investigating LLMs’ Behavior Style to Conflicting Prompts

  • Jan 01, 2024
  • Proceedings of the Annual Meeting of the Association for Computational Linguistics
  • Jiahao Ying +5
  • Research Article

Look Before You Leap: Enhance Attention and Vigilance Regarding Harmful Content with GuidelineLLM

  • Apr 11, 2025
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Shaoqing Zhang +6
  • Conference Article

BitDecoding: Unlocking Tensor Cores for Long-Context LLMs with Low-Bit KV Cache

  • Jan 31, 2026
  • Dayou Du +5
  • Research Article
  • Citations2

Toward Cross-Hospital Deployment of Natural Language Processing Systems: Model Development and Validation of Fine-Tuned Large Language Models for Disease Name Recognition in Japanese

  • Jul 08, 2025
  • JMIR Medical Informatics
  • Seiji Shimizu +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.