• Home
  • Search
  • Query optimization in compressed database systems
  • Open Access IconOpen Access
  • Cite Icon23
  • https://doi.org/10.1145/376284.375692Copy DOI Icon

Query optimization in compressed database systems

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Over the last decades, improvements in CPU speed have outpaced improvements in main memory and disk access rates by orders of magnitude, enabling the use of data compression techniques to improve the performance of database systems. Previous work describes the benefits of compression for numerical attributes, where data is stored in compressed format on disk. Despite the abundance of string-valued attributes in relational schemas there is little work on compression for string attributes in a database context. Moreover, none of the previous work suitably addresses the role of the query optimizer: During query execution, data is eithereagerlydecompressed when it is read into main memory, or datalazilystays compressed in main memory and is decompressed on demand onlyIn this paper, we present an effective approach for database compression based on lightweight, attribute-level compression techniques. We propose a IIierarchical Dictionary Encoding strategy that intelligently selects the most effective compression method for string-valued attributes. We show that eager and lazy decompression strategies produce sub-optimal plans for queries involving compressed string attributes. We then formalize the problem of compression-aware query optimization and propose one provably optimal and two fast heuristic algorithms for selecting a query plan for relational schemas with compressed attributes; our algorithms can easily be integrated into existing cost-based query optimizers. Experiments using TPC-H data demonstrate the impact of our string compression methods and show the importance of compression-aware query optimization. Our approach results in up to an order speed up over existing approaches.

Similar Papers
  • Book Chapter
  • Citations14

Distributed query optimization in loosely coupled multidatabase systems

  • Jan 01, 1995
  • Silvio Salza +2
  • Research Article

How to Optimize SQL Queries? A Comparison Between Split, Holistic, and Hybrid Approaches

  • Jul 01, 2025
  • Proceedings of the VLDB Endowment
  • Luca Gretscher +1
  • Research Article
  • Citations25

Multi-route query processing and optimization

  • Oct 18, 2012
  • Journal of Computer and System Sciences
  • Rimma V Nehme +4
  • Research Article
  • Citations58

Query optimization over crowdsourced data

  • Aug 01, 2013
  • Proceedings of the VLDB Endowment
  • Hyunjung Park +1
  • Conference Article
  • Citations34

Efficient Lightweight Compression Alongside Fast Scans

  • May 31, 2015
  • Orestis Polychroniou +1
  • Conference Article
  • Citations49

Decoupled query optimization for federated database systems

  • Aug 07, 2002
  • A Deshpande +1
  • Research Article
  • Citations38

Processing and optimizing main memory spatial-keyword queries

  • Nov 01, 2015
  • Proceedings of the VLDB Endowment
  • Taesung Lee +5
  • Research Article
  • Citations1

Proactive Energy Management in Database Systems

  • Dec 01, 2024
  • ACM SIGEnergy Energy Informatics Review
  • Yuto Hayamizu +2
  • Book Chapter
  • Citations3

A Framework for Cost-Based Query Optimization in Native XML Database Management Systems

  • Jan 01, 2010
  • Andreas M Weiner +1
  • Book Chapter
  • Citations130

Chapter 18 - Generic Database Cost Models for Hierarchical Memory Systems

  • Jan 01, 2002
  • Proceedings 2002 VLDB Conference
  • Stefan Manegold +2
  • Research Article
  • Citations1

Logical and Physical Optimizations for SQL Query Execution over Large Language Models

  • Jun 17, 2025
  • Proceedings of the ACM on Management of Data
  • Dario Satriani +5
  • Book Chapter

A Non-Volatile Buffered Main Memory Using Phase-Change RAM

  • Dec 11, 2012
  • Do-Heon Lee +2
  • Research Article
  • Citations9

Closing the query processing loop in Oracle 11g

  • Aug 01, 2008
  • Proceedings of the VLDB Endowment
  • Allison W Lee +1
  • PDF
  • Research Article
  • Citations18

QIACO: A Quantum Dynamic Cost Ant System for Query Optimization in Distributed Database

  • Jan 01, 2021
  • IEEE Access
  • Sayed A Mohsin +2
  • Conference Article
  • Citations7

Optimizing query rewriting for multiple queries

  • May 20, 2012
  • George Konstantinidis +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.