• Cite Icon45
  • https://doi.org/10.14778/1453856.1453882Copy DOI Icon

Parallelizing query optimization

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Many commercial RDBMSs employ cost-based query optimization exploiting dynamic programming (DP) to efficiently generate the optimal query execution plan. However, optimization time increases rapidly for queries joining more than 10 tables. Randomized or heuristic search algorithms reduce query optimization time for large join queries by considering fewer plans, sacrificing plan optimality. Though commercial systems executing query plans in parallel have existed for over a decade, the optimization of such plans still occurs serially. While modern microprocessors employ multiple cores to accelerate computations, parallelizing query optimization to exploit multi-core parallelism is not as straightforward as it may seem. The DP used in join enumeration belongs to the challenging nonserial polyadic DP class because of its non-uniform data dependencies. In this paper, we propose a comprehensive and practical solution for parallelizing query optimization in the multi-core processor architecture, including a parallel join enumeration algorithm and several alternative ways to allocate work to threads to balance their load. We also introduce a novel data structure called skip vector array to significantly reduce the generation of join partitions that are infeasible. This solution has been prototyped in PostgreSQL. Extensive experiments using various query graph topologies confirm that our algorithms allocate the work evenly, thereby achieving almost linear speed-up. Our parallel join enumeration algorithm enhanced with our skip vector array outperforms the conventional generate-and-filter DP algorithm by up to two orders of magnitude for star queries-linear speedup due to parallelism and an order of magnitude performance improvement due to the skip vector array.

Similar Papers
  • Research Article
  • Citations2

The role of dynamic programming & control structures in performance

  • Jun 08, 1995
  • ACM SIGAPL APL Quote Quad
  • Robert Bernecky
  • Research Article

Optimization Strategy of Bidirectional Join Enumeration in Multi-Core CPUS

  • Dec 06, 2010
  • Applied Mechanics and Materials
  • Yong Heng Chen +2
  • Conference Article

Using similarity distance for performance prediction of the query optimization process

  • Jun 24, 2013
  • Anisoara Nica +1
  • Conference Article
  • Citations66

A parallel dynamic programming algorithm on a multi-core architecture

  • Jun 09, 2007
  • Guangming Tan +2
  • Conference Article
  • Citations4

Efficient GPU-accelerated Join Optimization for Complex Queries

  • May 01, 2022
  • Vasilis Mageirakos +4
  • Research Article
  • Citations3

Optimal Vehicle-to-Grid Charge Scheduling for Electric Vehicles Based on Dynamic Programming

  • Feb 24, 2025
  • Energies
  • Heeyun Lee +3
  • Research Article
  • Citations1

Optimal Flight Path Planning of Cruising Phase with No-Fly Zone Constraints Based on Dynamic Programming Algorithm

  • Jan 03, 2012
  • Advanced Materials Research
  • Su Xiao Wang +2
  • Research Article
  • Citations37

Query optimization for parallel execution

  • Jun 01, 1992
  • ACM SIGMOD Record
  • Sumit Ganguly +2
  • Research Article

Maximum a posteriori probability direction finding and the dynamic programming algorithm

  • Jun 01, 1995
  • Journal of the Chinese Institute of Engineers
  • Yung‐Dar Huang
  • Conference Article

Dynamic Programming for POMDP with Jointly Discrete and Continuous State-Spaces

  • Jul 01, 2019
  • Donghwan Lee +2
  • Book Chapter
  • Citations104

Deep Policy Dynamic Programming for Vehicle Routing Problems

  • Jan 01, 2022
  • Wouter Kool +3
  • PDF
  • Research Article
  • Citations13

Development of Global Optimization Algorithm for Series-Parallel PHEV Energy Management Strategy Based on Radau Pseudospectral Knotting Method

  • Aug 25, 2019
  • Energies
  • Kegang Zhao +3
  • Research Article

Adaptive control of plug-in hybrid electric vehicles based on energy management strategy and dynamic programming algorithm

  • Nov 01, 2024
  • International Journal of Renewable Energy Development
  • Yuxin Ge
  • Conference Article

Optimization of Fuel Economy of Hybrid Electric Vehicles Using Set Based Dynamic Programming

  • Oct 22, 2014
  • Nikhil Ramaswamy +1
  • Research Article

APPLICATION OF COMBINATORY OPTIMISATION METHODS FOR DESIGN OF MINING PRODUCTION PROCESSES WITH LIMITED RESOURCES

  • Jan 01, 2024
  • JOURNAL of Donetsk mining institute
  • Andrii Khorolskyi
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.