• Home
  • Search
  • A learning optimizer for a federated database management system
  • Open Access IconOpen Access
  • Cite Icon9
  • https://doi.org/10.1007/s00450-005-0206-8Copy DOI Icon

A learning optimizer for a federated database management system

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Optimizers in modern DBMSs utilize a cost model to choose an efficient query execution plan (QEP) among all possible plans for a given query. The accuracy of the cost estimates depends heavily on accurate statistics about the underlying data. Outdated statistics or wrong assumptions in the underlying statistical model frequently lead to suboptimal selection of execution plans and thus to bad query performance. Federated systems require additional statistics on remote data to be kept on the federated DBMS in order to choose the most efficient execution plan when joining data from different data sources. Wrong statistics within a federated DBMS can cause not only suboptimal data access strategies but also unbalanced workload distribution as well as unnecessarily high network traffic and communication overhead. The maintenance of statistics in a federated DBMS is troublesome due to the independence of the remote DBMSs that might not expose their statistics or use different models and not collect all statistics needed by the federated DBMS. We present an approach that extends DB2’s learning optimizer to automatically find flaws in statistics on remote data by extending its query feedback loop towards the federated architecture. We will discuss several approaches to get feedback from remote queries and present our solution that utilizes local query feedback and remote query feedback to retrieve information needed to compute statistics profiles. We provide a detailed performance study and analysis of our approach, and demonstrate in a case study a potential query execution speedup of orders of magnitude while only incurring a moderate overhead during query execution.

Similar Papers
  • Conference Article
  • Citations136

Partout

  • Apr 07, 2014
  • Luis Galárraga +2
  • Book Chapter
  • Citations130

Chapter 18 - Generic Database Cost Models for Hierarchical Memory Systems

  • Jan 01, 2002
  • Proceedings 2002 VLDB Conference
  • Stefan Manegold +2
  • Dissertation
  • Citations3

Consultas por similaridade complexas em gerenciadores relacionais

  • Jan 01, 2014
  • Adriano Siqueira Arantes
  • Research Article
  • Citations14

Cache-Based Multi-Query Optimization for Data-Intensive Scalable Computing Frameworks

  • Mar 04, 2020
  • Information Systems Frontiers
  • Pietro Michiardi +2
  • Conference Article

Assessing the Impact of Supporting Information on the Scheduling of Scientific Workflows on Clouds

  • Jul 06, 2018
  • Eduardo Cotrin Teixeira +2
  • Conference Article
  • Citations26

Divergent physical design tuning for replicated databases

  • May 20, 2012
  • Mariano P Consens +3
  • Book Chapter
  • Citations1

Optimization of Massively Parallel Data Flows

  • Nov 28, 2013
  • Fabian Hueske +1
  • Research Article

Unraveling the Impact of Window Semantics: Optimizing Join Order for Efficient Stream Processing

  • Apr 01, 2025
  • Proceedings of the VLDB Endowment
  • Ariane Ziehn +3
  • Research Article
  • Citations4

Efficient execution plan for egress traffic engineering

  • Feb 15, 2021
  • Computer Networks
  • Ibrahim Shaer +3
  • Research Article
  • Citations2

Algorithms for data warehouse design to enhance decision-making

  • Mar 01, 2008
  • WSEAS Transactions on Computers archive
  • Ziyati Elhoussaine +2
  • Conference Article
  • Citations5

Modeling and analysis of a multilevel caching in distributed database systems

  • Jan 01, 2004
  • D.S El Zanfaly +2
  • Research Article
  • Citations12

Heuristic and Cost-Based Optimization for Diverse Provenance Tasks

  • Jul 01, 2019
  • IEEE Transactions on Knowledge and Data Engineering
  • Xing Niu +6
  • Book Chapter
  • Citations14

Distributed query optimization in loosely coupled multidatabase systems

  • Jan 01, 1995
  • Silvio Salza +2
  • Supplementary Content

QoS-aware query processing for wireless sensor networks

  • Jan 01, 2013
  • Figshare
  • Shaila Pervin
  • Book Chapter
  • Citations3

An Efficient Multi Join Query Optimization for Relational Database Management System Using Two Phase Artificial Bess Colony Algorithm

  • Jan 01, 2015
  • Ahmed Khalaf Zager Alsaedi +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.