• Home
  • Search
  • Single-scan: a fast star-join query processing algorithm
  • Cite Icon5
  • https://doi.org/10.1002/spe.2308Copy DOI Icon

Single-scan: a fast star-join query processing algorithm

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

A data warehouse can store very large amounts of data that should be processed in parallel in order to achieve reasonable query execution times. The MapReduce programming model is a very convenient way to process large amounts of data in parallel on commodity hardware clusters. A very popular query used in data warehouses is star-join. In this paper, we present a fast and efficient star-join query execution algorithm built on top of a MapReduce framework called Hadoop. By using dynamic filters against dimension tables, the algorithm needs a single scan of the fact table, which means a significant reduction of input/output operations and computational complexity. Also, the algorithm requires only two MapReduce iterations in total-one to build the filters against dimension tables and one to scan the fact table. Our experiments show that the proposed algorithm performs much better than the existing solutions in terms of execution time and input/output. Copyright © 2014 John Wiley & Sons, Ltd.

Similar Papers
  • Book Chapter

A Genetic Algorithm for Selecting Horizontal Fragments

  • Jan 01, 2009
  • Ladjel Bellatreche
  • Book Chapter

8 - Dimensions

  • Jan 01, 2005
  • Oracle 10g Data Warehousing
  • Lilian Hobbs +3
  • Research Article
  • Citations138

Why is the snowflake schema a good data warehouse design?

  • Jan 17, 2003
  • Information Systems
  • Mark Levene +1
  • Conference Article
  • Citations1

Spatial data processing with MapReduce

  • Dec 01, 2015
  • Tilani Gunawardena +2
  • Research Article
  • Citations5

Data analysis and data warehouse design based on Pentaho data integration (kettle) to support the determination of student learning achievement

  • Mar 01, 2021
  • IOP Conference Series: Materials Science and Engineering
  • A D Barahama +1
  • Book Chapter
  • Citations1

Study of Meta-Data Enrichment Methods to Achieve Near Real Time ETL

  • Nov 05, 2018
  • N Mohammed Muddasir +1
  • Research Article

Multi connection query optimization in data warehouse dependent on multiple linear regression algorithm

  • May 18, 2018
  • International Journal of Computers and Applications
  • Yuping Jin
  • Conference Article
  • Citations14

Building large ROLAP data cubes in parallel

  • Jul 07, 2004
  • Ying Chen +3
  • PDF
  • Preprint Article

Multi-Cloud workflows with Pangeo and Dask Gateway

  • Feb 05, 2022
  • Tom Augspurger +3
  • Research Article
  • Citations1

A HIGH SPEED VLSI ARCHITECTURE FOR DIGITAL SPEECH WATERMARKING WITH COMPRESSION

  • Apr 01, 2014
  • International Journal of Electronics and Electical Engineering
  • Raja Sree Avirneni +1
  • Conference Article

Leveraging human oversight and intervention in large-scale parallel processing of open-source data

  • May 27, 2015
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Enrico Casini +2
  • Conference Article
  • Citations33

What can partitioning do for your data warehouses and data marts?

  • Sep 18, 2000
  • L Bellatreche +3
  • Research Article
  • Citations13

Prefix filter

  • Mar 01, 2022
  • Proceedings of the VLDB Endowment
  • Tomer Even +2
  • Conference Article
  • Citations10

An adaptive machine learning on Map-Reduce framework for improving performance of large-scale data analysis on EC2

  • Nov 01, 2013
  • Walisa Romsaiyud +1
  • Conference Article
  • Citations3

Bucket MapReduce: Relieving the Disk I/O Intensity of Data-Intensive Applications in MapReduce Frameworks

  • Mar 01, 2021
  • Kai-Hsun Chen +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.