• Cite Icon1
  • https://doi.org/10.1007/978-3-642-03422-0_8Copy DOI Icon

Scalable Data-Intensive Analytics

  • Jan 1, 2009
  • Meichun Hsu +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To effectively handle the scale of processing required in information extraction and analytical tasks in an era of information explosion, partitioning the data streams and applying computation to each partition in parallel is the key. Even though the concept of MapReduce has been around for some time and is well known in the functional programming literatures, it is Google which demonstrated that this very high-level abstraction is especially suitable for data-intensive computation and potentially has very high performance implementation as well. If we observe the behavior of a query plan on a modern shared-nothing parallel database system such as Teradata and HP NeoView, one notices that it also offers large-scale parallel processing while maintaining the high level abstraction of a declarative query language. The correspondence between the MapReduce parallel processing paradigm and the paradigm for parallel query processing has been observed. In addition to integrated schema management and declarative query language, the strengths of parallel SQL engines also include workload management and richer expressive power and parallel processing patterns. Compared to the MapReduce parallel processing paradigm, however, the parallel query processing paradigm has focused on native, built-in, algebraic query operators that are supported in the SQL language. Parallel query processing engines lack the ability to efficiently handle dynamically-defined procedures. While the “user-defined function” in SQL can be used to inject dynamically defined procedures, the ability of standard SQL to support flexibility of their invocation, and efficient implementation of these user-defined functions, especially in a highly scaled-out architecture, are not adequate. This paper discusses some issues and approaches in integrating large scale information extraction and analytical tasks with parallel data management.

Similar Papers
  • Research Article
  • Citations2466

Bounds on Multiprocessing Timing Anomalies

  • Mar 01, 1969
  • SIAM Journal on Applied Mathematics
  • R L Graham
  • Conference Article
  • Citations5

Dynamic parallel query processing for distributed objects

  • Aug 25, 1998
  • Y Jiang +2
  • Research Article

A Service for Parallel Processing of Protected Information Queries in a Multi-Server Environment

  • Nov 11, 2021
  • INFORMACIONNYE TEHNOLOGII
  • R E Asratian
  • Research Article
  • Citations31

Parallel query processing in shared disk database systems

  • Dec 01, 1993
  • ACM SIGMOD Record
  • Erhard Rahm
  • Conference Article
  • Citations12

Cogset: A Unified Engine for Reliable Storage and Parallel Processing

  • Oct 01, 2009
  • Steffen Viken Valvag +1
  • Research Article
  • Citations7

Posting file partitioning and parallel information retrieval

  • Aug 01, 2002
  • The Journal of Systems & Software
  • Yung-Cheng Ma +2
  • Conference Article
  • Citations11

Efficient Scheduling of Resources for Parallel Query Processing on Grid-based Architecture

  • Jan 01, 2005
  • Khin Mar Soe +4
  • Book Chapter
  • Citations26

Parallel query processing

  • Jan 01, 1993
  • P S Yu +3
  • Research Article
  • Citations86

Are graph databases ready for bioinformatics?

  • Oct 17, 2013
  • Bioinformatics
  • Christian Theil Have +1
  • Research Article
  • Citations10

Evaluation of SQL and NoSQL Databases on Parallel Processing

  • Aug 02, 2025
  • Engineering, Technology & Applied Science Research
  • Iyas Qaddara +2
  • Conference Article
  • Citations1

An Approach to Organizing Parallel Distributed Processing of Protected Information Queries in Multi-server Environment

  • Sep 26, 2022
  • Ruben Asratian
  • Research Article
  • Citations2

Complex Question Enhanced Transfer Learning for Zero-Shot Joint Information Extraction

  • Jan 01, 2024
  • IEEE/ACM Transactions on Audio, Speech, and Language Processing
  • Ying Zhang +4
  • Research Article
  • Citations2

Graph-Based Parallel Query Processing and Optimization Strategies for Object-Oriented Databases

  • Jan 01, 1998
  • Distributed and Parallel Databases
  • Stanley Y.W Su +2
  • Conference Article
  • Citations15

The Convex C240 architecture

  • Nov 01, 1988
  • M Chastain +3
  • Conference Article
  • Citations5

A new parallel processing paradigm using a recon. gurable computing system

  • Apr 12, 2005
  • K Shimoo +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.