• Home
  • Search
  • GMR: graph-compatible MapReduce programming model
  • Cite Icon2
  • https://doi.org/10.1007/s11042-017-5102-2Copy DOI Icon

GMR: graph-compatible MapReduce programming model

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The MapReduce programming model is widely used to parallelize data processing over the large scale of commodity computer clusters. However, on account of its monotonous data representation, it fails to express graph-parallel algorithms naturally and execute them efficiently. Alternatively, Pregel and PowerGraph could address these challenges. But they require users to familiarize another set of programming patterns and platforms, and at the same time the legacy MapReduce code also becomes incompatible and useless. In this paper, we proposed the Graph-compatible MapReduce (GMR) as an extension of Google's Standard MapReduce (SMR). In this way, graph-parallel algorithm will be naturally expressed without compromising the efficiency and simplicity, and meanwhile the conventional MapReduce programming pattern be preserved. Also, users could gain the convenience of "Think like a vertex". Based on the experimental studying, we analyzed the ratio of the redundant computation, transmission and data caching introduced in naive iterative MapReduce platforms (e.g., HaLoop, Twister). Furthermore, we discussed the difference between GMR and the graph-targeted frameworks. The evaluation experiment results show that GMR outperforms GraphX in a series of real-world graph-parallel algorithms.

Similar Papers
  • Book Chapter

Data Centric Text Processing Using MapReduce

  • Dec 15, 2015
  • N Sandhya +1
  • Conference Article

Teaching large scale data processing

  • Oct 24, 2008
  • Kang Chen +2
  • Conference Article
  • Citations2

A hybrid mapreduce model for prolog

  • Dec 01, 2014
  • Joana Corte-Real +2
  • Conference Article
  • Citations9

Verification and validation of Parallel Support Vector Machine algorithm based on MapReduce Program model on Hadoop cluster

  • Dec 01, 2013
  • M Kiran +2
  • Book Chapter
  • Citations1

Parallel kNN Queries for Big Data Based on Voronoi Diagram Using MapReduce

  • Jan 01, 2016
  • Wei Yan
  • Conference Article
  • Citations2

A case for MapReduce over the internet

  • Aug 09, 2013
  • Hrishikesh Gadre +3
  • Research Article
  • Citations4

Горизонтальне та вертикальне масштабування методів машинного навчання

  • Jan 01, 2019
  • PROBLEMS IN PROGRAMMING
  • B.O Biletskyy
  • Conference Article
  • Citations3

Parallel Processing of Frequent Itemset Based on MapReduce Programming Model

  • Sep 01, 2019
  • Rajshree A Deshmukh +2
  • Conference Article
  • Citations28

Apache Hadoop Yarn Parameter configuration Challenges and Optimization

  • Feb 01, 2015
  • Bhavin J Mathiya +1
  • Conference Article
  • Citations2

MapReduce based Heart Disease Prediction System

  • Mar 17, 2021
  • Fathimabi Shaik +2
  • Research Article
  • Citations11

A haoop-based parallel mining of frequent itemsets using N-Lists

  • Apr 03, 2018
  • Journal of the Chinese Institute of Engineers
  • Mohammad Karim Sohrabi +1
  • Conference Article

Short-term Electricity Load Forecasting Using a MapReduce-based Elman Networks with Coarse-grained Parallel Genetic Optimization

  • Dec 01, 2019
  • Guangqing Bao +3
  • Conference Article
  • Citations727

MapReduce online

  • Apr 28, 2010
  • Tyson Condie +5
  • Conference Article
  • Citations163

Online aggregation and continuous query support in MapReduce

  • Jun 06, 2010
  • Tyson Condie +7
  • Conference Article
  • Citations52

MITHRA: Multiple data independent tasks on a heterogeneous resource architecture

  • Jan 01, 2009
  • Reza Farivar +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.