• Home
  • Search
  • Data Centric Text Processing Using MapReduce
  • https://doi.org/10.1007/978-3-319-28031-8_11Copy DOI Icon

Data Centric Text Processing Using MapReduce

  • Dec 15, 2015
  • N Sandhya +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Processing huge volume of data opened new opportunities in ecommerce, engineering, business and large computing applications. MapReduce programming model is a parallel data processing approach for execution on computer clusters. This model provides an abstraction to design scalable computing algorithm for big data processing. For batch processing types of data processing, MapReduce model provides faster computation. The key/value pair generation of MapReduce program creates memory overhead and deserialization overhead due to data redundancy. Redundancy of data is one of the most important factors that consumes space and affect system performance while using large set of data. This overhead can be avoided considerably by using a novel approach that we developed named Data Triggered Multithreaded Programming (DTMP) model. In this paper, we demonstrate the use of DTMP model using a large dataset with author details and his publications. The Data Triggered Multithreaded Programming can dynamically allocate the resources and can identify the data repetition occurring during computation. DTMP model when applied to the MapReduce programming model brings performance improvement to the system. The major contributions of this work are a simple, scalable and powerful processing of text data that enables automatic parallelization and distribution of large-scale computations.

Similar Papers
  • Conference Article

Teaching large scale data processing

  • Oct 24, 2008
  • Kang Chen +2
  • Research Article
  • Citations2

GMR: graph-compatible MapReduce programming model

  • Aug 23, 2017
  • Multimedia Tools and Applications
  • Weidong Zhang +3
  • Research Article
  • Citations298

Machine learning for Big Data analytics in plants.

  • Sep 14, 2014
  • Trends in Plant Science
  • Chuang Ma +2
  • Conference Article
  • Citations2

A hybrid mapreduce model for prolog

  • Dec 01, 2014
  • Joana Corte-Real +2
  • Conference Article
  • Citations6

Comparison of Parallel Programming Models on Intel MIC Computer Cluster

  • May 01, 2014
  • Chenggang Lai +4
  • PDF
  • Research Article
  • Citations10

Big Data Recommendation Research Based on Travel Consumer Sentiment Analysis.

  • Feb 28, 2022
  • Frontiers in Psychology
  • Zhu Yuan
  • Conference Article
  • Citations2

A case for MapReduce over the internet

  • Aug 09, 2013
  • Hrishikesh Gadre +3
  • Research Article
  • Citations4

Горизонтальне та вертикальне масштабування методів машинного навчання

  • Jan 01, 2019
  • PROBLEMS IN PROGRAMMING
  • B.O Biletskyy
  • Conference Article
  • Citations28

Apache Hadoop Yarn Parameter configuration Challenges and Optimization

  • Feb 01, 2015
  • Bhavin J Mathiya +1
  • Conference Article
  • Citations40

Provenance for MapReduce-based data-intensive workflows

  • Nov 14, 2011
  • Daniel Crawl +2
  • Conference Article
  • Citations1

The Algorithm for Constructing Extremal Graphs Based on MapReduce

  • Oct 01, 2012
  • Sun Yongqi +2
  • Conference Article
  • Citations2

Working Pattern Recognition of Airborne Fire Control Radar for Unbalanced Data

  • Jun 19, 2020
  • Yanping Liao +1
  • Research Article
  • Citations19

Survey on Programming Models and Environments for Cluster, Cloud, and Grid Computing that Defends Big Data

  • Jan 01, 2015
  • Procedia Computer Science
  • J Christy Jackson +3
  • Conference Article
  • Citations9

Verification and validation of Parallel Support Vector Machine algorithm based on MapReduce Program model on Hadoop cluster

  • Dec 01, 2013
  • M Kiran +2
  • Conference Instance

Proceedings of the stated meeting held Wednesday, May 16, 1900

  • Jun 01, 1900
  • Journal of the Franklin Institute
  • Wm.H Wahl
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.