• Home
  • Search
  • Automatic Taxonomy Generation and Incremental Evolution on Apache Spark Parallelization Framework
  • Open Access IconOpen Access
  • Cite Icon1
  • https://doi.org/10.51153/kjcis.v5i1.83Copy DOI Icon

Automatic Taxonomy Generation and Incremental Evolution on Apache Spark Parallelization Framework

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

The term “Big Data” refers to a large volume of information usually in terabytes and petabytes. It includes both structured and unstructured data. Unstructured data is conventionally text-heavy, but may also contain data such as facts, dates and numbers. To use this unstructured information effectively, it needs to be processed and organized. Taxonomy is considered as a powerful way of organizing the information. For automatic taxonomy generation, various techniques have been proposed in the past. However, the substantial nature of big data presently crosses the processing abilities of traditional techniques. Thus, to meet this challenge an extensible and scalable technique is required to potentially accelerate the process of taxonomy generation and its evolution upon arrival of new data, hence catering large amount of unstructured big data. This paper proposes a technique for both the taxonomy generation and evolution on Apache Spark infrastructure. The proposed technique is evaluated on a text dataset of a computing domain. The evaluation results show that the technique presented in this paper outperformed the existing techniques in terms of time and quality metrics. The time and quality-based evaluation showed that the use of MapReduce environment has resolved the scalability issues of current taxonomy generation and evolution process.

Similar Papers
  • Conference Article
  • Citations34

Structured and Unstructured Big Data Analytics

  • Sep 01, 2017
  • Suyash Mishra +1
  • PDF
  • Research Article
  • Citations2

Multilabel Emotion Recognition Technique considering the Characteristics of Unstructured Conversation Data

  • May 09, 2022
  • Mobile Information Systems
  • Myungjin Lim +3
  • Research Article

Enterprise big data analysis using SVM classifier and lexicon dictionary

  • Jan 01, 2019
  • International Journal of Enterprise Network Management
  • C Nelson Kennedy Babu +1
  • Book Chapter
  • Citations17

Interactive Big Data Management in Healthcare Using Spark

  • Jan 01, 2016
  • J Archenaa +1
  • Conference Article
  • Citations13

Big Data Pipeline with ML-Based and Crowd Sourced Dynamically Created and Maintained Columnar Data Warehouse for Structured and Unstructured Big Data

  • Mar 01, 2020
  • Kamran Ghane
  • Research Article

Factors Affecting The Usability Of Unstructured Big Data

  • Jan 01, 2020
  • Journal of Independent Studies and Research Computing
  • Joshua Devadason +1
  • Conference Article
  • Citations19

A Proposed Framework for Improving Analysis of Big Unstructured Data in Social Media

  • Dec 01, 2019
  • Mohamed Elsayed +2
  • Research Article
  • Citations20

Automated extraction of fragments of Bayesian networks from textual sources

  • Jul 12, 2017
  • Applied Soft Computing
  • Marcello Trovati +3
  • Research Article
  • Citations5

Application of Big Data Analysis and Cloud Computing in Network Platform Building

  • Sep 01, 2021
  • Journal of Physics: Conference Series
  • Jichao Sun +4
  • Conference Article
  • Citations17

Big data: Concept, applications, & challenges

  • Nov 01, 2016
  • Novan Zulkarnain +1
  • Research Article

Dynamic Multi-objective Resource Optimization in Big Data Clusters

  • Aug 12, 2021
  • International Journal of Innovative Research in Engineering & Multidisciplinary Physical Sciences
  • Kanagalakshmi Murugan
  • PDF
  • Research Article
  • Citations4

Editorial: What Can We Expect from Data Scientists

  • Jan 01, 2017
  • Journal of theoretical and applied electronic commerce research
  • Kurt Englmeier +1
  • Research Article
  • Citations5

Call for Special Issue Papers: Big Data in Business.

  • Oct 07, 2019
  • Big data
  • Haitham Nobanee
  • Conference Article
  • Citations372

BigBench

  • Jun 22, 2013
  • Ahmad Ghazal +6
  • Research Article
  • Citations1

What Does Knowledge Organization Mean in a Big Data Environment

  • Dec 12, 2013
  • SRELS Journal of Information Management
  • Michael Shepherd +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.