• Home
  • Search
  • A Survey on Cleaning Dirty Data Using Machine Learning Paradigm for Big Data Analytics
  • Open Access IconOpen Access
  • Cite Icon48
  • https://doi.org/10.11591/ijeecs.v10.i3.pp1234-1243Copy DOI Icon

A Survey on Cleaning Dirty Data Using Machine Learning Paradigm for Big Data Analytics

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

<span>Recently Big Data has become one of the important new factors in the business field. This needs to have strategies to manage large volumes of structured, unstructured and semi-structured data. It’s challenging to analyze such large scale of data to extract data meaning and handling uncertain outcomes. Almost all big data sets are dirty, i.e. the set may contain inaccuracies, missing data, miscoding and other issues that influence the strength of big data analytics. One of the biggest challenges in big data analytics is to discover and repair dirty data; failure to do this can lead to inaccurate analytics and unpredictable conclusions. Data cleaning is an essential part of managing and analyzing data. In this survey paper, data quality troubles which may occur in big data processing to understand clearly why an organization requires data cleaning are examined, followed by data quality criteria (dimensions used to indicate data quality). Then, cleaning tools available in market are summarized. Also challenges faced in cleaning big data due to nature of data are discussed. Machine learning algorithms can be used to analyze data and make predictions and finally clean data automatically.</span>

Similar Papers
  • PDF
  • Research Article
  • Citations3

Challenges in Big Data Analytics and Cloud Computing

  • May 10, 2021
  • International Journal of Business and Management Research
  • P Madana Mohan +1
  • Conference Article
  • Citations2

Security Issues and Challenges of Big Data Analytics

  • Nov 25, 2022
  • Richa Verma +1
  • Research Article
  • Citations7

Challenges and Opportunities of Big Data Analytics for Human Resource Management in Mining and Metal Industries

  • Dec 20, 2023
  • Journal of Mines, Metals and Fuels
  • Prakash Chandra Mishra +1
  • Front Matter

Preface

  • Jan 01, 2021
  • Journal of Physics: Conference Series
  • Conference Article
  • Citations1

Hybrid Machine Learning-Based Intelligent Technique for Improved Big Data Analytics

  • Nov 01, 2019
  • Andronicus A Akinyelu
  • Conference Article
  • Citations19

Insight of big data analytics in healthcare industry

  • Apr 01, 2016
  • Satwik Sabharwal +2
  • Conference Article

Profit Optimization for Splitting and Sampling Based Resource Management in Big Data Analytics-as-a-Service Platforms in Cloud Computing Environments

  • Sep 01, 2019
  • Yali Zhao +3
  • Research Article
  • Citations4

Usability enhancement model for unstructured text in big data

  • Nov 08, 2023
  • Journal of Big Data
  • Kiran Adnan +2
  • Conference Article
  • Citations8

An evaluation of big data analytics in feature selection for long-lead extreme floods forecasting

  • Apr 01, 2016
  • Yong Zhuang +3
  • Research Article
  • Citations256

Live Data Analytics With Collaborative Edge and Cloud Processing in Wireless IoT Networks

  • Jan 01, 2017
  • IEEE Access
  • Shree Krishna Sharma +1
  • PDF
  • Research Article
  • Citations3

Legal Governance of Brain Data Derived from Artificial Intelligence

  • Jun 02, 2021
  • Voices in Bioethics
  • Mahika Ahluwalia
  • Research Article
  • Citations123

Artificial intelligence for hospitality big data analytics: developing a prediction model of restaurant review helpfulness for customer decision-making

  • Jun 10, 2021
  • International Journal of Contemporary Hospitality Management
  • Minwoo Lee +2
  • PDF
  • Research Article
  • Citations56

Pushing the limits of solubility prediction via quality-oriented data selection.

  • Dec 17, 2020
  • iScience
  • Murat Cihan Sorkun +2
  • Book Chapter
  • Citations1

Big Data to Improve Public Health in Low- and Middle-Income Countries

  • Jan 01, 2021
  • Songul Cinaroglu
  • Research Article
  • Citations125

Big Data Analytics for Large-scale Wireless Networks

  • Sep 13, 2019
  • ACM Computing Surveys
  • Hong-Ning Dai +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.