• Home
  • Search
  • Data Dimension Reduction makes ML Algorithms efficient
  • Open Access IconOpen Access
  • Cite Icon7
  • https://doi.org/10.1109/icetecc56662.2022.10069527Copy DOI Icon

Data Dimension Reduction makes ML Algorithms efficient

  • Dec 7, 2022
  • Wisal Khan +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the Variance approach, LSA-Transform, the Combined and Direct approaches, and the New Random Approach. Auto-encoders (AE) are used to learn end-to-end mapping. In this paper, we demonstrate that pre-processing not only speeds up the algorithms but also improves accuracy in both supervised and unsupervised learning. In pre-processing of DDR, first PCA based DDR is used for supervised learning, then we explore AE based DDR for unsupervised learning. In PCA based DDR, we first compare supervised learning algorithms accuracy and time before and after applying PCA. Similarly, in AE based DDR, we compare unsupervised learning algorithm accuracy and time before and after AE representation learning. Supervised learning algorithms including support-vector machines (SVM), Decision Tree with GINI index, Decision Tree with entropy and Stochastic Gradient Descent classifier (SGDC) and unsupervised learning algorithm including K-means clustering, are used for classification purpose. We used two datasets MNIST and FashionMNIST Our experiment shows that there is massive improvement in accuracy and time reduction after pre-processing in both supervised and unsupervised learning.

Similar Papers
  • Dissertation

TOPIC CLASSIFICATION USING HYBRID OF UNSUPERVISED AND SUPERVISED LEARNING

  • May 20, 2019
  • Jayant Shelke
  • PDF
  • Research Article
  • Citations77

ResNet Autoencoders for Unsupervised Feature Learning From High-Dimensional Data: Deep Models Resistant to Performance Degradation

  • Jan 01, 2021
  • IEEE Access
  • Chathurika S Wickramasinghe +2
  • Conference Article

AI-Powered Personalized Nutrition Based on Biochemical Data: An Exploration of Machine Learning Applications

  • Mar 14, 2025
  • Rukshanda Rahman +6
  • PDF
  • Research Article
  • Citations1

Comparison of Unsupervised Learning Methods for Natural Image Processing

  • Jul 04, 2019
  • Biodiversity Information Science and Standards
  • Wilfried Wöber +5
  • Conference Article

Automatic labelling of clusters with discrete and continuous data using supervised machine learning

  • Oct 01, 2016
  • Joselito Mendes De Sousa +4
  • Research Article
  • Citations65

Application of Machine Learning Algorithms for Asthma Management with mHealth: A Clinical Review.

  • Jun 01, 2022
  • Journal of asthma and allergy
  • Kevin C H Tsang +3
  • Research Article
  • Citations8

Longitudinal twin growth discordance patterns and adverse perinatal outcomes.

  • Jul 01, 2025
  • American journal of obstetrics and gynecology
  • Smriti Prasad +4
  • PDF
  • Research Article
  • Citations4

Hybrid feature selection model based on machine learning and knowledge graph

  • Nov 01, 2021
  • Journal of Physics: Conference Series
  • Xiaoqing Peng +3
  • PDF
  • Research Article
  • Citations49

On the analysis of clonogenic survival data: Statistical alternatives to the linear-quadratic model

  • Jan 28, 2016
  • Radiation Oncology (London, England)
  • Steffen Unkel +2
  • Book Chapter
  • Citations5

Unsupervised Learning with Restricted Boltzmann Machines and Auto-encoders

  • Jan 01, 2017
  • Santanu Pattanayak
  • Research Article
  • Citations3

Simulation Algorithm Benefits by Connecting Geostatistics With Unsupervised Learning

  • Oct 01, 2018
  • Journal of Petroleum Technology
  • Adam Wilson
  • Research Article
  • Citations141

Deep variational auto-encoders: A promising tool for dimensionality reduction and ball bearing elements fault diagnosis

  • Jul 20, 2018
  • Structural Health Monitoring
  • Gabriel San Martin +3
  • Research Article
  • Citations6

An assessment of machine learning algorithms for healthcare analysis based on improved MapReduce

  • Sep 21, 2022
  • Advances in Engineering Software
  • J Sukanya +2
  • Research Article
  • Citations53

Machine learning-based multi-modal information perception for soft robotic hands

  • Sep 24, 2019
  • Tsinghua Science and Technology
  • Haiming Huang +5
  • Conference Article
  • Citations31

SpikeDyn: A Framework for Energy-Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments

  • Dec 05, 2021
  • arXiv (Cornell University)
  • Rachmad Vidya Wicaksana Putra +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.