• Home
  • Search
  • The Effect of Preprocessing on Short Document Clustering
  • Cite Icon5
  • https://doi.org/10.5445/ksp/1000098011/01Copy DOI Icon

The Effect of Preprocessing on Short Document Clustering

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Natural Language Processing has become a common tool to extract relevant information from unstructured data. Messages in social media, customer reviews, and military messages are all very short and therefore harder to handle than longer texts. Document clustering is essential in gaining insight from these unlabeled texts and is typically performed after some preprocessing steps. Preprocessing often removes words. This can become risky in short texts, where the main message is made of only a few words. The effect of preprocessing and feature extraction on these short documents is therefore analyzed in this paper. Six different levels of text normalization are combined with four different feature extraction methods. These setting are all applied on K-means clustering and tested on three different datasets. Anticipated results can not be concluded, however other findings are insightful in terms of the connection between text cleaning and feature extraction.

Similar Papers
  • Book Chapter
  • Citations14

Crime Detection and Analysis from Social Media Messages Using Machine Learning and Natural Language Processing Technique

  • Jan 01, 2022
  • Xolani Lombo +2
  • Research Article
  • Citations5

An Improved Method of Short Text Feature Extraction Based on Words Co-Occurrence

  • Feb 01, 2014
  • Applied Mechanics and Materials
  • Li Hong Wang
  • Research Article
  • Citations214

How publics react to crisis communication efforts

  • Jan 28, 2014
  • Journal of Communication Management
  • W Timothy Coombs +1
  • PDF
  • Research Article
  • Citations36

Content Based Medical Image Retrieval with Texture Content Using Gray Level Co-occurrence Matrix and K-Means Clustering Algorithms

  • Jul 01, 2012
  • Journal of Computer Science
  • Walaa
  • Research Article
  • Citations6

Deep Learning Classification of Traffic-Related Tweets: An Advanced Framework Using Deep Learning for Contextual Understanding and Traffic-Related Short Text Classification

  • Nov 27, 2024
  • Applied Sciences
  • Wasen Yahya Melhem +2
  • Research Article
  • Citations37

Brand choice via incidental social media exposure

  • Jun 12, 2017
  • Journal of Research in Interactive Marketing
  • William F Humphrey Jr +2
  • Research Article
  • Citations62

Putting people in the picture: Combining big location-based social media data and remote sensing imagery for enhanced contextual urban information in Shanghai

  • Nov 10, 2016
  • Computers, Environment and Urban Systems
  • Michael Jendryke +3
  • PDF
  • Research Article
  • Citations131

Using Social Media to Detect Outdoor Air Pollution and Monitor Air Quality Index (AQI): A Geo-Targeted Spatiotemporal Analysis Framework with Sina Weibo (Chinese Twitter).

  • Oct 27, 2015
  • PLOS ONE
  • Wei Jiang +3
  • PDF
  • Research Article
  • Citations54

L-Boost: Identifying Offensive Texts From Social Media Post in Bengali

  • Jan 01, 2021
  • IEEE Access
  • M F Mridha +5
  • Research Article
  • Citations89

Using value modeling to evaluate social media messages: The case of Hurricane Irene

  • Apr 03, 2013
  • Public Relations Review
  • Karen Freberg +3
  • Research Article
  • Citations7

Political Posters Reveal a Tension in WhatsApp Platform Design: An Analysis of Digital Images From India’s 2019 Elections

  • Oct 25, 2021
  • Television & New Media
  • Sananda Sahoo
  • Conference Article
  • Citations56

Sentiment classification for Indonesian message in social media

  • Apr 01, 2012
  • Aqsath Rasyid Naradhipa +1
  • PDF
  • Research Article
  • Citations5

Key Factors for Evaluating Visual Perception Responses to Social Media Video Communication

  • Oct 12, 2022
  • Sustainability
  • Chi-Jui Tsai +1
  • Conference Article

Propaganda Messages in Social Media in Latvia’s Information Space: Analysis of the Russia-Ukraine War

  • May 16, 2025
  • Laura Maļukova
  • Research Article
  • Citations2

SOSYAL MEDYADA KULLANILAN MESAJLARIN HALKLA İLİŞKİLER ÇALIŞMALARINDAKİ ÖNEMİ

  • Apr 01, 2016
  • THE TURKISH ONLINE JOURNAL OF DESIGN, ART AND COMMUNICATION
  • Sevinç Koçak
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.