• Home
  • Search
  • Short text classification with machine learning in the social sciences: The case of climate change on Twitter.
  • Open Access IconOpen Access
  • Cite Icon26
  • https://doi.org/10.1371/journal.pone.0290762Copy DOI Icon

Short text classification with machine learning in the social sciences: The case of climate change on Twitter.

  • Sep 29, 2023
  • PLOS ONE
  • Karina Shyrokykh +2 more
Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To analyse large numbers of texts, social science researchers are increasingly confronting the challenge of text classification. When manual labeling is not possible and researchers have to find automatized ways to classify texts, computer science provides a useful toolbox of machine-learning methods whose performance remains understudied in the social sciences. In this article, we compare the performance of the most widely used text classifiers by applying them to a typical research scenario in social science research: a relatively small labeled dataset with infrequent occurrence of categories of interest, which is a part of a large unlabeled dataset. As an example case, we look at Twitter communication regarding climate change, a topic of increasing scholarly interest in interdisciplinary social science research. Using a novel dataset including 5,750 tweets from various international organizations regarding the highly ambiguous concept of climate change, we evaluate the performance of methods in automatically classifying tweets based on whether they are about climate change or not. In this context, we highlight two main findings. First, supervised machine-learning methods perform better than state-of-the-art lexicons, in particular as class balance increases. Second, traditional machine-learning methods, such as logistic regression and random forest, perform similarly to sophisticated deep-learning methods, whilst requiring much less training time and computational resources. The results have important implications for the analysis of short texts in social science research.

Loading PDF

Similar Papers
  • Research Article
  • Citations5

Don't Sell Social Science Short

  • Jun 09, 2006
  • Science
  • Dennis S Ojima +17
  • Research Article
  • Citations11

Eclecticism as the Foundation of Meta-theoretical, Mixed Methods and Interdisciplinary Research in Social Sciences

  • Nov 12, 2011
  • Integrative Psychological and Behavioral Science
  • Karmo Kroos
  • Research Article
  • Citations4

Comparison of Deep Learning and Traditional Machine Learning Models for Predicting Mild Cognitive Impairment Using Plasma Proteomic Biomarkers.

  • Mar 08, 2025
  • International journal of molecular sciences
  • Kesheng Wang +6
  • Research Article
  • Citations1

Power and Agency: The Discipline-Shifting Work of James C. Scott

  • Apr 21, 2021
  • The Journal of Asian Studies
  • Meredith L Weiss +1
  • Research Article
  • Citations26

A Citizen’s Claim: Science With and for Society

  • Jul 18, 2020
  • Qualitative Inquiry
  • Marta Soler +1
  • Research Article
  • Citations3

Short text classification using semantically enriched topic model

  • Mar 20, 2024
  • Journal of Information Science
  • Farid Uddin +3
  • PDF
  • Research Article
  • Citations19

Social Science Applications in Sustainable Aviation Biofuels Research: Opportunities, Challenges, and Advancements

  • Jan 24, 2022
  • Frontiers in Energy Research
  • Brian J Anderson +4
  • Research Article
  • Citations25

Addressing the policy challenges and opportunities of “Big data”

  • Jun 01, 2013
  • Policy & Internet
  • Helen Margetts +1
  • Book Chapter
  • Citations13

Wikipedia Based Short Text Classification Method

  • Jan 01, 2017
  • Junze Li +4
  • Research Article

Philosophical Alignments in Social Science Inquiry: A Scoping Review

  • Aug 19, 2021
  • Asian Journal of Management
  • F B Tende
  • Research Article
  • Citations94

Structural equation modeling in social science research

  • Jun 22, 2012
  • European Business Review
  • Barry J Babin +1
  • Research Article
  • Citations19

Social science contributions compared in synthetic biology and nanotechnology

  • Jan 02, 2015
  • Journal of Responsible Innovation
  • Philip Shapira +2
  • Research Article
  • Citations2

Experiences of social scientists in health research settings: SBM Leadership Institute.

  • Oct 08, 2020
  • Translational behavioral medicine
  • Nora B Henrikson
  • Conference Article
  • Citations19

Adapting deep learning for sentiment classification of code-switched informal short text

  • Mar 30, 2020
  • Muhammad Haroon Shakeel +1
  • Research Article
  • Citations182

A topography of climate change research

  • Jan 27, 2020
  • Nature Climate Change
  • Max W Callaghan +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.