• Home
  • Search
  • Large Language Models in Crisis Informatics for Zero and Few-Shot Classification
  • Cite Icon2
  • https://doi.org/10.1145/3736160Copy DOI Icon

Large Language Models in Crisis Informatics for Zero and Few-Shot Classification

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This article presents an exploration of the use of pre-trained Large Language Models (LLMs) for crisis classification to address labeled data dependency issues. We present a methodology that enhances open LLMs through fine-tuning, creating zero-shot and few-shot classifiers that approach traditional supervised models in classifying crisis-related messages. A comparative study evaluates crisis classification tasks using general domain pre-trained LLMs, crisis-specific LLMs, and traditional supervised learning methods, establishing a benchmark in the field. Our task-specific fine-tuned Llama model achieved a 69% macro F1 score in classifying humanitarian information—a remarkable 26% improvement compared to the Llama baseline, even with limited training data. Moreover, it outperformed ChatGPT4 by 3% in macro F1. This improvement increased to 71% macro F1 when fine-tuning Llama with multitask data. For the binary classification of messages as related vs. not related to crises, we observed that pre-trained LLMs, such as Llama 2 and ChatGPT4, performed well without fine-tuning, achieving an 87% macro F1 score with ChatGPT4. This research expands our knowledge of how to exploit the potential of LLMs for crisis classification, representing a great opportunity for crisis scenarios that lack labeled data. The findings emphasize the potential of LLMs in crisis informatics to address cold start challenges, especially critical in the initial phases of a disaster, while also showcasing their capacity to attain high accuracy even with limited training data.

Similar Papers
  • Conference Article

Automated Inline Comment Smell Detection and Repair with Large Language Models

  • Nov 16, 2025
  • Hatice Kübra Çağlar +2
  • Research Article

P0386 Automated Montreal Classification Extraction from Real-World Colonoscopy Narratives Using a Hybrid NLP–LLM Framework

  • Jan 01, 2026
  • Journal of Crohn’s and Colitis
  • B F Agargun +13
  • Dissertation

Leveraging linguistic knowledge to enhance low-resource NLP applications

  • Jan 01, 2025
  • Zixiao Zhu
  • Research Article
  • Citations3

Towards Vietnamese Question and Answer Generation: An Empirical Study

  • Aug 16, 2024
  • ACM Transactions on Asian and Low-Resource Language Information Processing
  • Quoc-Hung Pham +8
  • Research Article

Detecting \u201clarge language models fingerprint\u201d for Japanese texts generated by six LLMs

  • Jan 01, 2026
  • Frontiers in Artificial Intelligence
  • Wataru Zaitsu +4
  • PDF
  • Research Article

Comparison of proprietary and fine-tuned large language models for multi-label classification of billing codes from radiology reports.

  • Aug 01, 2026
  • European radiology
  • Kamyar Arzideh +12
  • Research Article

Context-Aware Sentence Classification of Radiology Reports Using Synthetic Data: Development and Validation Study.

  • Apr 10, 2026
  • Journal of medical Internet research
  • Tomohiro Kikuchi +6
  • Research Article
  • Citations4

Enhancing sentiment and intent analysis in public health via fine-tuned Large Language Models on tobacco and e-cigarette-related tweets

  • Nov 28, 2024
  • Frontiers in Big Data
  • Sherif Elmitwalli +3
  • PDF
  • Research Article
  • Citations5

Large language models are few-shot multivariate time series classifiers

  • Aug 07, 2025
  • Data Mining and Knowledge Discovery
  • Yakun Chen +4
  • Research Article
  • Citations19

Ophthalmological Question Answering and Reasoning Using OpenAI o1 vs Other Large Language Models

  • Jul 31, 2025
  • JAMA Ophthalmology
  • Sahana Srinivasan +18
  • Research Article

BeigeSage: sentiment classification in economic texts utilizing LLMs and fine-tuned BERT models

  • Mar 25, 2026
  • Applied Economics
  • Charlie Smith +1
  • Research Article
  • Citations6

NLP modeling recommendations for restricted data availability in clinical settings

  • Mar 07, 2025
  • BMC Medical Informatics and Decision Making
  • Fabián Villena +2
  • PDF
  • Research Article
  • Citations115

CancerGPT for few shot drug pair synergy prediction using large pretrained language models

  • Feb 19, 2024
  • NPJ Digital Medicine
  • Tianhao Li +6
  • PDF
  • Preprint Article

Knowledge Enhancement of Small-Scale Models in Medical Question Answering (Preprint)

  • Nov 03, 2024
  • Xinbai Li +3
  • Research Article
  • Citations3

Improving drug identification in overdose death surveillance by using clinical natural language processing models.

  • Feb 08, 2026
  • Journal of forensic sciences
  • Arthur J Funnell +8
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.