• Home
  • Search
  • BeigeSage: sentiment classification in economic texts utilizing LLMs and fine-tuned BERT models
  • https://doi.org/10.1080/00036846.2026.2647124Copy DOI Icon

BeigeSage: sentiment classification in economic texts utilizing LLMs and fine-tuned BERT models

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

ABSTRACT Large language models (LLMs) possess the contextual awareness and scale of pre-training needed to perform sentiment analysis on complex economic texts with human-like accuracy and computer-like speed. This study compares the ability of five LLMs (ChatGPT, Llama, Phi, Gemma, and a fine-tuned BERT model named BeigeSage) alongside a traditional rule-based method (VADER) to classify sentiment in the Federal Reserve’s Beige Book reports. Human annotators created a labelled dataset of 1000 Beige Book text chunks, and each model was evaluated using accuracy, macro F1 score, and Matthews correlation coefficient across three sentiment classes: positive, negative, and mixed. While all LLMs substantially outperformed the traditional method, BeigeSage achieved the highest overall performance, demonstrating both strong general accuracy and balance across all sentiment categories, especially for difficult passages containing mixed sentiment. Results also show that smaller open-source models like Phi and Llama can match or exceed ChatGPT’s accuracy while offering faster or lower-cost deployment. These findings suggest that fine-tuning LLMs with domain-specific labelled data significantly enhances classification quality.

Similar Papers
  • Research Article
  • Citations2

Large Language Models in Crisis Informatics for Zero and Few-Shot Classification

  • May 22, 2025
  • ACM Transactions on the Web
  • Cinthia Sánchez +2
  • Conference Article

Automated Inline Comment Smell Detection and Repair with Large Language Models

  • Nov 16, 2025
  • Hatice Kübra Çağlar +2
  • PDF
  • Research Article

Comparison of proprietary and fine-tuned large language models for multi-label classification of billing codes from radiology reports.

  • Aug 01, 2026
  • European radiology
  • Kamyar Arzideh +12
  • Research Article

Detecting \u201clarge language models fingerprint\u201d for Japanese texts generated by six LLMs

  • Jan 01, 2026
  • Frontiers in Artificial Intelligence
  • Wataru Zaitsu +4
  • PDF
  • Research Article
  • Citations32

Automatic structuring of radiology reports with on-premise open-source large language models

  • Oct 10, 2024
  • European Radiology
  • Piotr Woźnicki +11
  • Research Article
  • Citations4

Zero-shot learning for clinical phenotyping: Comparing LLMs and rule-based methods.

  • Jun 01, 2025
  • Computers in biology and medicine
  • Bernardo Neves +6
  • Research Article
  • Citations4

M2CVD: Enhancing Vulnerability Understanding through Multi-Model Collaboration for Code Vulnerability Detection

  • Oct 16, 2025
  • ACM Transactions on Software Engineering and Methodology
  • Ziliang Wang +6
  • Research Article
  • Citations19

Ophthalmological Question Answering and Reasoning Using OpenAI o1 vs Other Large Language Models

  • Jul 31, 2025
  • JAMA Ophthalmology
  • Sahana Srinivasan +18
  • Research Article

Evaluation of GPT-5 for Esophageal Cancer Staging Using Fluorodeoxyglucose Positron Emission Tomography Maximum-Intensity Projection Images: Comparative Pilot Study.

  • Feb 23, 2026
  • JMIR cancer
  • Hiroki Maruyama +7
  • PDF
  • Research Article
  • Citations115

CancerGPT for few shot drug pair synergy prediction using large pretrained language models

  • Feb 19, 2024
  • NPJ Digital Medicine
  • Tianhao Li +6
  • Research Article
  • Citations5

Can general purpose large language models assist pediatricians in predicting infants with serious bacterial infection?

  • Nov 14, 2025
  • BMC Medical Informatics and Decision Making
  • Ivan Šimunović +9
  • Research Article

P0386 Automated Montreal Classification Extraction from Real-World Colonoscopy Narratives Using a Hybrid NLP–LLM Framework

  • Jan 01, 2026
  • Journal of Crohn’s and Colitis
  • B F Agargun +13
  • Research Article

Detecting Stigmatizing Language in Clinical Notes with Large Language Models for Addiction Care

  • Aug 12, 2025
  • medRxiv
  • R Sethi +8
  • Research Article

Benchmarking ESG Risk Classification in 10-K Filings

  • Jul 19, 2026
  • Journal of Computer Information Systems
  • Ace Vo +3
  • Research Article
  • Citations9

Stylometry recognizes human and LLM-generated texts in short samples

  • Jan 01, 2026
  • Expert Systems with Applications
  • Karol Przystalski +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.