• Home
  • Search
  • NLP modeling recommendations for restricted data availability in clinical settings
  • Cite Icon6
  • https://doi.org/10.1186/s12911-025-02948-2Copy DOI Icon

NLP modeling recommendations for restricted data availability in clinical settings

Show More
  • Abstract
  • Highlights & Summary
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

BackgroundClinical decision-making in healthcare often relies on unstructured text data, which can be challenging to analyze using traditional methods. Natural Language Processing (NLP) has emerged as a promising solution, but its application in clinical settings is hindered by restricted data availability and the need for domain-specific knowledge.MethodsWe conducted an experimental analysis to evaluate the performance of various NLP modeling paradigms on multiple clinical NLP tasks in Spanish. These tasks included referral prioritization and referral specialty classification. We simulated three clinical settings with varying levels of data availability and evaluated the performance of four foundation models.ResultsClinical-specific pre-trained language models (PLMs) achieved the highest performance across tasks. For referral prioritization, Clinical PLMs attained an 88.85 % macro F1 score when fine-tuned. In referral specialty classification, the same models achieved a 53.79 % macro F1 score, surpassing domain-agnostic models. Continuing pre-training with environment-specific data improved model performance, but the gains were marginal compared to the computational resources required. Few-shot learning with large language models (LLMs) demonstrated lower performance but showed potential in data-scarce scenarios.ConclusionsOur study provides evidence-based recommendations for clinical NLP practitioners on selecting modeling paradigms based on data availability. We highlight the importance of considering data availability, task complexity, and institutional maturity when designing and training clinical NLP models. Our findings can inform the development of effective clinical NLP solutions in real-world settings.

Similar Papers
  • Research Article
  • Citations173

An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing: Algorithm Development and Validation Study.

  • Apr 08, 2024
  • JMIR Medical Informatics
  • Sonish Sivarajkumar +4
  • Research Article
  • Citations3

Improving drug identification in overdose death surveillance by using clinical natural language processing models.

  • Feb 08, 2026
  • Journal of forensic sciences
  • Arthur J Funnell +8
  • Research Article

Integrating NLP into Radiation Oncology: A Practical Guide to Transformer Architecture and Large Language Models

  • Aug 13, 2025
  • BJR|Artificial Intelligence
  • Reza Khanmohammadi +10
  • Research Article
  • Citations8

Automated anonymization of radiology reports: comparison of publicly available natural language processing and large language models.

  • Oct 31, 2024
  • European radiology
  • Marcel C Langenbach +7
  • Research Article
  • Citations1

Unveiling the Power of Pre - Trained Language Models in NLP Applications

  • Nov 05, 2023
  • International Journal of Science and Research (IJSR)
  • Shrinath Pai
  • Research Article

Clinical-ShiftEval: a framework for simulating and evaluating model adaptation in dynamic clinical NLP tasks

  • May 11, 2026
  • BMC Medical Informatics and Decision Making
  • Fabi\Xe1N Villena +2
  • PDF
  • Research Article
  • Citations12

Comparing traditional natural language processing and large language models for mental health status classification: a multi-model evaluation

  • Jul 06, 2025
  • Scientific Reports
  • Thomas Kallstenius +3
  • Research Article
  • Citations12

Improving the robustness and accuracy of biomedical language models through adversarial training

  • Jun 15, 2022
  • Journal of Biomedical Informatics
  • Milad Moradi +1
  • Research Article

Improving Drug Identification in Overdose Death Surveillance using Large Language Models.

  • Jul 16, 2025
  • ArXiv
  • Arthur J Funnell +8
  • Research Article
  • Citations15

Emerging applications of NLP and large language models in gastroenterology and hepatology: a systematic review

  • Jan 22, 2025
  • Frontiers in Medicine
  • Mahmud Omar +5
  • PDF
  • Research Article
  • Citations16

Advancements and Applications of Large Language Models in Natural Language Processing: A Comprehensive Review

  • Nov 26, 2024
  • Applied and Computational Engineering
  • Mengchao Ren
  • Research Article

Identification of muscle-invasion status in bladder cancer patients using natural language processing and machine learning.

  • Feb 20, 2022
  • Journal of Clinical Oncology
  • Ruixin Yang +6
  • Research Article
  • Citations4

Assessing citation integrity in biomedical publications: corpus annotation and NLP models.

  • Jun 26, 2024
  • Bioinformatics (Oxford, England)
  • Maria Janina Sarol +4
  • Research Article
  • Citations1

POS0262 IDENTIFYING EROSIVE DISEASE FROM RADIOLOGY REPORTS OF VETERANS WITH INFLAMMATORY ARTHRITIS USING NATURAL LANGUAGE PROCESSING

  • May 19, 2021
  • Annals of the Rheumatic Diseases
  • G Penmetsa +7
  • Research Article

Enabling national identification of lung cancer screening eligibility with large language models.

  • Jun 01, 2025
  • Journal of Clinical Oncology
  • Julie Tsu-Yu Wu +14
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.