• Home
  • Search
  • Improving drug identification in overdose death surveillance by using clinical natural language processing models.
  • Cite Icon3
  • https://doi.org/10.1111/1556-4029.70281Copy DOI Icon

Improving drug identification in overdose death surveillance by using clinical natural language processing models.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The rising rate of drug-related deaths in the United States, largely driven by fentanyl, requires timely and accurate surveillance. However, critical overdose data are often buried in free-text coroner reports, leading to delays and information loss when coded into ICD (International Classification of Disease)-10 classifications. Natural language processing (NLP) models may automate and enhance overdose surveillance, but prior applications have been limited. A dataset of 35,433 death records from multiple US jurisdictions in 2020 was used for model training and internal testing. External validation was conducted using a novel separate dataset of 3335 records from 2023 to 2024. Multiple NLP approaches were evaluated for classifying specific drug involvement from unstructured death certificate text. These included traditional single- and multi-label classifiers, as well as fine-tuned encoder-only language models such as Bidirectional Encoder Representations from Transformers (BERT) and BioClinicalBERT, and contemporary decoder-only large language models (LLMs) such as Qwen 3 and Llama 3. Model performance was assessed using macro-averaged F1 scores, and 95% confidence intervals were calculated to quantify uncertainty. Fine-tuned BioClinicalBERT models achieved near-perfect performance, with macro F1 scores ≥0.998 on the internal test set. External validation confirmed robustness (macro F1 = 0.966), outperforming conventional machine learning, general-domain BERT models, and various decoder-only LLMs. NLP models, particularly fine-tuned clinical variants like BioClinicalBERT, offer a highly accurate and scalable solution for overdose death classification from free-text reports. These methods can significantly accelerate surveillance workflows, overcoming the limitations of manual ICD-10 coding and supporting near real-time detection of emerging substance use trends.

Similar Papers
  • Research Article

Improving Drug Identification in Overdose Death Surveillance using Large Language Models.

  • Jul 16, 2025
  • ArXiv
  • Arthur J Funnell +8
  • Research Article
  • Citations2

Assessment of a zero-shot large language model in measuring documented goals-of-care discussions

  • Sep 26, 2025
  • medRxiv
  • Robert Y Lee +6
  • Research Article
  • Citations1

Assessment of a Zero-Shot Large Language Model in Measuring Documented Goals-of-Care Discussions.

  • Jan 01, 2026
  • Journal of pain and symptom management
  • Robert Y Lee +6
  • Research Article
  • Citations8

Automated anonymization of radiology reports: comparison of publicly available natural language processing and large language models.

  • Oct 31, 2024
  • European radiology
  • Marcel C Langenbach +7
  • Conference Article
  • Citations2

High-level Image Classification by Synergizing Image Captioning with BERT

  • Oct 20, 2021
  • Xiaohong Yu +2
  • Research Article
  • Citations35

Privacy-ensuring Open-weights Large Language Models Are Competitive with Closed-weights GPT-4o in Extracting Chest Radiography Findings from Free-Text Reports.

  • Jan 01, 2025
  • Radiology
  • Sebastian Nowak +11
  • Research Article
  • Citations4

TextBugger: an extended adversarial text attack on NLP-based text classification model

  • Jun 01, 2025
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Sanjaikanth E Vadakkethil Somanathan Pillai +4
  • Conference Article
  • Citations1

Towards Predicting Source Code Changes Based on Natural Language Processing Models: An Empirical Evaluation

  • Oct 09, 2023
  • Yuto Kaibe +2
  • Research Article

A Natural Language Processing Model for the Development of an Italian-Language Chatbot for Public Administration

  • Jan 01, 2024
  • International Journal of Advanced Computer Science and Applications
  • Antonio Piizzi +4
  • Research Article
  • Citations2

Natural Language Processing and ICD-10 Coding for Detecting Bleeding Events in Discharge Summaries: Comparative Cross-Sectional Study

  • Aug 29, 2025
  • JMIR Medical Informatics
  • Frederic Gaspar +6
  • Research Article
  • Citations7

Sentiment Analysis in Healthcare: A Comparison of VADER, BERT, and Flair NLP Models on Patient Reviews of Pain Management Physicians

  • Jul 28, 2025
  • Cureus
  • Ishan Aggarwal +5
  • PDF
  • Research Article
  • Citations3

Performance of Natural Language Processing Model in Extracting Information from Free-Text Radiology Reports: A Systematic Review and Meta-Analysis.

  • Oct 28, 2025
  • Journal of imaging informatics in medicine
  • Qingwen Yang +7
  • Research Article
  • Citations6

Comparative study of sequence-to-sequence models: From RNNs to transformers

  • Feb 23, 2024
  • Applied and Computational Engineering
  • Jiancong Zhu
  • Research Article
  • Citations13

Natural language processing to predict isocitrate dehydrogenase genotype in diffuse glioma using MR radiology reports.

  • Aug 11, 2023
  • European Radiology
  • Minjae Kim +12
  • Research Article
  • Citations2

Abstract 1158: A.I.-assisted clinical data curation to determine genomic biomarkers of cancer metastasis

  • Jun 15, 2022
  • Cancer Research
  • Anisha Luthra +8
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.