• Home
  • Search
  • Facilitating clinical research through automation: Combining optical character recognition with natural language processing.
  • Cite Icon18
  • https://doi.org/10.1177/17407745221093621Copy DOI Icon

Facilitating clinical research through automation: Combining optical character recognition with natural language processing.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Performance status is crucial for most clinical research, as an eligibility criterion, a comorbidity covariate, or a trial endpoint. Yet information on performance status often is embedded as free text within a patient's electronic medical record, rather than coded directly, thereby making this concept extremely difficult to extract for research. Furthermore, performance status information frequently resides in outside reports, which are scanned into the electronic medical record along with thousands of clinic notes. The image format of scanned documents also is a major obstacle to the search and retrieval of information, as natural language processing cannot be applied to unstructured text within an image. We, therefore, utilized optical character recognition software to convert images to a searchable format, allowing the application of natural language processing to identify pertinent performance status data elements within scanned electronic medical records. Our study cohort consisted of 189 subjects diagnosed with diffuse large B-cell lymphoma for whom performance status was a required data element for analysis of prognostic factors related to recurrence and survival. Manual abstraction of performance status was previously conducted by a clinical Subject Matter Expert, serving as the gold standard. Leveraging our data warehouse, we extracted relevant scanned electronic medical record documents and applied optical character recognition to these images using the ABBYY FineReader software. The Linguamatics i2e natural language processing software was then used to run queries for performance status against the corpus of electronic medical record documents. We evaluated our optical character recognition/natural language processing pipeline for accuracy and reduction in data extraction effort. We found that there was high accuracy and reduced time for extraction of performance status data by applying our optical character recognition/natural language processing pipeline. The transformed scanned documents from a random sample of patients yielded excellent precision, recall, and F score, with <1% incorrect results. Time savings from a second cohort showed that median time to review documents for patients with performance status data present was reduced by a third. The major time savings was in the review of those documents that in fact did not contain performance status information: median of 18 minutes versus 108 minutes for manual review, an 83% reduction in data abstraction effort. By applying this optical character recognition/natural language processing pipeline, we achieved significant operational improvement and reduced time for information retrieval to support clinical research. Our study demonstrated that optical character recognition software provides an effective mechanism to transform scanned electronic medical record images to allow the application of natural language processing, yielding highly accurate data abstraction. We conclude that our optical character recognition/natural language processing pipeline can greatly facilitate research data abstraction by providing a highly focused data review, eliminating unnecessary manual review of the entire chart, and thus freeing time for abstracting other data elements requiring more human interpretation.

Similar Papers
  • Discussion
  • Citations29

Natural Language Processing and the Promise of Big Data: Small Step Forward, but Many Miles to Go.

  • Aug 18, 2015
  • Circulation: Cardiovascular Quality and Outcomes
  • Thomas M Maddox +1
  • Research Article
  • Citations26

Automating Access to Real-World Evidence

  • May 17, 2022
  • JTO Clinical and Research Reports
  • Marie-Pier Gauthier +14
  • Research Article
  • Citations10

Searching the PDF Haystack: Automated Knowledge Discovery in Scanned EHR Documents.

  • Mar 01, 2021
  • Applied Clinical Informatics
  • Alexander L Kostrinsky-Thomas +2
  • Research Article
  • Citations60

Big Data, Predictive Analytics, and Quality Improvement in Kidney Transplantation: A Proof of Concept.

  • Jan 04, 2017
  • American Journal of Transplantation
  • T.R Srinivas +9
  • Conference Article
  • Citations11

Applications of Natural Language Processing in Clinical Research and Practice

  • Jan 01, 2019
  • Yanshan Wang +3
  • Research Article
  • Citations1

Evaluation and Use of Natural Language Processing (NLP) Reasoning and Classification Models to Support Clinical Trial Patient Identification and Enrollment in the Community Oncology Setting

  • Oct 31, 2024
  • Journal of the Society for Clinical Data Management
  • Christopher Tristen Rocha +6
  • Research Article

Comparing the accuracy of natural language processing labelling versus manual chart review and ICD-10 codes to identify bleeding events in patients with cancer

  • Nov 03, 2025
  • Blood
  • Thomas Fusillo +9
  • Research Article

Abstract P1-07-12: Using Natural Language Processing to Identify and Extract HER2 Value from a large EMR system

  • Dec 15, 2012
  • Cancer Research
  • C Zheng +2
  • Research Article

427.12: Using Artificial Intelligence to Classify the Status of Kidney Allograft in Routine Clinical Records

  • Sep 01, 2022
  • Transplantation
  • Andrea García +3
  • Abstract

Using Natural Language Processing to Determine Chemotherapeutic Regimens Administered within 30 Days Prior to Death in Acute Myelogenous Leukemia Patients

  • Dec 06, 2014
  • Blood
  • Hanahlyn M Park +5
  • Research Article
  • Citations5

Natural Language Processing Identifies Underdocumentation of Symptoms in Patients on Hemodialysis

  • Jan 29, 2025
  • Kidney360
  • Yang Dai +9
  • Research Article
  • Citations1

Extracting longitudinal anticancer treatments at scale using deep natural language processing and temporal reasoning.

  • May 20, 2021
  • Journal of Clinical Oncology
  • Meng Ma +14
  • Supplementary Content
  • Citations51

Assessment of Electronic Health Record for Cancer Research and Patient Care Through a Scoping Review of Cancer Natural Language Processing

  • Jul 01, 2022
  • JCO Clinical Cancer Informatics
  • Liwei Wang +13
  • Research Article
  • Citations6

Development of natural language processing (NLP) models for extracting key features from unstructured notes to create real-world data (RWD) assets for clinical research at scale.

  • Jun 01, 2023
  • Journal of Clinical Oncology
  • Smita Agrawal +13
  • Research Article
  • Citations7

Extraction and Imputation of Eastern Cooperative Oncology Group Performance Status From Unstructured Oncology Notes Using Language Models.

  • May 01, 2024
  • JCO clinical cancer informatics
  • Wenxin Xu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.