• Home
  • Search
  • Semantic Textual Similarity in Japanese Clinical Domain Texts Using BERT.
  • Cite Icon30
  • https://doi.org/10.1055/s-0041-1731390Copy DOI Icon

Semantic Textual Similarity in Japanese Clinical Domain Texts Using BERT.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Background Semantic textual similarity (STS) captures the degree of semantic similarity between texts. It plays an important role in many natural language processing applications such as text summarization, question answering, machine translation, information retrieval, dialog systems, plagiarism detection, and query ranking. STS has been widely studied in the general English domain. However, there exists few resources for STS tasks in the clinical domain and in languages other than English, such as Japanese. Objective The objective of this study is to capture semantic similarity between Japanese clinical texts (Japanese clinical STS) by creating a Japanese dataset that is publicly available. Materials We created two datasets for Japanese clinical STS: (1) Japanese case reports (CR dataset) and (2) Japanese electronic medical records (EMR dataset). The CR dataset was created from publicly available case reports extracted from the CiNii database. The EMR dataset was created from Japanese electronic medical records. Methods We used an approach based on bidirectional encoder representations from transformers (BERT) to capture the semantic similarity between the clinical domain texts. BERT is a popular approach for transfer learning and has been proven to be effective in achieving high accuracy for small datasets. We implemented two Japanese pretrained BERT models: a general Japanese BERT and a clinical Japanese BERT. The general Japanese BERT is pretrained on Japanese Wikipedia texts while the clinical Japanese BERT is pretrained on Japanese clinical texts. Results The BERT models performed well in capturing semantic similarity in our datasets. The general Japanese BERT outperformed the clinical Japanese BERT and achieved a high correlation with human score (0.904 in the CR dataset and 0.875 in the EMR dataset). It was unexpected that the general Japanese BERT outperformed the clinical Japanese BERT on clinical domain dataset. This could be due to the fact that the general Japanese BERT is pretrained on a wide range of texts compared with the clinical Japanese BERT.

Similar Papers
  • Conference Article
  • Citations3

Engineering Document Summarization Using Sentence Representations Generated by Bidirectional Language Model

  • Aug 17, 2021
  • Yunjian Qiu +1
  • Research Article
  • Citations20

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT

  • May 05, 2024
  • Artificial Intelligence In Medicine
  • Shoya Wada +6
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • Conference Article
  • Citations12

Cross2Self-attentive Bidirectional Recurrent Neural Network with BERT for Biomedical Semantic Text Similarity

  • Dec 16, 2020
  • Zhengguang Li +5
  • PDF
  • Research Article

Automatic Short Answer Grading for Enhancing Educational Assessment Using BERT and USE Models

  • Feb 22, 2026
  • Indian Journal Of Science And Technology
  • Chandralika Chakraborty +2
  • Research Article
  • Citations1

Natural language processing models for predicting treatment outcomes in internet-delivered cognitive behavioral therapy

  • Oct 10, 2025
  • Internet Interventions
  • Nils Hentati Isacsson +4
  • Research Article

Spam Detection Based on BERT Model: A Descriptive Study

  • Jan 01, 2023
  • Theory and practice of science and technology
  • Hailin Xu
  • PDF
  • Research Article
  • Citations61

Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models.

  • Nov 23, 2020
  • JMIR Medical Informatics
  • Xi Yang +5
  • Research Article
  • Citations4

Artificial Intelligence for CT and MRI Protocoling: A Meta-Analysis of Traditional Machine Learning, BERT, and Large Language Models.

  • Oct 29, 2025
  • AJR. American journal of roentgenology
  • Ethan Sacoransky +2
  • PDF
  • Research Article
  • Citations24

Adapting Bidirectional Encoder Representations from Transformers (BERT) to Assess Clinical Semantic Textual Similarity: Algorithm Development and Validation Study.

  • Feb 03, 2021
  • JMIR Medical Informatics
  • Klaus Kades +6
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • PDF
  • Research Article
  • Citations37

Classifying the lifestyle status for Alzheimer’s disease from clinical notes using deep learning with weak supervision

  • Jul 01, 2022
  • BMC medical informatics and decision making
  • Zitao Shen +6
  • Research Article

Cybershield Monitor Using Deep Learning and BERT Model

  • Feb 24, 2025
  • INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • A Nandhini
  • Research Article
  • Citations9

Multifaceted Natural Language Processing Task-Based Evaluation of Bidirectional Encoder Representations From Transformers Models for Bilingual (Korean and English) Clinical Notes: Algorithm Development and Validation.

  • Oct 30, 2024
  • JMIR medical informatics
  • Kyungmo Kim +11
  • PDF
  • Research Article
  • Citations25

Identification of asthma control factor in clinical notes using a hybrid deep learning model

  • Nov 01, 2021
  • BMC Medical Informatics and Decision Making
  • Bhavani Singh Agnikula Kshatriya +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.