• Home
  • Search
  • Natural Language Processing with “More Than Words – BERT”
  • Cite Icon8
  • https://doi.org/10.1007/978-3-030-79757-7_11Copy DOI Icon

Natural Language Processing with “More Than Words – BERT”

  • Jan 1, 2021
  • Saranlita Chotirat +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract Question-Answering (QA) has become one of the most popular natural language processing (NLP) and information retrieval applications. To be applied in QA systems, this paper presents a question classification technique based on NLP and Bidirectional Encoder Representation from Transformers (BERT). We performed experimental investigation on BERT for question classification with TREC-6 dataset and a Thai sentence dataset. We propose an improved processing technique called “More Than Words – BERT” (MTW – BERT) that is a special NLP Annotation tags for combining Part-Of-Speech tagging and Named Entities Recognition to be able for learning both pattern of grammatical tag sequence and recognized entities together as input before classifying text on BERT model. Experimental results showed that MTW – BERT outperformed existing classification methods and achieved new state-of-the-art performance on question classification for TREC-6 dataset with 99.20%. In addition, MTW-BERT also applied for question classification for Thai sentences in wh-question category. The proposed technique remarkably achieved Thai wh-classification with accuracy rate of 87.50%.KeywordsClassificationBERT-based modelNLP TaggingAnalysis Thai Sentence

Similar Papers
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Conference Article
  • Citations10

Classification of Fire Related Tweets on Twitter Using Bidirectional Encoder Representations from Transformers (BERT)

  • Nov 28, 2021
  • Jairus Mingua +2
  • PDF
  • Research Article
  • Citations28

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

  • Jul 30, 2022
  • BMC Medical Informatics and Decision Making
  • Jia Li +10
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • Research Article
  • Citations20

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT

  • May 05, 2024
  • Artificial Intelligence In Medicine
  • Shoya Wada +6
  • Research Article

T-­BERT:臺灣語言模型–以臺灣在地語言預訓練BERT模型

  • Jan 01, 2020
  • 鍾明諺
  • Research Article
  • Citations1

Comparing human coding to two natural language processing algorithms in aspirations of people affected by Duchenne Muscular Dystrophy

  • Oct 01, 2022
  • Journal of Methods and Measurement in the Social Sciences
  • Carolyn E Schwartz +3
  • Book Chapter

Automatic Documents Categorization Using NLP

  • Nov 08, 2022
  • Parsa Sai Tejaswi +3
  • Research Article
  • Citations4

Chatbot Building with BERT for E-Commerce

  • Mar 31, 2024
  • International Journal for Research in Applied Science and Engineering Technology
  • Dr Guru Kesava Dasu Gopisetty
  • PDF
  • Research Article

Chinese news topic prediction using bidirectional encoder representation from transformers

  • Dec 08, 2023
  • Theoretical and Natural Science
  • Yifan Bi
  • Research Article
  • Citations1

Analisis Perbandingan Model Bert Dan Xlnet Untuk Klasifikasi Tweet Bully Pada Twitter

  • Dec 10, 2024
  • Jurnal Teknologi Informasi dan Ilmu Komputer
  • Teuku Radillah +2
  • Research Article
  • Citations1

Snippet generation using textbook corpus - an NLP approach based on BERT

  • Dec 01, 2020
  • Journal of Physics: Conference Series
  • Andrew Moses +1
  • Research Article
  • Citations30

Semantic Textual Similarity in Japanese Clinical Domain Texts Using BERT.

  • Jun 01, 2021
  • Methods of Information in Medicine
  • Faith Wavinya Mutinda +3
  • PDF
  • Research Article
  • Citations13

BERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System

  • Jan 01, 2020
  • International Journal of Advanced Computer Science and Applications
  • Truong H V Phan +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.