• Home
  • Search
  • Classification of Fire Related Tweets on Twitter Using Bidirectional Encoder Representations from Transformers (BERT)
  • Cite Icon10
  • https://doi.org/10.1109/hnicem54116.2021.9731956Copy DOI Icon

Classification of Fire Related Tweets on Twitter Using Bidirectional Encoder Representations from Transformers (BERT)

  • Nov 28, 2021
  • Jairus Mingua +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Bidirectional Encoder Representation from Transformers (BERT) is a transfer learning model approach in natural language processing (NLP). BERT has different types of pre-trained models that can pre-train a language representation to create a model that can be finetuned on specific tasks using a dataset like text classification to produce state of the art predictions. Recent studies providing the use of BERT in natural language processing have highlighted that there are no publicly available Filipino tweet datasets regarding fire reports on social media that lead to a lack of classification models. This paper aims to design and implement a system to classify Filipino tweets using different pre-trained BERT models. Upon creating a model exclusive for organizing Filipino tweets using 2,081 tweets as a dataset that contains fire-related tweets, the researchers were able to compare the accuracy of the different finetuned pre-trained BERT models. The data shows a significant difference in the accuracy of each pre-trained BERT model. The highest of which is the BERT Base Uncased WWM model with a test accuracy of 87.50% and a train loss of 0.06 during training of the dataset. The least accurate among the pre-trained BERT models is the BERT Base Cased WWM model, with a test accuracy of 76.34% and a train loss of 0.2. The result shows that BERT Base Uncased WWM model can be a reliable model in classifying fire-related tweets. The accuracy obtained by the models may vary depending on how large the dataset is.

Similar Papers
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • Research Article
  • Citations20

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT

  • May 05, 2024
  • Artificial Intelligence In Medicine
  • Shoya Wada +6
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Conference Article

Predictive Sentiment Analysis of Skincare Product Reviews: A Natural Language Processing Approach with BERT-Enhanced Sequential Model (BESM)

  • Dec 01, 2025
  • Sky Nurimba +4
  • PDF
  • Research Article
  • Citations28

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

  • Jul 30, 2022
  • BMC Medical Informatics and Decision Making
  • Jia Li +10
  • Research Article
  • Citations14

BERT and RoBERTa Models for Enhanced Detection of Depression in Social Media Text

  • Jan 01, 2024
  • Procedia Computer Science
  • Felix Indra Kurniadi +4
  • Research Article
  • Citations30

Semantic Textual Similarity in Japanese Clinical Domain Texts Using BERT.

  • Jun 01, 2021
  • Methods of Information in Medicine
  • Faith Wavinya Mutinda +3
  • Book Chapter
  • Citations8

Natural Language Processing with “More Than Words – BERT”

  • Jan 01, 2021
  • Saranlita Chotirat +1
  • Research Article

T-­BERT:臺灣語言模型–以臺灣在地語言預訓練BERT模型

  • Jan 01, 2020
  • 鍾明諺
  • Research Article
  • Citations1

Analisis Perbandingan Model Bert Dan Xlnet Untuk Klasifikasi Tweet Bully Pada Twitter

  • Dec 10, 2024
  • Jurnal Teknologi Informasi dan Ilmu Komputer
  • Teuku Radillah +2
  • Research Article
  • Citations1

Natural language processing models for predicting treatment outcomes in internet-delivered cognitive behavioral therapy

  • Oct 10, 2025
  • Internet Interventions
  • Nils Hentati Isacsson +4
  • Book Chapter
  • Citations24

A Literature Review on Bidirectional Encoder Representations from Transformers

  • Jan 01, 2022
  • S Shreyashree +3
  • Research Article
  • Citations10

Fine-Tuning BERT for Automated News Classification

  • Jun 04, 2025
  • Engineering, Technology & Applied Science Research
  • Mohammed I Salih +4
  • Research Article

Cybershield Monitor Using Deep Learning and BERT Model

  • Feb 24, 2025
  • INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • A Nandhini
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.