• Home
  • Search
  • Fine-Tuning BERT for Automated News Classification
  • Cite Icon10
  • https://doi.org/10.48084/etasr.10625Copy DOI Icon

Fine-Tuning BERT for Automated News Classification

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Text classification is a fundamental task in Natural Language Processing (NLP) with a wide range of applications such as sentiment analysis, document classification and content recommendation. Traditional approaches like Naive Bayes (NB), Support Vector Machine (SVM) and Random Forest (RF) relied on feature engineering but lacked contextual understanding. Deep learning came into the picture for text classification with transformer models such as Bidirectional Encoder Representations from Transformers (BERT), which could understand contextual words bidirectionally. In this article, we utilize a pre-trained BERT model fine-tuned on the Reuters-21578 dataset to classify news articles. We aim to measure the performance of transfer learning against common machine learning models and non-fine-tuned BERT. The fine-tuned model achieves 91.77% accuracy, which significantly outperforms the non-fine-tuned BERT, and performs better than classical classifiers such as NB, SVM and RF. The results show that fine-tuning allows BERT to contextualize domain-specific intricacies, resulting in improved classification performance. We also address the computational trade-offs associated with transformer models, highlighting the need for optimal methods for deployment. Thus, this study further enables the use of fine-tuned BERT in automatic news classification and is of significant value for information retrieval and content personalization.

Similar Papers
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • Research Article

A Comparative Review of VADER and BERT for Sentiment Analysis: Methods, Performance, and Applications

  • Apr 24, 2026
  • INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • Pamarthi Maheswarini +3
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Research Article

Performance Analysis of Transformer Based Models for Automatic Short Answer Grading

  • May 30, 2025
  • Journal of Information Systems Engineering and Management
  • Rupal Chaudhari
  • Research Article

Performance Analysis of Transformer Based Models for Automatic Short Answer Grading

  • May 30, 2025
  • Journal of Information Systems Engineering and Management
  • Rupal Chaudhari
  • Research Article

Sentiment Analysis on Twitter Social Media Regarding Covid-19 Vaccination with Naive Bayes Classifier (NBC) and Bidirectional Encoder Representations from Transformers (BERT)

  • Sep 30, 2024
  • Recursive Journal of Informatics
  • Angga Riski Dwi Saputra +1
  • Research Article
  • Citations1

Sentiment Analysis on Twitter Social Media Regarding Covid-19 Vaccination with Naive Bayes Classifier (NBC) and Bidirectional Encoder Representations from Transformers (BERT)

  • Sep 30, 2024
  • Recursive Journal of Informatics
  • Angga Riski Dwi Saputra +1
  • Research Article

T-­BERT:臺灣語言模型–以臺灣在地語言預訓練BERT模型

  • Jan 01, 2020
  • 鍾明諺
  • Research Article
  • Citations10

Predicting song genre with deep learning

  • Mar 28, 2023
  • Global Knowledge, Memory and Communication
  • Antonijo Marijić +1
  • PDF
  • Research Article
  • Citations50

Advancing natural language processing (NLP) applications of morphologically rich languages with bidirectional encoder representations from transformers (BERT): an empirical case study for Turkish

  • Apr 03, 2021
  • Automatika
  • Akın Özçift +3
  • Conference Article
  • Citations12

Cross2Self-attentive Bidirectional Recurrent Neural Network with BERT for Biomedical Semantic Text Similarity

  • Dec 16, 2020
  • Zhengguang Li +5
  • Research Article
  • Citations170

BERT applications in natural language processing: a review

  • Mar 15, 2025
  • Artificial Intelligence Review
  • Nadia Mushtaq Gardazi +5
  • Research Article

The Effect of Various Text Representation Methods for Sentiment Analysis on Movie Review Data with Different Machine Learning Methods

  • Dec 31, 2024
  • Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji
  • Veysel Göç +1
  • Conference Article
  • Citations4

Deep neural networks with pre-train model BERT for aspect-level sentiments classification

  • Jun 01, 2020
  • Yunxiang Zhang +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.