• Home
  • Search
  • GRU-BERT for NILM: A Hybrid Deep Learning Architecture for Load Disaggregation
  • Cite Icon8
  • https://doi.org/10.3390/ai6090238Copy DOI Icon

GRU-BERT for NILM: A Hybrid Deep Learning Architecture for Load Disaggregation

  • Sep 22, 2025
  • AI
  • Annysha Huzzat +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Non-Intrusive Load Monitoring (NILM) aims to disaggregate a household’s total aggregated power consumption into appliance-level usage, enabling intelligent energy management without the need for intrusive metering. While deep learning has improved NILM significantly, existing NILM models struggle to capture load patterns across both longer time intervals and subtle timings for appliances involving brief or overlapping usage patterns. In this paper, we propose a novel GRU+BERT hybrid architecture, exploring both unidirectional (GRU+BERT) and bidirectional (Bi-GRU+BERT) variants. Our model combines Gated Recurrent Units (GRUs) to capture sequential temporal dependencies with Bidirectional Encoder Representations from Transformers (BERT), which is a transformer-based model that captures rich contextual information across the sequence. The bidirectional variant (Bi-GRU+BERT) processes input sequences in both forward (past to future) and backward (future to past) directions, enabling the model to learn relationships between power consumption values at different time steps more effectively. The unidirectional variant (GRU+BERT) provides an alternative suited for appliances with structured, sequential multi-phase usage patterns, such as dishwashers. By placing the Bi-GRU or GRU layer before BERT, our models first capture local time-based load patterns and then use BERT’s self-attention to understand the broader contextual relationships. This design addresses key limitations of both standalone recurrent and transformer-based models, offering improved performance on transient and irregular appliance loads. Evaluated on the UK-DALE and REDD datasets, the proposed Bi-GRU+BERT and GRU+BERT models show competitive performance compared to several state-of-the-art NILM models while maintaining a comparable model size and training time, demonstrating their practical applicability for real-time energy disaggregation, including potential edge and cloud deployment scenarios.

Similar Papers
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • PDF
  • Research Article
  • Citations26

Adapting transformer-based language models for heart disease detection and risk factors extraction

  • Apr 04, 2024
  • Journal of Big Data
  • Essam H Houssein +3
  • Research Article
  • Citations62

Does BERT need domain adaptation for clinical negation detection?

  • Feb 11, 2020
  • Journal of the American Medical Informatics Association
  • Chen Lin +5
  • Research Article
  • Citations20

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT

  • May 05, 2024
  • Artificial Intelligence In Medicine
  • Shoya Wada +6
  • Research Article
  • Citations1

Phishing website detection using novel integration of BERT and XLNet with deep learning sequential models

  • Nov 01, 2024
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Kongara Srinivasa Rao +5
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Conference Article
  • Citations111

How Does BERT Answer Questions?

  • Nov 03, 2019
  • Betty Van Aken +3
  • Research Article

Performance Analysis of Transformer Based Models for Automatic Short Answer Grading

  • May 30, 2025
  • Journal of Information Systems Engineering and Management
  • Rupal Chaudhari
  • Research Article

Performance Analysis of Transformer Based Models for Automatic Short Answer Grading

  • May 30, 2025
  • Journal of Information Systems Engineering and Management
  • Rupal Chaudhari
  • Research Article
  • Citations5

Psychological Stress Detection Using Transformer-Based Models

  • Jun 22, 2024
  • ComTech: Computer, Mathematics and Engineering Applications
  • Derwin Suhartono +3
  • PDF
  • Research Article
  • Citations28

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

  • Jul 30, 2022
  • BMC Medical Informatics and Decision Making
  • Jia Li +10
  • Book Chapter
  • Citations24

A Literature Review on Bidirectional Encoder Representations from Transformers

  • Jan 01, 2022
  • S Shreyashree +3
  • Book Chapter
  • Citations8

Natural Language Processing with “More Than Words – BERT”

  • Jan 01, 2021
  • Saranlita Chotirat +1
  • Research Article
  • Citations7

Sentiment analysis with hotel customer reviews using FNet

  • Apr 01, 2024
  • Bulletin of Electrical Engineering and Informatics
  • Shovan Bhowmik +3
  • Research Article
  • Citations1

Analisis Perbandingan Model Bert Dan Xlnet Untuk Klasifikasi Tweet Bully Pada Twitter

  • Dec 10, 2024
  • Jurnal Teknologi Informasi dan Ilmu Komputer
  • Teuku Radillah +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.