• Home
  • Search
  • Data-driven energy management system for smart buildings
  • https://doi.org/10.32657/10356/182526Copy DOI Icon

Data-driven energy management system for smart buildings

  • Jan 1, 2024
  • Hongyuan Ding
Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

This thesis explores innovative data-driven approaches to enhance energy management in smart buildings, addressing challenges through advanced deep reinforcement learning (DRL) methods. The thesis follows a logical progression, starting from the smallest unit of a smart building, a multi-energy smart home, and then moving to the residential building level, focusing on a typical scenario of an apartment building often found in city areas. Finally, the thesis addresses a general case of building energy management, proposing an improved approach that integrates advanced forecasting algorithms to enhance the performance of building energy management systems (BEMSs). Chapter 2 models a multi-energy smart home equipped with various appliances, battery energy storage systems (BESS), thermal energy storage systems (TES), micro combined heat and power systems (mCHP), electrical heat pumps (EHP), rooftop photovoltaic (PV), and electric vehicles (EV). The home energy management (HEM) problem is formulated as a cost minimization task with strict constraints to manage energy generation, storage, and consumption efficiently. The chapter introduces a safe DRL approach, primal-dual deep deterministic policy gradient (PD-DDPG) algorithm. Unlike existing DRL methods, this approach learns to minimize costs from accumulated cost functions and automatically tunes the cost function coefficients. Additionally, a convolutional neural network-long short-term memory (CNN-LSTM)-based dynamic electricity price forecasting model addresses future price uncertainties. Simulations with Singapore wholesale electricity price data demonstrate the proposed method's effectiveness in minimizing energy costs and avoiding constraint violations. This chapter addresses the research gap of efficiently managing time-coupled operational constraints in smart homes by proposing a novel approach that ensures constraint satisfaction and convergence, surpassing the limitations of empirical penalty functions used in previous studies. Chapter 3 explores the concept of smart sustainable apartment buildings (SSABs), focusing on installing renewable energy systems in common areas, integrating smart meters for precise energy consumption tracking, and coordinating energy use across multiple residential units. The internal energy coordination scheme is formulated as a hierarchical partially observable Markov decision process (HPOMDP), emphasizing efficient RES utilization and introducing an equitable internal electricity settlement mechanism to ensure fair benefits for all residents. The self-attention prioritized deep deterministic policy gradient (SAP-DDPG) algorithm addresses complex challenges related to RES integration, privacy considerations, and energy consumption patterns within SSABs. Real-world data simulations show that SAP-DDPG significantly enhances energy efficiency, provides cost savings for residents, increases revenue for building operators, and boosts local RES generation utilization. This chapter addresses the unique challenges of energy management in SSABs, including hierarchical coordination, privacy preservation, and efficient internal electricity settlement schemes. The chapter also proposes the use of multi-agent DRL to effectively manage interactions and energy distribution among multiple agents within the SSAB framework. Chapter 4 introduces the multi-step interval forecast soft actor-critic (MSIF-SAC) algorithm. This approach incorporates multi-step interval forecasts of PV generation and electricity prices into the soft actor-critic (SAC) algorithm's state representation. By redesigning the actor and critic network architectures, MSIF-SAC effectively extracts vital information from complex input data, enabling BEMSs to make informed decisions. Real-world dataset evaluations show that MSIF-SAC outperforms existing DRL-based strategies, demonstrating superior learning efficiency, stability, and cost-reduction capabilities. This chapter addresses the research gap of integrating multi-step interval forecasts into DRL-based BEMSs to improve decision-making under uncertainty, especially with the challenges posed by uncertainties in PV generation and fluctuating electricity prices. In conclusion, this thesis presents advanced data-driven energy management strategies for smart buildings that aim to enhance efficiency, reduce costs, and maximize renewable energy utilization. By pushing the boundaries of deep reinforcement learning applications in smart building energy management, this thesis makes significant contributions to the development of more sustainable, cost-effective, and intelligent energy management systems.

Similar Papers
  • Book Chapter
  • Citations19

Energy Cloud: Services for Smart Buildings

  • Sep 21, 2017
  • Nader Mohamed +2
  • PDF
  • Research Article
  • Citations34

Research and Application of Predictive Control Method Based on Deep Reinforcement Learning for HVAC Systems

  • Jan 01, 2021
  • IEEE Access
  • Chenhui Fu +1
  • Research Article
  • Citations130

Smart building energy management and monitoring system based on artificial intelligence in smart city

  • Feb 26, 2023
  • Sustainable Energy Technologies and Assessments
  • Rajalakshmi Selvaraj +2
  • Conference Article
  • Citations5

Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning

  • Oct 01, 2022
  • Qilei Zhang +5
  • Research Article
  • Citations97

AI-powered deep learning for sustainable industry 4.0 and internet of things: Enhancing energy management in smart buildings

  • Aug 10, 2024
  • Alexandria Engineering Journal
  • Franciskus Antonius Alijoyo
  • Research Article
  • Citations29

Enabling cross-type full-knowledge transferable energy management for hybrid electric vehicles via deep transfer reinforcement learning

  • Jul 10, 2024
  • Energy
  • Ruchen Huang +4
  • PDF
  • Research Article
  • Citations38

UAV maneuvering decision -making algorithm based on Twin Delayed Deep Deterministic Policy Gradient Algorithm

  • Dec 07, 2021
  • Journal of Artificial Intelligence and Technology
  • Shuangxia Bai +5
  • Conference Article
  • Citations26

CE-BEMS: A cloud-enabled building energy management system

  • Mar 01, 2016
  • Nader Mohamed +2
  • Research Article
  • Citations152

Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm

  • Jun 01, 2022
  • Applied Energy
  • Ruchen Huang +4
  • Research Article
  • Citations14

Machine Learning Applications in Energy Management Systems for Smart Buildings

  • Jan 01, 2024
  • E3S Web of Conferences
  • Rajesh Singh +5
  • Research Article
  • Citations128

Morphing control of a new bionic morphing UAV with deep reinforcement learning

  • May 28, 2019
  • Aerospace Science and Technology
  • Dan Xu +3
  • Research Article

Sustainability in smart buildings by holistic energy management strategy: A confluence of prosumers employing deep Q-learning

  • Nov 01, 2025
  • Journal of Renewable and Sustainable Energy
  • Mary Sumitha Maria Michael +1
  • PDF
  • Research Article
  • Citations6

A State-Compensated Deep Deterministic Policy Gradient Algorithm for UAV Trajectory Tracking

  • Jun 21, 2022
  • Machines
  • Jiying Wu +5
  • Research Article
  • Citations21

A Three-Stage Optimal Operation Strategy of Interconnected Microgrids With Rule-Based Deep Deterministic Policy Gradient Algorithm.

  • Feb 01, 2024
  • IEEE Transactions on Neural Networks and Learning Systems
  • Huifeng Zhang +3
  • Research Article
  • Citations6

Deep Reinforcement Learning Based Controller Design for Model of The Vertical Take off and Landing System

  • Jun 26, 2021
  • European Journal of Science and Technology
  • Mahmut Ağrali +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.