Improving Event-Based Non-Intrusive Load Monitoring Using Graph Signal Processing

Energy disaggregation algorithms disintegrate aggregate demand into appliance-level demands. Among various energy disaggregation approaches, non-intrusive load monitoring (NILM) algorithms requiring a single sensor have gained much attention in recent years. Various machine learning and optimization-based NILM approaches are available in the literature, but bulk training data and high computational time are their respective drawbacks. Considering these drawbacks, we devised an event matching energy disaggregation algorithm (EMEDA) for NILM of multistate household appliances using smart meter data. Having limited training data, K-means clustering was employed to estimate appliance power states. These power states were accumulated to generate an event database (EVD) containing all combinations of appliance operations in their various states. Prior to matching, the test samples of aggregate demand events were decreased by event-driven data compression for computational effectiveness. The compressed test events were matched in the sorted EVD to assess the contribution of each appliance in the aggregate demand. To counter the effects of transient spikes and/or dips that occurred during the state transition of appliances, a post-processing algorithm was also developed. The proposed approach was validated using the low-rate data of the Reference Energy Disaggregation Dataset (REDD). With better energy disaggregation performance, the proposed EMEDA exhibited reductions of 97.5 and 61.7% in computational time compared with the recent smart event-based optimization and optimization-based load disaggregation approaches, respectively.

Challenges for real-world applications of nonintrusive load monitoring and opportunities for machine learning approaches

Non-intrusive load monitoring (NILM) is to estimate individual appliance’s power consumption from aggregated smart meter data, which is useful for optimized energy management and provisioning of customized services. While deep learning (DL) has achieved state-of-the-art NILM performance, it is still constrained by the dependency on large amounts of data and intensive computations on training. In this paper, we propose a pre-training approach to address the generalization of DL models for NILM. We develop a meta-learning based approach and an ensemble learning based approach, which pre-train a base model and then fine-tune it with few-short learning when applied to an unknown dataset. The models are validated with two real-world datasets and shown to achieve a superior transferability performance compared with traditional DL and transfer learning methods.

Renewable energy sources are slowly but surely supplementing conventional sources of energy. These energy sources create a large number of micro-grids which become a part of the main grid. Smart meters are essential components in smart micro-grids and smart grids. Together they form a complex system which has become today an attractive area of research world-wide in view of enormous benefits of reliability and safety of power supply economically. Several studies in smart meter applications have shown that in residential buildings, energy consumption can be reduced up to 15% with better management. For this, a non-intrusive appliance load monitoring (NIALM) technique has been advocated which enables appliance identification to help better energy management. The identification is done using load signatures with appropriate algorithm. Several features of load signatures ranging from voltage and current profiles (steady states and transients) to a plethora of features such as active power (P) and reactive power (Q), power factor (pf), harmonic components (h), magnitudes of h (mh), current waveform (CW), eigen values, switching transient waveform, instantaneous admittance waveform, etc have been used in NIALM. The algorithms used vary from a `single algorithm' to `multiple algorithms', the latter used in `Committee Decision Mechanism' (CDM) in which majority of `votes' (i.e., agreement), `cast' by each of the algorithms, decides the final result of appliances identified. This scenario presents a serious difficulty with regard to choice of features and algorithms, besides the possibility of increasing the hardware and software costs of smart meters. The motivation for the study in this paper is provided by this scenario. The basic objective of this paper is to investigate the possibility of including only a limited number of features as load signature of appliances, and the use of only a single algorithm to effectively implement NIALM without any ambiguity. Results of our study so far indicate that generally only four features of P, Q, h and mh are sufficient for detection of appliances in operation; however, in some cases (~>10%), the additional feature, CW, may be needed for final identification.. The experiments conducted so far yielded unambiguous identification of appliances and the results are encouraging enough for possible use in practice for residential loads only.

This paper presents a technical system, which uses the non-intrusive appliance load monitoring (NIALM) method. The solution enables the end user to observe the electricity consumption of the individual appliances. By dividing electricity consumption to individual appliances, it improves the users’ understanding of the overall energy use of the building. This way the owner of the building is able to intervene better with the energy consumption of the building. Observation of the electricity appliances is performed in a web application in a user interface calendar view.

This paper presents a complete real-time implementation of a Non-Intrusive Appliance Load Monitoring (NIALM) system that, is robust under residential voltage level fluctuations. Existing NIALM techniques rely on multiple measurements taken at high sampling rates, but, only have been proven in simulated environments without even considering the effect of residential voltage level fluctuations — which is a severe problem in power systems of most developing countries like Sri Lanka. In contrast, through the NIALM method proposed in this paper, accurate load monitoring results were obtained in realtime using only smart meter measurements taken at a low sampling rate from a real appliance setup under residential voltage level fluctuations. In the proposed NIALM method, initially in the learning phase, a properly constructed MATLABTM Graphical User Interface (GUI) was used to acquire signals of each appliance active power consumption and voltage levels. Then, obtained active power measurements were separated into subspace components (SCs) via the Karhunen Loeve' Expansion (KLE) while also taking the voltage variations into account. Using those SCs, a unique information rich appliance level signature database was constructed and it was then used to obtain the signatures for all possible device combinations. Next, a separate GUI was designed to identify the turned ON appliance combination in the current time window using the pre-constructed signature databases, after reading the total residential active power consumption and the supply voltage. To validate the proposed real-time NIALM implementation, data from a laboratory arrangement consisting of ten household appliances was used. From the results, it was found that the proposed method is capable of accurately identifying the turned on appliances even under severe residential supply voltage level fluctuations.

The aim of appliance identification methods is to get electrical energy consumption at appliance level based on aggregate measurements from a single energy meter. The appliance identification methods in conjunction with smart meters provide consumers with detailed statistics of electrical energy consumption. The detailed feedback could lead to a reduction in energy consumption, including increased consumer awareness. In this paper we describe electrical parameters and appliance groups with different electrical behaviors. We review different steady and transient state identification methods. Then we compare requirements and limitations of discussed methods.

Non-Intrusive load monitoring (NILM) is an emerging technology for extracting potent information from a consumer's electric load profile. The NILM techniques are gaining popularity among researchers as they reduce the requirement for external hardware for load monitoring. These techniques require only the smart meter's data, thus reducing the need for other measuring and sensing devices. In this paper, the research status of non-intrusive load monitoring has been reviewed. The utilisation of NILM techniques for event detection, load monitoring and energy disaggregation has been discussed in this paper. Furthermore, the research gap and future aspects are discussed. This paper has a great utility factor for upcoming researchers interested in NILM techniques.

Prudent and meaningful performance evaluation of algorithms is essential for the progression of any research field. In the field of Non-Intrusive Load Monitoring (NILM), performance evaluation can be conducted on real-world aggregate signals, provided by smart energy meters or artificial superpositions of individual load signals (i.e., denoised aggregates). It has long been suspected that testing on these denoised aggregates provides better evaluation results mainly due to the fact that the signal is less complex. Complexity in real-world aggregate signals increases with the number of unknown/untracked loads. Although this is a known performance reporting problem, an investigation into the actual performance gap between real and denoised testing is still pending. In this paper, we examine the performance gap between testing on real-world and denoised aggregates with the aim of bringing clarity into this matter. Starting with an assessment of noise levels in datasets, we find significant differences in test cases. We give broad insights into our evaluation setup comprising three load disaggregation algorithms, two of them relying on neural network architectures. The results presented in this paper, based on studies covering three scenarios with ascending noise levels, show a strong tendency towards load disaggregation algorithms providing significantly better performance on denoised aggregate signals. A closer look at the outcome of our studies reveals that all appliance types could be subject to this phenomenon. We conclude the paper by discussing aspects that could be causing these considerable gaps between real and denoised testing in NILM.

What we measure, we can improve. In accordance to this approach, Indian Institute of Science (IISc), Bangalore has developed a Micro-grid Monitoring System in the campus through the installation of Smart Meters, covering almost 250 nodes including substations, centers, departments, administration, hostels and other utilities. This will help the institute in various ways such as capacity planning, substation loading, phase imbalance correction, over-voltage monitoring, billing and so on. Smart Meters measure the power consumption at a single point in the building giving a picture of the energy consumption of the building as a whole. It is necessary to also understand the scenario of the constituent loads at the point where the smart meter is installed so that ways could be found to reduce consumption. Personalised, concise and reliable feedback providing appliance level breakdown of energy consumption in the premises is the key in implementing energy efficiency programs. Taking this into consideration the area of Non Intrusive Load Monitoring (NILM) was explored. In NILM the aggregate smart meter data is separated into constituent loads by machine learning techniques. The NILM system is trained through previous data sets and then the algorithm will disaggregate the total power into individual appliances based on its experience. A benchmark NILM algorithm called Factorial Hidden Markov Model was used for proper load disaggregation. Finally an attempt was made to develop a Smartphone app to visualize results and bring the data to the people.

Understanding customers’ energy consumption at the individual appliances level is crucial for the planning and implementation of demand response (DR) programs. The appliances’ usage profiles can be disaggregated from whole-house energy consumption data using non-intrusive load monitoring (NILM) methods. The appliance load patterns of each customer are considerably different, which make it challenging to train a model with strong generalization ability. In this paper, a novel methodology using transfer knowledge between domains for NILM is proposed. A temporal convolutional network is developed to learn the dynamic features of individual appliance load. A domain adaption loss is used to quantify the domain distribution discrepancy between source and target domain representation. By jointly optimizing domain adaptation and energy disaggregation, an invariant representation across domains for the individual appliance states can be learned. Data experiments on ground truth data validate the accuracy and the robustness of the proposed model, and demonstrate its superior transferability and application potential under those scenarios of data shortage.

Non-intrusive load monitoring (NILM) based energy disaggregation is the decomposition of a system's energy into the consumption of its individual appliances. Previous work on deep learning NILM algorithms has shown great potential in the field of energy management and smart grids. In this paper, we propose BERT4NILM, an architecture based on bidirectional encoder representations from transformers (BERT) and an improved objective function designed specifically for NILM learning. We adapt the bidirectional transformer architecture to the field of energy disaggregation and follow the pattern of sequence-to-sequence learning. With the improved loss function and masked training, BERT4NILM outperforms state-of-the-art models across various metrics on the two publicly available datasets UK-DALE and REDD.

Non-intrusive load monitoring (NILM) or energy disaggregation, aims to disaggregate a household's electricity consumption into constituent appliances. More than three decades of work in NILM has resulted in the development of several novel algorithmic approaches. However, despite these advancements, two core challenges still exist: i) disaggregating low power consumption appliances and ii) distinguishing between multiple instances of similar appliances. These challenges are becoming increasingly important due to an increasing number of appliances and increased usage of electronics in homes. Previous approaches have attempted to solve these problems using expensive hardware involving high sampling rates better suited to laboratory settings, or using additional number of sensors, limiting the ease of deployment. In this work, we explore using commercial-off-the-shelf (COTS) power line communication (PLC) modems as an inexpensive and easy to deploy alternative solution to these problems. We use the reduction in bandwidth between two PLC modems, caused due to the change in PLC modulation scheme when different appliances are operated as a signature for an appliance. Since the noise generated in the powerline is dependent both on type and location of an appliance, we believe that our technique based on PLC modems can be a promising addition for solving NILM.

Non-intrusive load monitoring (NILM) considers different approaches for disaggregating energy consumption in residential, tertiary, and industrial buildings to enable smart grid services. The main feature of NILM is that it can break down the bulk electricity demand, as recorded by conventional smart meters, into the consumption of individual appliances without the need for additional meters or sensors. Furthermore, NILM can identify when an appliance is in use and estimate its real-time consumption based on its unique consumption patterns. However, NILM is based on machine learning methods and its performance is dependent on the quality of the training data for each appliance. Therefore, a common problem with NILM systems is that they may not generalize well to new environments where the appliances are unknown, which hinders their widespread adoption and more significant contributions to emerging smart grid services. The main goal of the presented research is to apply a domain adversarial neural network (DANN) approach to improve the generalization of NILM systems. The proposed semi-supervised algorithm utilizes both labeled and unlabeled data and was tested on data from publicly available REDD and UK-DALE datasets. The results show a improvement in generalization performance on highly uncorrelated data, indicating the potential for real-world applications.

Non-intrusive load monitoring (NILM) has become an important subject of study, since it provides benefits to both consumers and utility companies. The analysis of smart meter signals is useful for identifying consumption patterns and user behaviors, in order to make predictions and optimizations to anticipate the use of electrical appliances at home. However, the problem with this kind of analysis rests in how to isolate individual appliances from an aggregated consumption signal. In this work, we propose an unsupervised disaggregation method based on a controlled dataset obtained using smart meters in a standard household. By using soft computing techniques, the proposed methodology can identify the behavior of each of the devices from aggregated consumption records. In the approach developed in this work, it is possible to detect changes in power levels and to build a box model, consisting of a sequence of rectangles of different heights (power) and widths (time), which is highly adaptable to the real-life working conditions of household appliances. The system was developed and tested using data collected at households in France and the UK (UK-domestic appliance-level electricity (DALE) dataset). The proposed analysis method serves as a basis to be applied to large amounts of data collected by distribution companies with smart meters.