Load Disaggregation Using Microscopic Power Features and Pattern Recognition

What we measure, we can improve. In accordance to this approach, Indian Institute of Science (IISc), Bangalore has developed a Micro-grid Monitoring System in the campus through the installation of Smart Meters, covering almost 250 nodes including substations, centers, departments, administration, hostels and other utilities. This will help the institute in various ways such as capacity planning, substation loading, phase imbalance correction, over-voltage monitoring, billing and so on. Smart Meters measure the power consumption at a single point in the building giving a picture of the energy consumption of the building as a whole. It is necessary to also understand the scenario of the constituent loads at the point where the smart meter is installed so that ways could be found to reduce consumption. Personalised, concise and reliable feedback providing appliance level breakdown of energy consumption in the premises is the key in implementing energy efficiency programs. Taking this into consideration the area of Non Intrusive Load Monitoring (NILM) was explored. In NILM the aggregate smart meter data is separated into constituent loads by machine learning techniques. The NILM system is trained through previous data sets and then the algorithm will disaggregate the total power into individual appliances based on its experience. A benchmark NILM algorithm called Factorial Hidden Markov Model was used for proper load disaggregation. Finally an attempt was made to develop a Smartphone app to visualize results and bring the data to the people.

This paper presents a novel Non-Intrusive Load Monitoring (NILM) approach focusing on the Energy Efficiency (EE) assessment of residential appliances. This approach (NILMEE) is able to identify the individual consumption of several household devices, providing proper information for evaluating energy efficiency and pointing out the operational issues or labelling mismatches of appliances, while recommending better practices for energy usage in specific consumer installations. The proposed approach was developed and evaluated by embedding the NILM engine on an electronic power meter, which performs a microscopic analysis on measured voltages and currents and provides the load disaggregation using the Conservative Power Theory for the feature extraction, K-Nearest Neighbours for the appliance classification, and the Power Signature Blob for the energy disaggregation. The disaggregation algorithm performance evaluation is carried out using NILMTK. Results show that NILM transcends the regular energy usage calculation, serving as a tool that enables the diagnosis of household appliances using the energy efficiency indexes provided by labels and standards.

Non-intrusive load monitoring (NILM) is to estimate individual appliance’s power consumption from aggregated smart meter data, which is useful for optimized energy management and provisioning of customized services. While deep learning (DL) has achieved state-of-the-art NILM performance, it is still constrained by the dependency on large amounts of data and intensive computations on training. In this paper, we propose a pre-training approach to address the generalization of DL models for NILM. We develop a meta-learning based approach and an ensemble learning based approach, which pre-train a base model and then fine-tune it with few-short learning when applied to an unknown dataset. The models are validated with two real-world datasets and shown to achieve a superior transferability performance compared with traditional DL and transfer learning methods.

Beyond privacy and security: Exploring ethical issues of smart metering and non-intrusive load monitoring

Millions of smart meters have been deployed worldwide, collecting the total power consumed by individual households. Based on these data, electricity suppliers offer their clients energy monitoring solutions to provide feedback on the consumption of their individual appliances. Historically, such estimates have relied on statistical methods that use coarse-grained total monthly consumption and static customer data, such as appliance ownership. Non-Intrusive Load Monitoring (NILM) is the problem of disaggregating a household's collected total power consumption to retrieve the consumed power for individual appliances. Current state-of-the-art (SotA) solutions for NILM are based on deep-learning (DL) and operate on subsequences of an entire household consumption reading. However, the non-stationary nature of real-world smart meter data leads to a drift in the data distribution within each segmented window, which significantly affects model performance. This paper introduces NILMFormer, a Transformer-based architecture that incorporates a new subsequence stationarization/de-stationarization scheme to mitigate the distribution drift and that uses a novel positional encoding that relies only on the subsequence's timestamp information. Experiments with 4 real-world datasets show that NILMFormer significantly outperforms the SotA approaches. Our solution has been deployed as the backbone algorithm for EDF's (Electricité De France) consumption monitoring service, delivering detailed insights to millions of customers about their individual appliances' power consumption.

Energy disaggregation algorithms disintegrate aggregate demand into appliance-level demands. Among various energy disaggregation approaches, non-intrusive load monitoring (NILM) algorithms requiring a single sensor have gained much attention in recent years. Various machine learning and optimization-based NILM approaches are available in the literature, but bulk training data and high computational time are their respective drawbacks. Considering these drawbacks, we devised an event matching energy disaggregation algorithm (EMEDA) for NILM of multistate household appliances using smart meter data. Having limited training data, K-means clustering was employed to estimate appliance power states. These power states were accumulated to generate an event database (EVD) containing all combinations of appliance operations in their various states. Prior to matching, the test samples of aggregate demand events were decreased by event-driven data compression for computational effectiveness. The compressed test events were matched in the sorted EVD to assess the contribution of each appliance in the aggregate demand. To counter the effects of transient spikes and/or dips that occurred during the state transition of appliances, a post-processing algorithm was also developed. The proposed approach was validated using the low-rate data of the Reference Energy Disaggregation Dataset (REDD). With better energy disaggregation performance, the proposed EMEDA exhibited reductions of 97.5 and 61.7% in computational time compared with the recent smart event-based optimization and optimization-based load disaggregation approaches, respectively.

Nonintrusive disaggregation of residential air-conditioning loads from sub-hourly smart meter data

This paper presents a complete real-time implementation of a Non-Intrusive Appliance Load Monitoring (NIALM) system that, is robust under residential voltage level fluctuations. Existing NIALM techniques rely on multiple measurements taken at high sampling rates, but, only have been proven in simulated environments without even considering the effect of residential voltage level fluctuations — which is a severe problem in power systems of most developing countries like Sri Lanka. In contrast, through the NIALM method proposed in this paper, accurate load monitoring results were obtained in realtime using only smart meter measurements taken at a low sampling rate from a real appliance setup under residential voltage level fluctuations. In the proposed NIALM method, initially in the learning phase, a properly constructed MATLABTM Graphical User Interface (GUI) was used to acquire signals of each appliance active power consumption and voltage levels. Then, obtained active power measurements were separated into subspace components (SCs) via the Karhunen Loeve' Expansion (KLE) while also taking the voltage variations into account. Using those SCs, a unique information rich appliance level signature database was constructed and it was then used to obtain the signatures for all possible device combinations. Next, a separate GUI was designed to identify the turned ON appliance combination in the current time window using the pre-constructed signature databases, after reading the total residential active power consumption and the supply voltage. To validate the proposed real-time NIALM implementation, data from a laboratory arrangement consisting of ten household appliances was used. From the results, it was found that the proposed method is capable of accurately identifying the turned on appliances even under severe residential supply voltage level fluctuations.

Non-Intrusive Load Monitoring (NILM) is an efficient way for energy disaggregation, as it can identify and monitor power consumption of downstream appliances or equipment from the aggregated data acquired from a single electricity metering point. There are many researches and applications of NILM in residential load disaggregation, but very few are applied on industrial load so far. This paper studies the industrial load disaggregation via NILM based on on-situ monitoring energy consumption data from one factory. The factorial hidden Markov model (FHMM) is applied for load disaggregation of five industrial equipment in the factory with the active power and reactive power data synchronously sampled at the rate of 1 Hz. This is the first attempt of using FHMM with both active power and reactive power as outputs for modeling industrial load in this field of NILM, and the promising results demonstrate its effectiveness for industrial load disaggregation.

<p>The need of electrical energy saving policies is becoming increasingly important nowadays, specially after the latest electricity market tensions in Europe. The energy consumption impacts directly in our electricity bills, thus optimization strategies are required to decrease its negative consequences on the economy and encouraging the consumption of renewable energies and reducing the carbon footprint. For this reason, non-intrusive load monitoring is gaining more attention as a modern strategy to assist in controlling electricity consumption. Several techniques have been proposed using basic information from current or voltage waveforms. However, the use of harmonic features is not widespread due to the need for a device capable of measuring power signals at a high sampling rate and for the high complexity of the disaggregation problem. The use of new high-end IoT devices like openZmeter, can help on this task. In this paper, several sets of harmonic features (current, active power, and custom combination) used along with a particle filter algorithm are compared. The results show that increasing the number of odd harmonics increases the accuracy of the result provided by the algorithm.</p>

The electric energy demand is dramatically growing worldwide and demand reduction emerges as an outstanding strategy; it implies detailed information about the electricity consumption, namely load disaggregation. Typical automatic methods for load disaggregation require high hardware efforts to install one sensor per appliance, whereas Non-intrusive Load Monitoring (NILM) systems diminish the hardware efforts through signal processing and mathematical modeling. One approach to NILM systems is to model the load signatures via artificial intelligence. This paper proposes to employ S-Transform for the feature extraction stage and Support Vector Machines for the pattern recognition problem. Several experiments are presented and the results of the feature extraction with S-Transform and Wavelet Packet Transform are compared. Thus promising feature vectors based on S-Transform are presented with similar or superior performance than the approach based on Wavelet Packet Transform.

Deep attention and generative neural networks for nonintrusive load monitoring

Renewable energy sources are slowly but surely supplementing conventional sources of energy. These energy sources create a large number of micro-grids which become a part of the main grid. Smart meters are essential components in smart micro-grids and smart grids. Together they form a complex system which has become today an attractive area of research world-wide in view of enormous benefits of reliability and safety of power supply economically. Several studies in smart meter applications have shown that in residential buildings, energy consumption can be reduced up to 15% with better management. For this, a non-intrusive appliance load monitoring (NIALM) technique has been advocated which enables appliance identification to help better energy management. The identification is done using load signatures with appropriate algorithm. Several features of load signatures ranging from voltage and current profiles (steady states and transients) to a plethora of features such as active power (P) and reactive power (Q), power factor (pf), harmonic components (h), magnitudes of h (mh), current waveform (CW), eigen values, switching transient waveform, instantaneous admittance waveform, etc have been used in NIALM. The algorithms used vary from a `single algorithm' to `multiple algorithms', the latter used in `Committee Decision Mechanism' (CDM) in which majority of `votes' (i.e., agreement), `cast' by each of the algorithms, decides the final result of appliances identified. This scenario presents a serious difficulty with regard to choice of features and algorithms, besides the possibility of increasing the hardware and software costs of smart meters. The motivation for the study in this paper is provided by this scenario. The basic objective of this paper is to investigate the possibility of including only a limited number of features as load signature of appliances, and the use of only a single algorithm to effectively implement NIALM without any ambiguity. Results of our study so far indicate that generally only four features of P, Q, h and mh are sufficient for detection of appliances in operation; however, in some cases (~>10%), the additional feature, CW, may be needed for final identification.. The experiments conducted so far yielded unambiguous identification of appliances and the results are encouraging enough for possible use in practice for residential loads only.

Non-intrusive load monitoring (NILM) considers different approaches for disaggregating energy consumption in residential, tertiary, and industrial buildings to enable smart grid services. The main feature of NILM is that it can break down the bulk electricity demand, as recorded by conventional smart meters, into the consumption of individual appliances without the need for additional meters or sensors. Furthermore, NILM can identify when an appliance is in use and estimate its real-time consumption based on its unique consumption patterns. However, NILM is based on machine learning methods and its performance is dependent on the quality of the training data for each appliance. Therefore, a common problem with NILM systems is that they may not generalize well to new environments where the appliances are unknown, which hinders their widespread adoption and more significant contributions to emerging smart grid services. The main goal of the presented research is to apply a domain adversarial neural network (DANN) approach to improve the generalization of NILM systems. The proposed semi-supervised algorithm utilizes both labeled and unlabeled data and was tested on data from publicly available REDD and UK-DALE datasets. The results show a improvement in generalization performance on highly uncorrelated data, indicating the potential for real-world applications.

Nonintrusive load monitoring (NILM), sometimes referred to as load disaggregation, is the process of determining what loads or appliances are running in a house from analysis of the power signal of the whole-house power meter. As the popularity of NILM grows, we find that there is no consistent way the researchers are measuring and reporting accuracies. In this short communication, we present a unified approach that would allow for consistent accuracy testing.