Solving Unit Commitment Problems with Multi-step Deep Reinforcement Learning

This paper presents the solving unit commitment (UC) problem using Modified Subgradient Method (MSG) method combined with Simulated Annealing (SA) algorithm. UC problem is one of the important power system engineering hard-solving problems. The Lagrangian relaxation (LR) based methods are commonly used to solve the UC problem. The main disadvantage of this group of methods is the difference between the dual and the primal solution which gives some significant problems on the quality of the feasible solution. In this paper, MSG method which does not require any convexity and differentiability assumptions is used for solving the UC problem. MSG method depending on the initial value reaches zero duality gap. SA algorithm is used in order to assign the appropriate initial value for MSG method. The major advantage of the proposed approach is that it guarantees the zero duality gap independently from the size of the problem. In order to show the advantages of this proposed approach, the four-unit Tuncbilek thermal plant and ten-unit thermal plant which is usually used in literature are chosen as test systems. Penalty function (PF) method is also used to compare with our proposed method in terms of total cost and UC schedule.

The unit commitment operation in power systems is a complex, non-linear, constrained optimization problem. The commitment and de-commitment decision presents a binary problem which needs discrete/binary optimization approaches. This paper presents a binary bat search algorithm (BBSA) to solve unit commitment (UC) problem. The bat search algorithm belongs to a meta heuristic class of optimization approaches inspired by natural echolocation behavior of bats. In order to solve binary UC problem, the real valued bat search process is mapped to binary search space using sigmoidal transformation function. The BBSA is then applied to test system with 10 thermal units. The effectiveness of the BBSA is verified against system dimension using test systems upto 100 units. Extensive numerical experiments are performed to test the effectiveness of BBSA and statistical analysis of simulation results are presented. The simulation results are presented, discussed and compared to various existing classical and heuristic approaches. The same demonstrate the superior performance of BBSA approach in solving UC problem.

Study on unit commitment problem considering pumped storage and renewable energy via a novel binary artificial sheep algorithm

This paper presents a Hybrid Particle Swarm Optimization (HPSO) to solve the Unit Commitment (UC) problem. Problem formulation of the unit commitment takes into consideration the minimum up and down time constraints, start up cost and spinning reserve, which is defined as the minimization of the total objective function while satisfying all the associated constraints. Problem formulation, representation and the simulation results for a 10 generator-scheduling problem are presented. Results shown are acceptable at this early stage.

This paper proposes an innovative genetic algorithm (GA) approach to solve the thermal unit commitment (UC) problem in power generation industry through a constraint satisfaction technique. Due to a large variety of constraints to be satisfied, the solution space of the UC problem is highly nonconvex, and therefore the UC problem can not be solved efficiently by the standard GA. To effectively deal with the constraints of the problem and greatly reduce the search space of the GA, the minimum up- and down-time constraints are embedded in the binary strings that are coded to represent the on-off states of the generating units. The violations of the other constraints are handled by integrating penalty factors into the cost function. Numerical results on the practical Taiwan Power (Taipower) system of 38 thermal units over a 24-hour period show that the features of easy implementation, fast convergence, and highly near-optimal solution in solving the UC problem can be achieved by the proposed GA approach. >

Many different methods have been presented to solve unit commitment (UC) problem in literature with different advantages and disadvantages. The need for multiple runs, huge computational burden and time, and poor convergence are some of the disadvantages, where are especially considerable in large scale systems. In this paper, a new analytical and non-iterative method is presented to solve UC problem. In the proposed method, improved pre-prepared power demand (IPPD) table is used to solve UC problem, and then analytical “λ-logic” algorithm is used to solve economic dispatch (ED) sub-problem. The analytical and non-iterative nature of the mentioned methods results in simplification of the UC problem solution. Obtaining minimum cost in very small time with only one run is the major advantage of the proposed method. The proposed method has been tested on 10 unit and 40-100 unit systems with consideration of different constraints, such as: power generation limit of units, reserve constraints, minimum up and down times of generating units. Comparing the simulation results of the proposed method with other methods in literature shows that in large scale systems, the proposed method achieves minimum operational cost within minimum computational time.

This paper presents centralized control for a wind farm using model predictive control (MPC) method. In order to solve intra-day unit commitment (UC) problem, the UC problem is solved by using the MPC method with short-term wind power forecasting. We introduce a new dynamics model for the UC with some constraints to utilize the benefits of the MPC method. The objective function considering the operation and maintenance costs is formulated by adding a new variable in order to average the operating time of each wind turbine (WT) within the whole time. The proposed method could solve the UC problems on-line using the prediction time horizon that could be selected flexibly considering time horizon based on wind power forecasting errors. From the simulation study using 10 WTs, we observed that the proposed dynamics model of UC effectively provided the optimal solution to each scenario. Numerical study will validate that the proposed method can be applied to solving the UC problem of a large scale wind farm by aggregating WTs.

Unit commitment (UC) is a non-linear, combinatorial, mixed integer constrained optimization problem. The aim of unit commitment problem (UCP) is obtained the most cost effective on/off schedule for generating units to meet the forecasted load demand and spinning reserve for a specified time horizon. UCP can be seen as a two combined optimization problem, the on/off scheduling problem of generating units and the real power allocation problem. A feasible UC schedule must satisfy various system and unit constraints. Various techniques have been developed to solve generator scheduling problem/ UCP. Natural Evolution based techniques are extensively applied to obtain global optimal solution. Genetic algorithm is one of the evolutionary method. This paper presents a comprehensive review on genetic algorithm based unit commitment problem solution. A survey of all of the research papers up to the year 2013 on this topic is given.

In this paper, Security Constrained Unit Commitment (SCUC) problem with combined Thermal- Solar generating units is solved using Artificial Bee Colony (ABC) algorithm. SCUC problem aims to obtain minimum generation cost while satisfying the system, network and security constraints. The SCUC problem is divided into Unit Commitment Problem (UCP) which is considered as the master problem and Security Constrained Economic Dispatch (SCED) is considered as the sub problem. Here, both thermal and solar generations are considered in UCP and SCED solutions. Binary Coded ABC Algorithm is used to solve the UCP and Real Coded ABC Algorithm is used for solving the SCED problem. The constraints such as spinning reserves, hourly load demands, ramp up/ramp down limits of generators, minimum up/down limits, line flow and voltage limits are considered in the problem formulation. Beta distribution function is employed to forecast the solar power generation in different seasons. The comparison is carried out with and without incorporating solar generation. The proposed method is validated on a 6 bus system and a South Indian 86 bus utility.

This paper presents an algorithm for integrating and managing electrochemical energy storage systems (ESSs) on unit commitment (UC) problem. As some elements required for integrating electrochemical ESS, such as the power converter, have non-linear characteristics, its corresponding linear modeling could be difficult to be developed and included on the UC problem, which could lead to unfeasible solutions or unexpected results. In order to incorporate full models of ESS and its interface with the power system, in this paper an algorithm to incorporate electrochemical ESS management on the UC problem is presented. An insular power system of 10-units is analyzed, and conclusions are duly drawn.

The unit commitment(UC) problem is a critical problem in economic dispatch of power system, and it is the key to planning for short-term power generation. Its economic benefit is generally greater than the benefit of economic distribution of load. However, unit commitment is a high-dimensional, nonconvex, discrete, nonlinear mixed integer optimization problem, and is difficult to find the optimal theoretical solution. Therefore, people have been actively studying to solve this problem. Social learning particle swarm optimizer is a recent proposed metaheuristic algorithm specialized in solving the high-dimensional problem. In this paper, a novel binary social learning particle swarm optimizer (BSLPSO) is proposed for solving the UC problem associated with lambda iteration method. In order to verify the effectiveness of the algorithm for UC problem, a comprehensive numerical study of 10 to 100 units has been conducted, and compared with other related algorithms. The result shows that this algorithm performs well in UC problem and is better than other algorithms.

In recent years, high penetration of variable generating sources, such as wind power, has challenged independent system operators (ISO) in keeping a cheap and reliable power system operation. Any deviation between expected and real wind production must be absorbed by the power system resources (reserves), which must be available and ready to be deployed in real time. To guarantee this resource availability, the system resources must be committed in advance, usually the day-ahead, by solving the so-called unit commitment (UC) problem. If the quantity of committed resources is extremely low, there will be devastating and costly consequences in the system, such as significant load shedding. On the other hand, if this quantity is extremely high, the system operation will be excessively expensive, mainly because facilities will not be fully exploited. This thesis proposes computationally efficient models for optimal day-ahead planning in (thermal) power systems to adequately face the stochastic nature of wind production in the real-time system operation. The models can support ISOs to face the new challenges in short-term planning as uncertainty increases dramatically due to the integration of variable generating resources. This thesis then tackles the UC problem in the following aspects: Power system representation: This thesis identifies drawbacks of the traditional energy-block scheduling approach, which make it unable to adequately prepare the power system to face deterministic and perfectly known events. To overcome those drawbacks, we propose the ramp-based scheduling approach that more accurately describes the system operation, thus better exploiting the system flexibility. UC computational performance: Developing more accurate models would be pointless if these models considerably increase the computational burden of the UC problem, which is already a complex integer and non-convex problem. We then devise simultaneously tight and compact formulations under the mixed-integer programming (MIP) approach. This simultaneous characteristic reinforces the convergence speed by reducing the search space (tightness) and simultaneously increasing the searching speed (compactness) with which solvers explore that reduced space. Uncertainty management in UC: By putting together the improvements in the previous two aspects, this thesis contributes to a better management of wind uncertainty in UC, even though these two aspects are in conflict and improving one often means harming the other. If compared with a traditional energy-block UC model under the stochastic (deterministic) paradigm, a stochastic (deterministic) ramp-based UC model: 1) leads to more economic operation, due to a better and more detailed system representation, while 2) being solved significantly faster, because the core of the model is built upon simultaneously tight and compact MIP formulations. To further improve the uncertainty management in the proposed ramp-based UC, we extend the formulation to a network-constrained UC with robust reserve modelling. Based on robust optimization insights, the UC solution guarantees feasibility for any realization of the uncertain wind production, within the considered uncertainty ranges. This final model remains as a pure linear MIP problem whose size does not depend on the uncertainty representation, thus avoiding the inherent computational complications of the stochastic and robust UCs commonly found in the literature.

This paper presents a hybrid immune algorithm (IA)/genetic algorithm (GA) and fuzzy system (FS) method (IGAFS) for solving short-term thermal generating unit commitment (UC) problems. The UC problem involves determining the start-up and shutdown schedules for generating units to meet the forecasted demand at the minimum cost. The commitment schedule must satisfy other constraints such as the generating limits per unit, reserve and individual units. First, we combined the IA and GA, then we added the fuzzy system approach. This hybrid system was used to solve the UC problems. Numerical simulations were carried out using three cases; ten, twenty and thirty thermal unit power systems over a 24 hrs period. The produced schedule was compared with several other methods, such as dynamic programming (DP), Lagrangian relaxation (LR), standard genetic algorithm (SGA), traditional simulated annealing (TSA), and traditional tabu search (TTS). The result demonstrated the accuracy of the proposed CIGAFS approach.

An approach to solving the short-term unit commitment problem (UCP) using a neural-based tabu search (NBTS) is presented. The solution of the unit commitment problem is a complex optimisation problem. The exact solution of the UCP can be obtained by a complete enumeration of all feasible combinations of generating units, which could be a huge number. The unit commitment has commonly been formulated as a nonlinear, large-scale, mixed-integer combinational optimisation problem. The objective is to find the generation scheduling such that the total operating cost can be minimised, when subjected to a variety of constraints. This also means that it is desirable to find the optimal generating unit commitment in the power system for the next H hours. Tabu search is a powerful optimisation procedure that has been successfully applied to a number of combinatorial optimisation problems. It has the ability to avoid entrapment in local minima by employing a flexible memory system. The neural network combines good solution quality for tabu search with rapid convergence for an artificial neural network. The neural based tabu search method is used to find the unit commitment. By doing so, it gives the optimum solution rapidly and efficiently. The Neyveli Thermal Power Station (NTPS) Unit – II in India has been considered as a case study and extensive studies have also been performed for different power systems consisting of 10, 26, and 34 generating units. The data collected has been used for implementation in the above methods. Numerical results are shown, comparing the cost solutions and computation time obtained by using the intelligent techniques with the conventional methods like dynamic programming and Lagrangian relaxation to reach proper unit commitment.

In traditional electricity market unit commitment (UC) is done only for the reduction of operating cost. In the deregulated electricity market, for a secure and economical hourly generation schedule of the day ahead market, independent system operator (ISO) executes the security constrained unit commitment (SCUC) problem. The objective of the paper is to develop scheduling algorithm using hybrid particle swarm optimization (PSO) for electric generation that accounts directly for system security requirements. The proposed SCUC formulation includes constraints, such as hourly power demand, system reserves, ramp up/down limits, minimum ON/OFF duration limits. The innovation of our approach is to capture the system security requirements within a network flow sub-problem that is solved in conjunction with the unit commitment problem. To solve such SCUC model, a binary coded particle swarm optimization (BPSO) is used for unit commitment master problem and real coded particle swarm optimization (RPSO) is used for the economic dispatch sub-problem. The effectiveness of the suggested method to solve the SCUC problem is validated on different test systems.