Optimal tracking control of flow velocity in a one-dimensional magnetohydrodynamic flow

In this paper, we consider an optimal control problem arising in a one-dimensional (1D) Magnetohydrodynamic (MHD) flow, which can be modelled by a coupled partial differential equations (PDEs) where the external control input (external induction of magnetic field) takes the multiplicative effect exerted on both state variables (momentum and magnetic components). The aim is to derive the flow velocity to within close proximity of a desired target flow velocity at the pre-indicated terminal time. We first use the Galerkin method to obtain a low dimensional dynamical ordinary differential equation (ODE) model based on the original coupled PDEs. Then, we combine the control parameterization method with the time-scaling transformation technique to obtain an approximate optimal parameter selection problem, which can be solved using gradient-based optimization techniques such as sequential quadratic programming (SQP). The exact gradients of the cost functional with respect to the decision parameters are computed based on the analytical equations. Finally, we conclude the paper with simulation results for an example of the 1D MHD flow.

In this paper, a reconfiguration guidance algorithm for formation flying spacecraft is presented. The formation reconfiguration guidance problem is first formulated as a continuous-time minimum-fuel or minimum-energy optimal control problem with collision avoidance and control constraints. The optimal control problem is then discretized to obtain a finite dimensional parameter optimization problem. In this formulation, the collision avoidance constraints are imposed via separating planes between each pair of spacecraft. A heuristic is introduced to choose these separating planes that leads to the convexification of the collision avoidance constraints. Additionally, convex constraints are imposed to guarantee that no collisions occur between discrete time samples. The resulting finite dimensional optimization problem is a second order cone program, for which standard algorithms can compute the global optimum with deterministic convergence and a prescribed level of accuracy. Consequently, the formation reconfiguration algorithm can be implemented onboard a spacecraft for real-time operations.

Direct optimal control methods first discretize a continuous-time Optimal Control Problem (OCP) and then solve the resulting Nonlinear Program (NLP). Sequential Quadratic Programming (SQP) is a popular family of algorithms to solve this finite dimensional optimization problem. In the specific case of a least squares cost, the Generalized Gauss-Newton (GGN) method is a popular approach which works very well under some assumptions. This paper proposes a Sequential Convex Quadratic Programming (SCQP) scheme which exploits additional convexities in the NLP in order to generalize the GGN algorithm, possibly extend its applicability and improve its local convergence. These properties are studied in detail for the proposed SCQP algorithm, which will be compared to the classical GGN method using a numerical case study of the optimal control of an inverted pendulum.

Real-time computational optimal control of an MHD flow system with parameter uncertainty quantification

Solutions to optimal control problems obtained via direct methods are usually of low resolution. As the desired resolution becomes higher, the number of parameters in the resulting parameter optimization problem increases nonlinearly. A concatenated approach to trajectory optimization previously introduced by the authors to obtain high resolution optimal solutions with low storage requirements is applicable only to a specific class of problems, such as minimum time and minimum energy optimal control problems. The hodograph ballooning approach introduced in this paper generalizes the concatenated approach to the most general optimal control problem. Introduction The development of powerful nonlinear programming software [1, 2] has made direct approaches to trajectory optimization the method of choice for most practical applications [3-5]. The discretization of an optimal control problem to a finite dimensional parameter optimization problem avoids many of the troublesome pathologies that are typical for the optimization over infinite dimensional function spaces [6-8]. Furthermore, direct approaches usually do not. require guessing the switching structure, and the dynamical system is devoid of the nonintuitive costate variables. However, to achieve good resolution it is usually necessary to refine some type of discretization mesh, and, ultimately, to use a large number of design parameters. For typical gradient search methods, this increase in the dimension of the optimization problem has nearly always a negative effect on the convergence rate and the robustness. Additionally, CPU time and RAM requirements for each iteration increase with the second power of the number of parameters (third power for non-sparse solvers) so that direct optimization approaches can become quite expensive. In [9], a method was introduced that achieves excellent resolution without solving high-dimensional nonlinear programming problems. This was achieved by lo'Senior Engineer, Member AIAA. t Supervising Engineer, Member AIAA. 117 Research Drive, Hampton, VA 23666. Copyright ©1996 by the American Institute of Aeronautics and Astronautics, Inc. All rights reserved cally optimizing the trajectory on an iterative sequence of short, partly overlapping subarcs. However, this approach is not applicable to the most general problem formulation. Loosely sneaking, it was required in [9] that the cost state does not appear explicitly in the right-hand side of the equations of motion. The present paper introduces a method through which the approach introduced in [9] becomes applicable to the most general problem formulation. Application of this method, however, requires a priori knowledge of the optimal cost. In practice it is observed that the optimal cost can be obtained with very high precision with reasonably low order discretizations. Once a good guess for the optimal cost is obtained presented in this paper can be applied to refine the trajectory, or, if the optimal cost value is not known a priori with sufficient precision, it can be applied iteratively with the prescribed cost value adjusted in an outer loop. Problem Formulation Let us consider the following simple optimal control problem stated in Mayer form: ^ 4 ( x ( t f ) , t f ) (1 )

An efficient method is introduced for solving optimal control and optimal parameter selection problems of nonlinear differential-algebraic systems involving general constraints. These infinite dimensional problems are converted into the finite dimensional optimization problems by using the control parametrization technique. Moreover, the transformed time locations for the control variables are included in such problems. As a result, optimal control problems become acausal optimal parameter selection problems. A modified version of differential evolution is introduced to solve these problems. The integration of the penalty functions is used to ensure the solution onto the feasible domain of the problems. Two industrial systems, a chemical reactor and a robotics arm, are used to illustrate the robustness and effectiveness of the method. The control effects can be improved by selecting the proper time locations as observed from the simulated results.

In this paper, we consider the problem of scheduling N robots interacting with a moving target. Both, the sequence of the robots and their trajectories are unknown and subject to optimization. Such type of problems appear in highly automated production plants and in the simulation of virtual factories. The purpose of the paper is to provide a mathematical model and to suggest a numerical solution approach. Our approach is based on the formulation of the problem as a bilevel optimization problem, where the lower level problem is an optimal control problem, while the upper level problem is a finite dimensional mixed-integer optimization problem. We approach the problem by exploitation of necessary optimality conditions for the lower level problem and by application of a Branch & Bound method for the resulting single level optimization problem. Two settings are taken into account. Firstly, no state constraints are assumed on the lower level problem, thus the local minimum principle applies directly. Secondly, the problem setting is augmented by pure state constraints, which are being handled by virtual controls in order to regularize the problem.

In this paper, we consider a class of optimal switching control problems with multiple time-delays and a cost on changing control and subject to terminal state constraints. A computational method involving three stages is developed to solve this class of optimal control problems. First, by parameterizing the control function with piecewise-constant functions, the optimal switching control problem is approximated by a sequence of finite-dimensional optimization problems, where the original switching times, the control heights and the control switching times are decision variables. Second, by introducing new variables, the total variation of the control variables is transformed into an equivalently smooth function. Third, we convert the constrained optimization problem into one only with box constraints by an exact penalty function method. The gradients of the cost functional are then derived, which can be combined with any gradient-based optimization method to determine the optimal solution. Finally, a numerical example is given to illustrate the effectiveness of the proposed algorithm.

This paper considers an optimal train control problem with two challenging, non-standard constraints: a speed constraint that is piecewise-constant with respect to the train's position, and control constraints that are non-smooth functions of the train's speed. We formulate this problem as an optimal switching control problem in which the mode switching times are decision variables to be optimized, and the track gradient and speed limit in each mode are constant. Then, using control parameterization and time-scaling techniques, we approximate the switching control problem by a finite-dimensional optimization problem, which is still subject to the challenging speed limit constraint (imposed continuously during each mode) and the non-smooth control constraints. We show that the speed constraint can be transformed into a finite number of point constraints. We also show that the non-smooth control constraints can be approximated by a sequence of conventional (smooth) inequality constraints. The resulting approximate problem can be viewed as a nonlinear programming problem and solved using gradient-based optimization algorithms, where the gradients of the cost and constraint functions are computed via the sensitivity method. A case study using data for a real subway line shows that the proposed method yields a realistic optimal control profile without the undesirable control fluctuations that can occur with the pseudospectral method.

The approximation for the boundary optimal control problem of Burgers–Fisher equation with constraints

In this paper, we investigate a discrete variational optimal control for mechanical systems that admit a Birkhoffian representation. Instead of discretizing the original equations of motion, our research is based on a direct discretization of the Pfaff–Birkhoff–d’Alembert principle. The resulting discrete forced Birkhoffian equations then serve as constraints for the minimization of the objective functional. In this way, the optimal control problem is transformed into a finite-dimensional optimization problem, which can be solved by standard methods. This approach yields discrete dynamics, which is more faithful to the continuous equations of motion and consequently yields more accurate solutions to the optimal control problem which is to be approximated. We illustrate the method numerically by optimizing the control for the damped oscillator.

Optimal control for fast acquisition of equilibrium voltage for Li-ion batteries

A common approach to solving infinite dimensional optimal control problems, such as in launch vehicle trajectory optimization, is to approximate the optimal control function as a set of parameters. This process, known as the direct method, transcribes the optimal control problem into a finite dimensional parameter optimization problem. Traditionally, subject matter experts and trajectory analysts work manually to find usable trajectories by changing the initial guess for the control parameters. This paper presents a method to capture the feasible design space of a launch vehicle trajectory problem. The result is a region of feasible values for the launch vehicle control parameters. In this context, feasibility is defined by the trajectory reaching the termination criteria, thereby returning a function evaluation. The method is applied to a Delta IV Medium launch vehicle. This vehicle is used because it represents the challenges of trajectory optimization for ETO launch vehicles while not being overly complex. Two ways of sampling the control parameter design space to determine feasibility are compared. Results are represented using design variable limits and the global feasible space is shown directly using scatter-plot matrices.

In general, optimal control problems rely on numerically rather than analytically solving methods, due to their nonlinearities. The direct method, one of the numerically solving methods, is mainly to transform the optimal control problem into a nonlinear optimization problem with finite dimensions, via discretizing the objective functional and the forced dynamical equations directly. However, in the procedure of the direct method, the classical discretizations of the forced equations will reduce or affect the accuracy of the resulting optimization problem as well as the discrete optimal control. In view of this fact, more accurate and efficient numerical algorithms should be employed to approximate the forced dynamical equations. As verified, the discrete variational difference schemes for forced Birkhoffian systems exhibit excellent numerical behaviors in terms of high accuracy, long-time stability and precise energy prediction. Thus, the forced dynamical equations in optimal control problems, after being represented as forced Birkhoffian equations, can be discretized according to the discrete variational difference schemes for forced Birkhoffian systems. Compared with the method of employing traditional difference schemes to discretize the forced dynamical equations, this way yields faithful nonlinear optimization problems and consequently gives accurate and efficient discrete optimal control. Subsequently, in the paper we are to apply the proposed method of numerically solving optimal control problems to the rendezvous and docking problem of spacecrafts. First, we make a reasonable simplification, i.e., the rendezvous and docking process of two spacecrafts is reduced to the problem of optimally transferring the chaser spacecraft with a continuously acting force from one circular orbit around the Earth to another one. During this transfer, the goal is to minimize the control effort. Second, the dynamical equations of the chaser spacecraft are represented as the form of the forced Birkhoffian equation. Then in this case, the discrete variational difference scheme for forced Birkhoffian system can be employed to discretize the chaser spacecraft's equations of motion. With further discretizing the control effort and the boundary conditions, the resulting nonlinear optimization problem is obtained. Finally, the optimization problem is solved directly by the nonlinear programming method and then the discrete optimal control is achieved. The obtained optimal control is efficient enough to realize the rendezvous and docking process, even though it is only an approximation of the continuous one. Simulation results fully verify the efficiency of the proposed method for numerically solving optimal control problems, if the fact that the time step is chosen to be very large to limit the dimension of the optimization problem is noted.

This paper proposes a solution method for the discrete-time long-term dynamic portfolio optimization problem with state and asset allocation constraints. We use the ideas of Model Predictive Control (MPC) to solve the constrained stochastic control problem. MPC is a solution technique which was developed to solve constrained optimal control problems for deterministic control applications. MPC solves the optimal control problem with a receding horizon where a series of consecutive open-loop optimal control problems is solved. The aim of this paper is to develop an MPC approach to the problem of long-term portfolio optimization when the expected returns of the risky assets are modeled using a factor model based on stochastic Gaussian processes. We prove that MPC is a suboptimal control strategy for stochastic systems which uses the new information advantageously and thus is better than the pure optimal open-loop control. For the open-loop optimal control optimization, we derive the conditional portfolio distribution and the corresponding conditional portfolio mean and variance. The mean and the variance depend on future decision about the asset allocation. For the dynamic portfolio optimization problem, we consider constraints on the asset allocation as well as probabilistic constraints on the attainable values of the portfolio wealth. We discuss two different objectives, a classical mean–variance objective and the objective to maximize the probability of exceeding a predetermined value of the portfolio. The dynamic portfolio optimization problem is stated, and the solution via MPC is explained in detail. The results are then illustrated in a case study.