Optimal control of sugarscape agent‐based model via a PDE approximation model

Experimental results have shown that anti-cancer therapies, such as radiotherapy and chemotherapy, can modulate the cell cycle and generate cell cycle phase-dependent responses. As a result, obtaining a detailed understanding of the cell cycle is one possible path towards improving the efficacy of many of these therapies. Here, we consider a basic structured partial differential equation (PDE) model for cell progression through the cell cycle, and derive expressions for key quantities, such as the population growth rate and cell phase proportions. These quantities are shown to be periodic and, as such, we compare the PDE model to a corresponding ordinary differential equation (ODE) model in which the parameters are linked by ensuring that the long-term ODE behaviour agrees with the average PDE behaviour. By design, we find that the ODE model does an excellent job of representing the mean dynamics of the PDE model within just a few cell cycles. However, by probing the parameter space we find cases in which this mean behaviour is not a good measure of the PDE population growth. Our analytical comparison of two caricature models (one PDE and one ODE system) provides insight into cases in which the simple ODE model is an appropriate approximation to the PDE model.

The Overview, Design concepts and Details (ODD) protocol for describing Individual-and Agent-Based Models (ABMs) is now widely accepted and used to document such models in journal articles. As a standardized document for providing a consistent, logical and readable account of the structure and dynamics of ABMs, some research groups also find it useful as a workflow for model design. Even so, there are still limitations to ODD that obstruct its more widespread adoption. Such limitations are discussed and addressed in this paper: the limited availability of guidance on how to use ODD; the length of ODD documents; limitations of ODD for highly complex models; lack of sufficient details of many ODDs to enable reimplementation without access to the model code; and the lack of provision for sections in the document structure covering model design ratio-nale, the model’s underlying narrative, and the means by which the model’s fitness for purpose is evaluated. We document the steps we have taken to provide better guidance on: structuring complex ODDs and an ODD summary for inclusion in a journal article (with full details in supplementary material; Table 1); using ODD to point readers to relevant sections of the model code; update the document structure to include sections on model rationale and evaluation. We also further advocate the need for standard descriptions of simulation experiments and argue that ODD can in principle be used for any type of simulation model. Thereby ODD would provide a lingua franca for simulation modelling.

This article explores the observer-based feedback control problem for a nonlinear hyperbolic partial differential equations (PDEs) system. Initially, the polynomial fuzzy hyperbolic PDEs (PFHPDEs) model is established through the utilization of the fuzzy identification approach, derived from the nonlinear hyperbolic PDEs model. Various types of state estimation and controller design problems for the polynomial fuzzy PDEs system are discussed concerning the state estimation problem. To investigate the relaxed stability problem, Euler's homogeneous theorem, Lyapunov-Krasovskii functional with polynomial matrices (LKFPM), and the sum-of-squares (SOSs) approach are adopted. The exponential stabilization condition is formulated in terms of the spatial-derivative-SOSs (SD-SOSs). Additionally, a segmental algorithm is developed to find the feasible solution for the SD-SOS condition. Finally, a hyperbolic PDEs system and several numerical examples are provided to illustrate the validity and effectiveness of the proposed results.

In this study, problems of the partial differential equation (PDE) modelling and vibration control design are first resolved for an overhead crane bridge system, which is regarded as a Timoshenko beam with an attached rigid body. With the established infinite‐dimensional PDE model, a Nussbaum function‐based adaptive control approach is developed in order to settle out parametric uncertainties of the system with unknown control directions. Under the proposed control method, states of the overhead crane bridge are globally bounded and finally converge to an adjustable region of zero. The stability of the closed‐loop overhead crane bridge system is analysed by employing Lyapunov's direct method. The effectiveness of the developed control strategy is verified through the simulation results.

A closed loop model of pulmonary gas exchange

We study parametric optimal control problems governed by a system of time-dependent partial differential equations (PDE) and subject to additional control and state constraints. An approach is presented to compute the optimal control functions and the so-called sensitivity differentials of the optimal solution with respect to perturbations. This information plays an important role in the analysis of optimal solutions as well as in real-time optimal control. The method of lines is used to transform the perturbed PDE system into a large system of ordinary differential equations. A subsequent discretization then transcribes parametric ODE optimal control problems into perturbed nonlinear programming problems (NLP), which can be solved efficiently by SQP methods. Second-order sufficient conditions can be checked numerically and we propose to apply an NLP-based approach for the robust computation of the sensitivity differentials of the optimal solutions with respect to the perturbation parameters. The numerical method is illustrated by the optimal control and sensitivity analysis of the Burgers equation.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

Beyond Lack of Compactness and Lack of Stability of a Coupled Parabolic-Hyperbolic Fluid-Structure System.- A Continuous Adjoint Approach to Shape Optimization for Navier Stokes Flow.- Recent Advances in the Analysis of State-constrained Elliptic Optimal Control Problems.- Fast and Strongly Localized Observation for a perturbed Plate Equation.- Representations, Composition, and Decomposition of C 1,1-hypersurfaces.- On Some Nonlinear Optimal Control Problems with Vector-valued Affine Control Constraints.- Weak Solutions to a Model for Crystal Growth from the Melt in Changing Magnetic Fields.- Lavrentiev Prox-regularization Methods for Optimal Control Problems with Pointwise State Constraints.- Nonlinear Feedback Solutions for a Class of Quantum Control Problems.- Optimal Feedback Synthesis for Bolza Control Problem Arising in Linearized Fluid Structure Interaction.- Single-step One-shot Aerodynamic Shape Optimization.- Shape Differentiability of Drag Functional for Compressible Navier-Stokes Equations.- Null-controllability for a Coupled Heat-Finite-dimensional Beam System.- Feedback Modal Control of Partial Differential Equations.- Optimization Problems for Thin Elastic Structures.- A New Non-linear Semidefinite Programming Algorithm with an Application to Multidisciplinary Free Material Optimization.- How to Check Numerically the Sufficient Optimality Conditions for Infinite-dimensional Optimization Problems.- Hidden Boundary Shape Derivative for the Solution to Maxwell Equations and Non Cylindrical Wave Equations.

Mathematical models to study quorum sensing (QS) have become an important tool to explore all aspects of this type of bacterial communication. A wide spectrum of mathematical tools and methods such as dynamical systems, stochastics, and spatial models can be employed. In this chapter, we focus on giving an overview of models consisting of differential equations (DE), which can be used to describe changing quantities, for example, the dynamics of one or more signaling molecule in time and space, often in conjunction with bacterial growth dynamics. The chapter is divided into two sections: ordinary differential equations (ODE) and partial differential equations (PDE) models of QS. Rates of change are represented mathematically by derivatives, i.e., in terms of DE. ODE models allow describing changes in one independent variable, for example, time. PDE models can be used to follow changes in more than one independent variable, for example, time and space. Both types of models often consist of systems (i.e., more than one equation) of equations, such as equations for bacterial growth and autoinducer concentration dynamics. Almost from the onset, mathematical modeling of QS using differential equations has been an interdisciplinary endeavor and many of the works we revised here will be placed into their biological context.

Neural field models of firing rate activity typically take the form of integral equations with space-dependent axonal delays. Under natural assumptions on the synaptic connectivity we show how one can derive an equivalent partial differential equation (PDE) model that properly treats the axonal delay terms of the integral formulation. Our analysis avoids the so-called long-wavelength approximation that has previously been used to formulate PDE models for neural activity in two spatial dimensions. Direct numerical simulations of this PDE model show instabilities of the homogeneous steady state that are in full agreement with a Turing instability analysis of the original integral model. We discuss the benefits of such a local model and its usefulness in modeling electrocortical activity. In particular, we are able to treat "patchy" connections, whereby a homogeneous and isotropic system is modulated in a spatially periodic fashion. In this case the emergence of a "lattice-directed" traveling wave predicted by a linear instability analysis is confirmed by the numerical simulation of an appropriate set of coupled PDEs.

To model biochemical systems in which both noise in the chemical reaction process and spatial movement of molecules is important, both the reaction-diffusion master equation (RDME) and Smoluchowski diffusion-limited reaction (SDLR) partial differential equation (PDE) models have been used. In previous work we showed that the solution to the RDME may be interpreted as an asymptotic approximation in the reaction radius to the solution of the SDLR PDE [S. A. Isaacson, SIAM J. Appl. Math. 70, 77 (2009)]. The approximation was shown to be divergent in the limit that the lattice spacing in the RDME approached zero. In this work we expand upon these results for the special case of the two-molecule annihilation reaction, A+B-->Ø. We first introduce a third stochastic reaction-diffusion PDE model that incorporates a pseudopotential based bimolecular reaction mechanism. The solution to the pseudopotential model is then shown to be an asymptotic approximation to the solution of the SDLR PDE for small reaction radii. We next illustrate how the RDME may be obtained by a formal discretization of the pseudopotential model, motivating why the RDME is itself an asymptotic approximation of the SDLR PDE. Finally, we give a more detailed numerical analysis of the difference between solutions to the RDME and SDLR PDE models as a function of both the reaction-radius and the lattice spacing (in the RDME).

In general, optimal control problems rely on numerically rather than analytically solving methods, due to their nonlinearities. The direct method, one of the numerically solving methods, is mainly to transform the optimal control problem into a nonlinear optimization problem with finite dimensions, via discretizing the objective functional and the forced dynamical equations directly. However, in the procedure of the direct method, the classical discretizations of the forced equations will reduce or affect the accuracy of the resulting optimization problem as well as the discrete optimal control. In view of this fact, more accurate and efficient numerical algorithms should be employed to approximate the forced dynamical equations. As verified, the discrete variational difference schemes for forced Birkhoffian systems exhibit excellent numerical behaviors in terms of high accuracy, long-time stability and precise energy prediction. Thus, the forced dynamical equations in optimal control problems, after being represented as forced Birkhoffian equations, can be discretized according to the discrete variational difference schemes for forced Birkhoffian systems. Compared with the method of employing traditional difference schemes to discretize the forced dynamical equations, this way yields faithful nonlinear optimization problems and consequently gives accurate and efficient discrete optimal control. Subsequently, in the paper we are to apply the proposed method of numerically solving optimal control problems to the rendezvous and docking problem of spacecrafts. First, we make a reasonable simplification, i.e., the rendezvous and docking process of two spacecrafts is reduced to the problem of optimally transferring the chaser spacecraft with a continuously acting force from one circular orbit around the Earth to another one. During this transfer, the goal is to minimize the control effort. Second, the dynamical equations of the chaser spacecraft are represented as the form of the forced Birkhoffian equation. Then in this case, the discrete variational difference scheme for forced Birkhoffian system can be employed to discretize the chaser spacecraft's equations of motion. With further discretizing the control effort and the boundary conditions, the resulting nonlinear optimization problem is obtained. Finally, the optimization problem is solved directly by the nonlinear programming method and then the discrete optimal control is achieved. The obtained optimal control is efficient enough to realize the rendezvous and docking process, even though it is only an approximation of the continuous one. Simulation results fully verify the efficiency of the proposed method for numerically solving optimal control problems, if the fact that the time step is chosen to be very large to limit the dimension of the optimization problem is noted.

Partial differential equations (PDEs) have been successfully applied to many computer vision and image processing problems. However, designing PDEs requires high mathematical skills and good insight into the problems. In this paper, we show that the design of PDEs could be made easier by borrowing the learning strategy from machine learning. In our learning-based PDE (L-PDE) framework for image restoration, there are two terms in our PDE model: (i) a regularizer which encodes the prior knowledge of the image model and (ii) a linear combination of differential invariants, which is data-driven and can effectively adapt to different problems and complex conditions. The L-PDE is learnt from some input/output pairs of training samples via an optimal control technique. The effectiveness of our L-PDE framework for image restoration is demonstrated with two exemplary applications: image denoising and inpainting, where the PDEs are obtained easily and the produced results are comparable to or better than those of traditional PDEs, which were elaborately designed.

Accurate reporting and forecasting of PM2.5 concentration are important for improving public health. In this paper, we propose a partial differential equation (PDE) model, specially, a linear diffusive equation, to describe the spatial-temporal characteristics of PM2.5 in order to make short-term prediction. We analyze the temporal and spatial patterns of a real dataset from China’s National Environmental Monitoring and validate the PDE-based model in terms of predicting the PM2.5 concentration of the next day by the former days’ history data. Our experiment results show that the PDE model is able to characterize and predict the process of PM2.5 transport. For example, for 300 continuous days of 2016, the average prediction accuracy of the PDE model over all city-regions is 93% or 83% based on different accuracy definitions. To our knowledge, this is the first attempt to use PDE-based model to study PM2.5 prediction in both temporal and spatial dimensions.

A partial differential equation (PDE) model for a flexible inverted pendulum system (FIPS) is derived by the use of the Hamilton principle. To solve the coupling system model, a singular perturbation method was adopted. The PDE model was divided into a fast subsystem and a slow subsystem using the singular perturbation method. To stabilize the fast subsystem, a boundary control force was applied at the free end of the beam. It then was proven that the closed‐loop subsystem is appropriate and exponentially stable. For the slow subsystem, a sliding mode control method was employed to design a controller and the Linear Matrix Inequality (LMI) method was used to design the sliding surface. It then was shown that the slow subsystem is exponentially stable.