Efficient quaternion CUR decomposition based on discrete empirical interpolation method

In this thesis we analyze and develop methods based on model order reduction (MOR) for the solution of optimization problems constrained by time-dependent partial differential equations (PDEs). The methods combine a direct solution approach with model reduction via proper orthogonal decomposition (POD) and the discrete empirical interpolation method (DEIM). The reduced-order models (ROMs) are used to approximate the high-dimensional dynamic systems originating from a spatial discretization of a PDE. However, when used in an optimization algorithm, conventional POD/DEIM ROMs often lack the ability to give adequate approximations of the gradient. We propose methods for a suitable enhancement of the ROMs for the optimization purpose which are based on the inclusion of derivative information in the POD and DEIM subspaces. We distinguish two types of error between quantities evaluated with the high-dimensional model and its ROM approximation in dependency on the optimization variable q: The reconstruction error which is evaluated with the same q0 which is used constructing the ROM and the prediction error which assesses approximations at q with a ROM constructed at q0 different to q. The novel reconstruction results we present include estimates for solutions of the adjoint equation and the sensitivity equations as well as for the gradient of the objective function. Based on the estimates we explain how the POD and DEIM bases should be extended with either adjoint or sensitivity information. The enhanced ROMs allow control of the reconstruction error for the objective and its gradient up to machine precision. Moreover, we propose a POD prediction estimate for the objective of the optimization problem in a neighborhood of q where the ROM is constructed. In case of sensitivity-extended POD and DEIM bases we give an analogous result for solutions of the states. The derivative-extended ROMs are then used to develop adaptive algorithms for the solution of optimal control and parameter estimation problems which results in great runtime improvements for the optimization while ensuring high approximation quality of the solution of the original problem. For the parameter estimation case a novel a posteriori error estimate is proposed which assesses the quality of suboptimal solutions obtained with the ROM. A further fundamental contribution is a discussion of discretize-then-optimize (DTO) vs. optimize-then-discretize (OTD) approaches in the context of MOR for optimization. We analyze advantages and disadvantages of both approaches and discuss to which extent our methods exhibit properties of either strategy. We also give examples of representative optimization problems in which standard POD/DEIM ROMs show an inacceptable behavior and can be successfully solved by derivative-extended ROMs. We have further implemented the developed methods emphasizing an efficient realization which is important for the investigation of the MOR potential. We showcase the practical performance of the proposed algorithms and the superiority of derivative-extended over conventional ROMs on two academic and one industry-relevant application which exhibit a variety of challenges for the model reduction approach in optimization.

The Proper Orthogonal Decomposition (POD) combined with the (Discrete) Empirical Interpolation Method (DEIM) has been successfully used to reduce the computation time of nonlinear Finite Element (FE) problems. The DEIM enables to alleviate the complexity cost of the nonlinear terms. In this communication, the Best Points Interpolation Method (BPIM) is compared with the DEIM in the case of nonlinear magnetostatics.

We propose a generalized CUR (GCUR) decomposition for matrix pairs $(A, B)$. Given matrices $A$ and $B$ with the same number of columns, such a decomposition provides low-rank approximations of both matrices simultaneously, in terms of some of their rows and columns. We obtain the indices for selecting the subset of rows and columns of the original matrices using the discrete empirical interpolation method (DEIM) on the generalized singular vectors. When $B$ is square and nonsingular, there are close connections between the GCUR of $(A, B)$ and the DEIM-induced CUR of $AB^{-1}$. When $B$ is the identity, the GCUR decomposition of $A$ coincides with the DEIM-induced CUR decomposition of $A$. We also show a similar connection between the GCUR of $(A, B)$ and the CUR of $AB^+$ for a nonsquare but full-rank matrix $B$, where $B^+$ denotes the Moore--Penrose pseudoinverse of $B$. While a CUR decomposition acts on one data set, a GCUR factorization jointly decomposes two data sets. The algorithm may be suitable for applications where one is interested in extracting the most discriminative features from one data set relative to another data set. In numerical experiments, we demonstrate the advantages of the new method over the standard CUR approximation; for recovering data perturbed with colored noise and subgroup discovery.

The work studies model reduction method for nonlinear systems based on proper orthogonal decomposition (POD) and discrete empirical interpolation method (DEIM). Instead of using the classical DEIM to directly approximate the nonlinear term of a system, our approach extracts the main part of the nonlinear term with a linear approximation before approximating the residual with the DEIM. We construct the linear term by Taylor series expansion and dynamic mode decomposition (DMD), respectively, so as to obtain a more accurate reconstruction of the nonlinear term. In addition, a novel error prediction model is devised for the POD-DEIM reduced systems by employing neural networks with the aid of error data. The error model is cheaply computable and can be adopted as a remedy model to enhance the reduction accuracy. Finally, numerical experiments are performed on two nonlinear problems to show the performance of the proposed method.

This study aims to develop a linear nonintrusive reduced-order model (NIROM) for facilitating combined fast parametric analysis and reconstruction of unsteady aerodynamic flow variables by using a novel signal interpolation approach, which is combined with a subspace-identification-based method. The NIROM is then applied to airfoil flutter and gust interaction problems where the assumption of linearized dynamics gives reasonably accurate estimates. In the traditional subspace-identification method, the training datasets of force coefficient signals corresponding to each flow parameter (like the Mach number and angle of attack) are required to generate the linear time-invariant system. The generation of the training signal for each flow parameter is the most computationally expensive process in any parametric reduced-order model (ROM). In the present work, the discrete empirical interpolation method (DEIM) combined with the radial basis function (RBF) method is used for the interpolation of training signals at a specific flow parameter to reduce the overall computational cost. The conventional nonintrusive approaches are generally constrained by the number of output channels, and hence not suitable for the reconstruction of unsteady surface force distribution or flowfield variables. A few suitable sensor locations using the DEIM are selected as output channels of the subspace-identification method to realize the full datasets of surface force distribution over the airfoil. Finally, a suitable algorithmic structure is proposed to achieve unsteady distributive flow-variable reconstruction and parametric variation simultaneously. The current signal interpolation-based NIROM is applied to a wing section with two- and four-degree-of-freedom structural motions.

A matrix DEIM technique for model reduction of nonlinear parametrized problems in cardiac mechanics

The present paper proposes a novel non-intrusive model reduction approach based on Proper Orthogonal Decomposition (POD), the Discrete Empirical Interpolation Method (DEIM) and Radial Basis Function (RBF) networks to efficiently predict production of oil and gas reservoirs. Provided a representative set of training reservoir scenarios, either POD or DEIM allows for effectively projecting input parameters (e.g., permeability, porosity), states (e.g., pressure, saturations) and outputs (e.g., well production curves) into a much lower dimension that retains the main features contained in the simulation system. In this work, these projections are applied across multiple levels to be able to collapse a large number of spatio-temporal correlations. It is observed that these projections can be effectively performed at a large extent regardless of the underlying geological complexity and operational constraints associated with the reservoir model. The RBF network provides a powerful means for developing learning functions from input-output relationships described by the reservoir dynamics entailed by multiple combinations of inputs and controls. In order to achieve a high degree of predictability from the resulting reduced model, the RBF network exploits locality by a means of Gaussian basis functions that are maximal at the sampled point and decrease monotonically with distance. Compared to multilayer perceptron networks (i.e., traditional artificial neural networks) RBF networks require less training and are less sensitive to the presence of noise in the data. In this regard, POD or DEIM acts as a data filter that additionally aids at designing a more compact RBF network representation suitable for targeting fast reservoir predictions. Numerical results show significant accelerations with respect to running the original simulation model on a set of field-motivated cases.

The design of commercial air transportation vehicles heavily relies on understanding and modeling fluid flows, which pose computational challenges due to their complexity and high degrees of freedom. To overcome these challenges, we propose a novel approach based on machine learning (ML) to construct reduced-order models (ROMs) using an autoencoder neural network coupled with a discrete empirical interpolation method (DEIM). This methodology combines the interpolation of nonlinear functions identified based on selected interpolation points using DEIM with an ML-based clustering algorithm that provides accurate predictions by spanning a low-dimensional subspace at a significantly lower computational cost. In this study, we demonstrate the effectiveness of our approach by the calculation of transonic flows over the National Advisory Committee of Aeronautics 0012 airfoil and the National Aeronautics and Space Administration Common Research Model wing. All the results confirm that the ROM captures high-dimensional parameter variations efficiently and accurately in transonic regimes, in which the nonlinearities are induced by shock waves, demonstrating the feasibility of the ROM for nonlinear aerodynamics problems with varying flow conditions.

The proper orthogonal decomposition (POD) is an efficient model order reduction method, which is frequently coupled with the discrete empirical interpolation method (DEIM) to solve nonlinear electromagnetic problems. A drawback of this method is that instabilities can occur related to the reduction operator of the nonlinear part. In this contribution, different DEIMs and the Gappy POD are employed and analyzed. Consecutively, the methods are employed to efficiently estimate the behavior of a permanent magnet synchronous machine in terms of global quantities, such as torque and iron losses.

The objective of this paper is to reduce the computational effort in reservoir flooding optimization problems by a combination of different optimization parametrization methods and model order reduction techniques. We compare three different parametrization methods that reduce the cardinality of the original infinite set of control-decision variables to a finite set. The three methods include a traditional piece-wise constant (PWC) approximation, a polynomial approximation by Chebyshev orthogonal polynomials and a piece-wise polynomial approximation by cubic Spline interpolation. The Proper Orthogonal Decomposition with Discrete Empirical Interpolation Method (POD-DEIM) accomplishes the reduced order modeling (ROM).. We compare a gradient-free global stochastic search approach and a gradient-based local search approach. We used Particle Swarm Optimization (PSO) as a gradient-free algorithm and Interior-Point Optimization (IPOPT) with L-BFGS method as a gradient-based algorithm. First, we compare the performances of the three parametrization methods solved by each optimizer, using fine scale simulations for an increasing level of parametrization refinement. Then, in the second part of this paper, we combine the parametrization methods with the reduced modeling workflow. For a given level of parametrization refinement, we compare the performance of each parametrization method coupled with POD-DEIM, and solved by each optimizer. In this part, we introduce an online training procedure, where the first optimization iteration is used to construct the snapshot matrix. The results demonstrate how refining the control approximation with more decision variables per well lead to better NPV values, but with a higher computational cost. The best NPV was achieved using the highest refining level with Chebyshev polynomial approximation. Both polynomial and piece-wise polynomial approximations served as better training sets for POD-DEIM leading to a more accurate and fast reduced model. With the strategy proposed, POD-DEIM showed the best optimization accuracy for Chebyshev polynomial with the gradient-free optimizer, thus permitting the use of the model reduction methodology for global-stochastic search methods. However, the gradient-based approach seems to consistently outperform the gradient-free approach in terms of NPV and number of iterations for the cases shown.

During lamination, residual thermo-mechanical stresses are induced in the encapsulated solar cells composing photovoltaic (PV) modules. Depending on the material and geometrical configuration of the layers of the laminate, this residual stress field can be beneficial since it may lead to a compressive stress state in Silicon and therefore crack closure effects in the presence of cracks, with a recovery of electrical conductivity in cracked solar cells. It is therefore important to investigate the distribution of thermo-mechanical stresses within the PV laminate with a view to optimizing the coupling between the electrical response and elastic deformation in the operation of PV modules. A promising approach proposed in the present thesis regards the prediction of residual stresses in composite laminates by using a shear-lag theory to model the epoxy-vinil-acetate polymeric layers, accounting for their thermo-visco-elastic response. Moreover, it will be shown that thermomechanical formulations for stress analysis of a PV laminate lead to a system of higher order ordinary differential equations or partial differential equations in which the exact solutions may be impossible to be determined in closed form and hence numerical schemes become desirable. However, the computational cost associated with the implementation of the numerical scheme may be significantly expensive. Therefore, a method to reduce the computational complexity is expected to be very important. To this aim, Model Order Reduction (MOR) techniques are applied hierarchically, first to the thermal system of a PV module in service, and then extended to coupled thermo-mechanical problems. A combination of proper orthogonal decomposition (POD) and discrete empirical interpolation method (DEIM) with a modified formulation is proposed for the first-order thermal equations of photovoltaic system during service and a new coupled second-order Krylov based formulation is developed for model order reduction of the coupled thermo-mechanical model of the photovoltaic module. The results of these reduction schemes show a huge computational gain in the reduced system solutions and a high accuracy of the reduced system outputs

Dynamical low-rank approximation allows for solving large-scale matrix differential equations (MDEs) with significantly fewer degrees of freedom and has been applied to a growing number of applications. However, most existing techniques rely on explicit time integration schemes. In this work, we introduce a cost-effective Newton’s method for the implicit time integration of stiff, nonlinear MDEs on low-rank matrix manifolds. Our methodology is focused on MDEs resulting from the discretization of random partial differential equations (PDEs), where the columns of the MDE can be solved independently. Cost-effectiveness is achieved by solving the MDE at the minimum number of entries required for a rank- r approximation. We present a novel cross low-rank approximation that requires solving the parametric PDE at r strategically selected parameters and O ( r ) grid points using Newton’s method. The selected random samples and grid points adaptively vary over time and are chosen using the discrete empirical interpolation method or similar techniques. The proposed methodology is developed for high-order implicit multi-step and Runge–Kutta schemes and incorporates rank adaptivity, allowing for dynamic rank adjustment over time to control error. Several analytical and PDE examples, including the stochastic Burgers’ and Gray–Scott equations, demonstrate the accuracy and efficiency of the presented methodology.

The proper orthogonal decomposition (POD) and the discrete empirical interpolation method (DEIM) are applied to coupled Burgers equations to develop its reduced-order model (ROM) by the Galerkin projection. A calibrated POD ROM is developed in the current study through adding and multiplying a set of time-dependent random parameters to recover the loss of accuracy due to the truncation of the POD modes. Calibrating the ROM becomes essentially a high-dimensional statistical inverse inference problem. To reduce the computational effort, the polynomial chaos based ensemble Kalman filter (PC-EnKF) is adopted in this work. By using a sparse optimization algorithm, a sparse PC expansion is obtained to facilitate further calculation of statistical moments used in ensemble Kalman filter. We apply the well-defined calibrated POD ROM for the coupled Burgers equations with the Reynolds numberRe= 10 000. The numerical results show that the PC-EnKF method is efficient in reducing the uncertainty included in the initial guess of input parameters and feasible in correcting the behavior of the POD ROM. The study suggests that the PC-EnKF is quite general as a calibration tool for calibrating the POD ROM.

This paper derives state space error bounds for the solutions of reduced systems constructed using proper orthogonal decomposition (POD) together with the discrete empirical interpolation method (DEIM) recently developed for nonlinear dynamical systems [SIAM J. Sci. Comput., 32 (2010), pp. 2737–2764]. The resulting error estimates are shown to be proportional to the sums of the singular values corresponding to neglected POD basis vectors both in Galerkin projection of the reduced system and in the DEIM approximation of the nonlinear term. The analysis is particularly relevant to ODE systems arising from spatial discretizations of parabolic PDEs. The derivation clearly identifies where the parabolicity is crucial. It also explains how the DEIM approximation error involving the nonlinear term comes into play.

We describe an equation-free control framework for the regulation of dissipative distributed parameter systems, with emphasis on improving the accuracy of the estimation by using a correction term. This control method is capable of regulating systems that have unknown dynamics but known effect of the control action. The system state and the dynamics are estimated by using the offline observations (snapshots ensemble) and the online continuous measurement of a restricted number of point sensors. First, we construct a reduced order model (ROM) with unknown terms using Galerkin/proper orthogonal decomposition (POD). Then the state of the ROM is estimated by a static observer with the information from the state sensors, and the mapping between the dynamics of the system and velocity sensors are generated using a similar approach. A discrete empirical interpolation method (DEIM) is employed to determine the sensor locations. To improve the accuracy of the estimation, a correction term is updated consistently. The proposed equation-free control framework is illustrated through a diffusion-reaction process and the performance of the proposed method is evaluated by simulation.