Monte Carlo Linear System Solver using MapReduce

Subject. This article focuses on the problems of solving systems of homogeneous linear algebraic equations in the pricing problems of an alternative financial model. Objectives. The article aims to develop a non-trivial approach to solving the problem of pricing from the scratch in the construction of a national alternative financial model, which boils down to solving large homogeneous systems of linear algebraic equations, complicated by the fuzzy setting of initial parameters (initial data) within the framework of creating a State model of a socially oriented economy, guaranteed to ensure economic, military and other types of integrated security of the Russian Federation. Methods. For the study, we used tensorial notations involving the use of elements of linear algebra, including operations with matrices and vectors, the apparatus of the fuzzy set theory (interval arithmetic), as well as methods and principles of scientific research and complex logical analysis and modeling of pricing and technological processes. Results. The article shows that an effective non-zero (different from zero, i.e. classical, trivial) solution of systems of homogeneous algebraic equations in pricing problems of an alternative financial model from the scratch is possible if the initial parameters are specified by fuzzy sets, which significantly simplifies the procedure of the computational process and the volume of arithmetic operations. Conclusions. The results obtained can be used in structures involved in the creation and testing of financial and economic models both at the federal and the Russian Federation constituent entity levels, as well as in governmental and non-governmental organizations dealing with the issues of pricing, planning and logistics support for business entities not only in the Russian Federation, but also in other countries experiencing problems in the field of financing.

Conjugate Gradient (CG) method is an iterative linear solver which is used by many scientific and engineering applications to solve a linear system of algebraic equations. CG generates a heavy load of computation and therefore it slows the performance of the applications using it. Parallelizing CG is considered as a way to increase its performance. However, CG suffers from communication dependencies among its divisible loads. Most of the studies to parallelize CG concentrate on parallelizing its matrix-vector multiplication. In this paper, we answer the following questions: 1) what are the divisible loads in the CG, and 2) where is communication involved in the parallel CG. To answer 1), we highlight the different divisible data blocks in CG. To answer 2), we introduce a dependency graph among the different data blocks. We conduct experiments on a parallel CG implementation and evaluate communication cost.

This work presents a parallel implementation of the Parareal method using Portable Extensible Toolkit for Scientific Computation (PETSc). An optimal control problem of a parabolic partial differential equation with known boundary conditions and initial state is solved, where the minimized cost function relates the controller v usage and the approximation of the solution y to an optimal known function y*, measured by ∥y∥ and ∥y*∥, respectively. The equations that model the process are discretized in space using Finite Elements and in time using Finite Differences. After the discretizations, the problem is transformed to a large linear system of algebraic equations, that is solved by the Conjugate Gradient method. A Parareal preconditioner is implemented to speed up the convergence of the Conjugate Gradient. The main advantage in using the Parareal approach is to speed up the resolution time, when comparing to implementations that use only the Conjugate Gradient or GMRES methods. The implementation developed in this work offers a parallelization relative efficiency for the strong scaling of approximately 70% each time the process count doubles. For weak scaling, 75% each time the process count doubles for a constant solution size per process and 96% each time the process count doubles for a constant data size per process.

In this research paper a new modification of Gauss-Seidel method has been presented for solving the system of linear algebraic equations. The systems of linear algebraic equations have an important role in the field of science and engineering. This modification has been developed by using the procedure of Gauss-Seidel method and the concept of substitution techniques. Developed modification of Gauss-Seidel method is a fast convergent as compared to Gauss Jacobi’s method, Gauss-Seidel method and successive over-relaxation (SOR) method. It works on the diagonally dominant as well as positive definite symmetric systems of linear algebraic equations. Its solution has been compared with the Gauss Jacobi’s method, Gauss-Seidel method and Successive over-Relaxation method by taking different systems of linear algebraic equations and found that, it was reducing to the number of iterations and errors in each problem.

There are no strict rules for the numerical treatment of partial differential equations. We concentrate here on linear partial differential equations. As an example of elliptic partial differential equations the two-dimensional Poisson equation with Dirichlet boundary conditions is investigated. The application of the finite difference approximation transforms this equation into a set of algebraic equations which can be solved iteratively. The time dependent heat equation is an example of parabolic partial differential equations. The one-dimensional Dirichlet boundary value problem is transformed using the implicit and explicit Euler method into an inhomogeneous system of linear algebraic equations. Stability problems of the explicit Euler method are discussed and demonstrated numerically. The wave equation is a model for hyperbolic partial differential equations. It can be transformed into a system of algebraic equations using, for instance, the explicit Euler method. Again, stability problems connected with this method are discussed and demonstrated numerically. Finally, the quantum mechanical tunneling effect is studied numerically by solving the time dependent Schrodinger equation by means of a Crank-Nicholson scheme which transforms the Schrodinger equation into a system of linear algebraic equations with tridiagonal matrix.

The numerical solution of integral equations or a system of integral equations (for a system of conductors) consists in their discretization and reduction to a system of linear algebraic equations for the desired function. For discretization, it is possible to use projection methods, for example, the Galerkin method or the collocation method. A system of linear algebraic equations for the class of problems under consideration is characterized by a complete (filled) complex matrix. For conductor antenna structures that are quite arbitrary in geometry and size, systems of linear algebraic equations turn out to be of a high order, and special computational algorithms are required to solve them. The purpose of the work is to study adequate mathematical models for wire antennas with a subsequent description of uniform numerical algorithms based on methods of sampling and approximation of antenna current. With this method, the error in solving integral equations is determined by the error in calculating the elements of the matrix of a system of linear algebraic equations for a given piecewise polynomial approximation of the solution at step h. If the quadrature formula for numerical integration is chosen, then there are two ways to reduce the solution error. An increase in the number of collocation points leads to a rapid increase in the volume of calculations and, consequently, to a rapid increase in the amount of occupied computer memory. Therefore, the question arises of choosing the most profitable method of piecewise polynomial interpolation and discretization step h from the point of view of using computer resources, ensuring an acceptable number of solutions.

Iterative refinement of solution with biparameter for solving ill-conditioned systems of linear algebraic equations

A new technique for solving the large system of linear algebraic equations associated with implicit differencing of multidimensio nal partial differential equations is presented. The coefficient matrix of the equations is factored, and then approximations to certain terms in the matrix are obtained from series expansions. The resulting system of equations is solved easily. The method is developed and demonstrated using a simple representative two-dimensional equation. Very good results are obtained when one direction is dominant. MPLICIT finite-difference schemes for the solution of multidimensional partial differential equations are usually stable and therefore applicable to a large class of problems. However, they are difficult to implement and may require an excessive amount of computer storage and time. The long computing time arises from the need to solve the large system of linear algebraic equations that result from the differencing. The computing time can be reduced significantly by approximating the coefficient matrix of the linear equations with a matrix that produces a system of equations that are relatively easy to solve. Among such methods are the alternating direction method (ADI)l used by Beam and Warming2 and Stone's strongly implicit method,3 which has been tested by Linetal.4 In this paper, a new technique for solving the large system of linear algebraic equations associated with implict differencing of multidimensional partial differential equations is presented. This method, called the pseudo-elimination method (PE), is shown to be faster than Stone's method for certain problems. The method is directly applicable to linear and linearized nonlinear systems of parabolic or elliptic partial differential equations. In order to discuss the method, a simple linear partial differential equation will be used; however, it should be kept in mind that the PE method is applicable to much more complicated problems. The question of whether the method will work when applied to difficult problems is not addressed. The scope of this paper is limited to presenting the method and illustrating, via a simple problem, that the method has some merit and deserves further study.

The article deals with high-performance information technology (HPC) for the problems of stress-strain analysis at all stages of the life cycle of buildings and structures: construction, operation and reconstruction. The results of numerical simulation of high buildings using software as a processor component based on a new hybrid algorithm for solving systems of linear algebraic equations [1] with a symmetric positive-definite matrix that combines computation on multi-core processors and graphs. It has been found that to accelerate the calculations, hybrid systems that combine multi-core CPUs with accelerator coprocessors, including GPUs, are promising [5]. To test the effectiveness of the proposed parallel algorithm for solving systems of linear algebraic equations [1], numerical experiments were carried out at the most dangerous loads of a 27-story building. Results of numerical researches with use for preprocessor (input of initial data) and postprocessor (output of results of calculations) of processing of the LIRA-SAPR software complex are presented [2, 4, 6]. The results of numerical studies of the behavior of structures of high buildings have shown a multiple reduction in the time of solving systems of linear algebraic equations with symmetric matrices on multiprocessor (multi-core) computers with graphical accelerators using the proposed hybrid algorithms [1]. High-performance technologies based on parallel calculations give more effect than more complex processes: modeling of life cycle of high buildings, bridges, especially complex structures of NPPs, etc. for static and dynamic loads, including emergencies in normal and difficult geological conditions, which make up 70% of Ukraine's territories.

With the wider use of vector-processing computers, much attention has come to be paid to the conjugate gradient method to solve a linear system of algebraic equations. However, in the case of finite element methods, it is rather difficult to tune up the computer program of the conjugate gradient method so as to make a big reduction in CPU time, because a coefficient matrix appearing in the finite element analysis is sparse and the nonzero components are irregularly located. In this paper, we present a vectorization technique for the conjugate gradient method by using element matrices only. The loop length attained by the present technique is as long as the number of elements and the rate of acceleration is very high.

Fast parallel solvers for fourth-order boundary value problems

Conventional conditioning criteria are shown to be invalid for estimating the accuracy of a numerical calculation for systems of linear algebraic equations. A new conditioning criterion is proposed, quantitatively describing the actual loss of decimal digits in calculations. The adequacy of this criterion is confirmed by examples of numerical calculations. Conditioning criteria have been obtained for some types of linear systems arising in important applied problems, in particular, in the difference solution of differential or integral equations.

The preconditioned conjugate gradient method for solving the system of linear algebraic equations with a positive definite matrix is investigated. The initial approximation for conjugate gradient is constructed as a result of a matrix iteration method after $m$ steps. The behaviour of the error vector for such a combined method is studied and special numerical tests and conclusions are made.

The possibility of application of the interval analysis for data processing in the field of spectral analysis is considered. It is assumed that the data have interval uncertainty; therefore the problem of finding unknown concentrations is posed as a linear interval tolerance problem. The incompatibility of the interval system of linear algebraic equations is shown for the initial data using the apparatus of the recognizing functional. The relevance of the topic is due to the need for regularization of inconsistent interval systems of linear equations. The idea of S. P. Shary of a combined method for correcting a linear tolerance problem has been implemented. A new method for managing the solution by changing the linear algebraic equations interval system matrix elements radii has been developed. The research results can be used for example, to calculate the substance’s concentrations by measurement of the characteristic X-ray radiation.

Chapter 7 Preconditioned Iterative Methods for Nonselfadjoint or Indefinite Elliptic Boundary Value Problems