Inner product preconditioned trust-region methods for frequency-domain full waveform inversion

A good starting model is imperative in full-waveform inversion (FWI) because it solves a least-squares inversion problem using a local gradient-based optimization method. A suboptimal starting model can result in cycle skipping leading to poor convergence and incorrect estimation of subsurface properties. This problem is especially crucial for salt models because the strong velocity contrasts create substantial time shifts in the modeled seismogram. Incorrect estimation of salt bodies leads to velocity inaccuracies in the sediments because the least-squares gradient aims to reduce traveltime differences without considering the sharp velocity jump between sediments and salt. We have developed a technique to estimate velocity models containing salt bodies using a combination of global and local optimization techniques. To stabilize the global optimization algorithm and keep it computationally tractable, we reduce the number of model parameters by using sparse parameterization formulations. The sparse formulation represents sediments using a set of interfaces and velocities across them, whereas a set of ellipses represents the salt body. We use very fast simulated annealing (VFSA) to minimize the misfit between the observed and synthetic data and estimate an optimal model in the sparsely parameterized space. The VFSA inverted model is then used as a starting model in FWI in which the sediments and salt body are updated in the least-squares sense. We partition model updates into sediment and salt updates in which the sediments are updated like conventional FWI, whereas the shape of the salt is updated by taking the zero crossing of an evolving level set surface. Our algorithm is tested on two 2D synthetic salt models, namely, the Sigsbee 2A model and a modified SEG Advanced Modeling Program (SEAM) Phase I model while fixing the top of the salt. We determine the efficiency of the VFSA inversion and imaging improvements from the level set FWI approach and evaluate a few sources of uncertainty in the estimation of salt shapes.

This study investigates the effectiveness and the applicability of full waveform inversion (FWI) method to estimate underwater sound velocity structures. We use a frequency domain full waveform inversion method in this study. We use an adjoint-state method for the calculation of the gradient in an iterative inversion based on a preconditioned conjugate gradient method. We first apply the FWI method to a synthetic dataset that is simulated for a sound velocity structure. The results of our inversion are then compared with those from a conventional ray-based traveltime inversion (TTI) method to evaluate the effectiveness of the method. The results show that the full waveform inversion method could provide more precise image with higher resolution than the ray-based method. The FWI method is also applied to a field dataset acquired by a vertical-cable-seismic (VCS) data acquisition experiment in Lake Biwa. In spite of very limited raypath condition using only direct arrival wave, the full waveform inversion method could reproduce a horizontally stratified velocity structure whose vertical profile showed the existence of a seasonal thermocline in the lake that was to be confirmed by temperature measurements after the VCS experiment. We conclude that the FWI method could be the key success factor for the higher resolution at estimation of underwater sound velocity structure.

The trust region (TR) method is an effective algorithm for image reconstruction of electrical impedance tomography (EIT). Aiming at the drawback of the traditional TR method, an improved method named the nonmonotonic and self-adaptive trust region (NSTR) method is proposed in this paper, in which three kinds of modified techniques are shown that help in improving the computational precision and convergence speed of the algorithm. The comparisons with image reconstruction are carried out between the NSTR, Levenberd–Marquardt (LM) and TR methods. Simulation experiment results indicate that for both the LM and TR methods it is difficult to accurately reconstruct concave and multiple boundaries. However the NSTR method cannot only realize accurate reconstruction, but also provide faster convergence speed. A noise simulation test is carried out and results show that the NSTR method also has strong stability in image reconstruction for EIT. This new method presents a feasible and effective way to research on image reconstruction for EIT.

Traditional full-waveform inversion (FWI) methods only render a “best-fit” model that cannot account for uncertainties of the ill-posed inverse problem. Additionally, local optimization-based FWI methods cannot always converge to a geologically meaningful solution unless the inversion starts with an accurate background model. We seek the solution for FWI in the Bayesian inference framework to address those two issues. In Bayesian inference, the model space is directly probed by sampling methods such that we obtain a reliable uncertainty appraisal, determine optimal models, and avoid entrapment in a small local region of the model space. The solution of such a statistical inverse method is completely described by the posterior distribution, which quantifies the distributions for parameters and inversion uncertainties. To efficiently sample the posterior distribution, we introduce a sampling algorithm in which the proposal distribution is constructed by the local gradient and the diagonal approximate Hessian of the local log posterior. Our algorithm is called the gradient-based Markov chain Monte Carlo (GMCMC) method. The GMCMC FWI method can quantify inversion uncertainties with estimated posterior distribution given sufficiently long Markov chains. By directly sampling the posterior distribution, we obtain a global view of the model space. Theoretically speaking, statistical assessments do not depend on starting models. Our method is applied to the 2D Marmousi model with the frequency-domain FWI setting. Numerical results suggest that our method can be readily applied to 2D cases with affordable computational efforts.

Full waveform inversion using a decomposed single frequency component from a spectrogram

*† ‡ § An efficient and high-fidelity design approach is proposed by combining global and local optimization methods for wing planform and surface design. For enhanced design results, aerodynamic shape optimization process is carried out via 2-stage with different optimization strategy. In the first stage, global optimization techniques are applied to planform design with a few geometric design variables. In the second stage, local optimization techniques are used for wing surface design with a lot of design variables to maintain a sufficient design space with high DOF (Degree of Freedom) geometric change. For global optimization, meta-modeling techniques such as RS (Response Surface) and Kriging methods are used in conjunction with Genetic Algorithm (GA). For local optimization, a discrete adjoint variable method is used. By the successive combination of global and local optimization techniques, drag minimization is performed for a multi-body aircraft configuration while maintaining the baseline lift and the wing weight at the same time. Through the design process, performances of the test models are remarkably improved in comparison with the single stage design approach. The capability of proposed design framework including wing planform design variables can be evaluated by the drag decomposition method which can provide improvement of induced drag and wave drag, respectively.

Ultrasound computed tomography (UCT) is considered to have great potential for the early diagnosis of knee joint injuries. Combining prior knowledge and sound speeds of tissues, UCT can diagnose a variety of symptoms and the extent of tissue lesion. However, no existing studies can reconstruct the sound speed distributions of knee joints in UCT. Therefore, in this study, sound speed distributions of knee joints are reconstructed to provide an imaging basis for the formulation of a treatment plan. In addition, Full waveform inversion (FWI) methods are utilized to estimate highresolution images. However, for media with large variations in sound speeds, traditional FWI methods may lead to a cycle-skipping phenomenon and incorrect convergence direction. Hence, this study proposes a multi-centerfrequency source based FWI method to overcome the above limitations. A penalized least-squares optimization problem is constructed to obtain a numerical solution of the sound speed distribution. Computer simulations are conducted to prove the effectiveness and robustness of the proposed method. Furthermore, the reasons for selecting the center frequencies of sources are analyzed. Two numerical knee joint phantoms are used to evaluate the performance. The results suggest that the biases of the reconstructed images are less than 1% under a 5% noise condition.

Since the Industrial Revolution in the 1700s, the high emission of gaseous wastes into the atmosphere from the usage of fossil fuels has caused a general increase in temperatures globally. To combat the environmental imbalance, there is an increase in the demand for renewable energy sources. Dams play a major role in the generation of “green" energy. However, these structures require frequent and strict monitoring to ensure safe and efficient operation. To tackle the challenges faced in the application of convention dam monitoring techniques, this work proposes the inverse analysis of numerical models to identify damaged regions in the dam. Using a dynamic coupled hydro-mechanical Extended Finite Element Method (XFEM) model and a global optimization strategy, damage (crack) in the dam is identified. By employing seismic waves to probe the dam structure, a more detailed information on the distribution of heterogeneous materials and damaged regions are obtained by the application of the Full Waveform Inversion (FWI) method. The FWI is based on a local optimization strategy and thus it is highly dependent on the starting model. A variety of data acquisition setups are investigated, and an optimal setup is proposed. The effect of different starting models and noise in the measured data on the damage identification is considered. Combining the non-dependence of a starting model of the global optimization strategy based dynamic coupled hydro-mechanical XFEM method and the detailed output of the local optimization strategy based FWI method, an enhanced Full Waveform Inversion is proposed for the structural analysis of dams.

The quantitative reconstruction of subsurface earth properties from the propagation of waves follows an iterative minimization of a misfit functional. In marine seismic exploration, the observed data usually consist of measurements of the pressure field, but dual-sensor devices also provide the normal velocity. Consequently, a reciprocity-based misfit functional is specifically designed, and it defines the full reciprocity-gap waveform inversion (FRgWI) method. This misfit functional provides additional features compared to the more traditional least-squares approaches, in particular, in that the observational and computational acquisitions can be different. Therefore, the positions and wavelets of the sources from which the measurements are acquired are not needed in the reconstruction procedure and, in fact, the numerical acquisition (for the simulations) can be chosen arbitrarily. Based on 3D experiments, FRgWI is shown to behave better than full-waveform inversion in the same context. It allows for arbitrary numerical acquisitions in two ways: when few measurements are given, a dense numerical acquisition (compared to the observational one) can be used to compensate. However, with a dense observational acquisition, a sparse computational one is shown to be sufficient, for instance, with multiple-point sources, hence reducing the numerical cost. FRgWI displays accurate reconstructions in both situations and appears more robust with respect to crosstalk than least-squares shot stacking.

Summary We suggest a new method for the Laplace domain full waveform inversion (FWI) which use single damping constant. This method makes the Laplace domain FWI more efficient, because the proposed method uses only one damping constant during inversion process. To scale the gradient direction properly, we use simple depth window function to steepest descent direction. We demonstrate that the algorithm is working by numerical test using synthetic data set.

SUMMARY Full waveform inversion (FWI) is a high-precision subsurface imaging technique that inverts subsurface parameter models by minimizing the discrepancy between observed and synthetic seismic data. However, complicated wave propagation mechanisms, non-convexity of the loss function and limited seismic acquisition system necessitate the incorporation of sufficient prior and physical constraints to alleviate the ill-posedness and cycle-skipping. Although the implicit FWI (IFWI) can encode implicit spectral bias (i.e. inverting model parameters from low frequencies to high frequencies) to reduce the dependence on an accurate initial model, its limited high-frequency inversion capability results in thousands of iterations for the final results. In this paper, we indicate that the frequency hyperparameters of the sine activation function in IFWI modulate the spectral bias, making a trade-off between inversion accuracy and stability, that is, lower frequencies yield robust FWI but lower accuracy, while higher frequencies achieve higher accuracy on the premise of an accurate initial model. To improve both the stability and accuracy of IFWI, we propose a novel implicit FWI method with an adaptive Fourier reparametrization strategy (termed FR-IFWI), which explicitly encodes multifrequency information by reparametrizing the network weights using a learnable coefficient matrix and fixed Fourier frequency bases. The role of learnable matrices in neural networks can evolve from determining frequencies in IFWI to actively selecting frequencies from fixed frequency bases through FR-IFWI, which alleviates the dependence on activation function frequency and obtains more robust and accurate inversion results. Extensive numerical experiments on the modified Marmousi, 2-D SEG/EAGE Salt and Overthrust models confirm that FR-IFWI successfully achieves superior inversion efficiency and accuracy compared with conventional FWI and IFWI methods.

Full waveform inversion (FWI) is a method for building subsurface models with high resolution by optimizing a data-fitting problem. However, it is still a challenge to apply the FWI method to complicated subsurface models, because FWI is a highly ill-fitting inversion problem. When the simulated data differ from the observed data by more than half a cycle, FWI tends to suffer from the cycle-skipping problems and get trapped in a local minimum. To help the inversion to converge to the accurate subsurface model, we typically build a reasonable initial model or use low-frequency data to start our inversion. Here, we developed a novel technique called smoothing of dilated convolutions inversion (SDCI) to generate low-frequency components from seismic data to recover low-wavenumber components of the subsurface. In the theory part, we first present the objective function of the SDCI method and then derive the gradient of the objective function relative to the velocity using the adjoint-state approach. We then apply the method to a set of simulated data from the Marmousi model. The SDCI method can reasonably estimate the subsurface model even if the simulated seismic record does not contain information below 5 Hz. The numerical examples prove the effectiveness and feasibility of the proposed method. From the SDCI results, the FWI method recovers the velocity with higher accuracy and resolution.

Full waveform inversion (FWI) is a powerful method for reconstructing subsurface parameters from local measurements of the seismic wavefield. This method consists in minimizing the distance between predicted and recorded data. The predicted data are computed as the solution of a wave-propagation problem. Conventional numerical methods for the resolution of FWI problems are gradient-based methods, such as the preconditioned steepest descent, or more recently the $l$-BFGS quasi-Newton algorithm. In this study, we investigate the desirability of applying a truncated Newton method to FWI. The inverse Hessian operator plays a crucial role in the parameter reconstruction. The truncated Newton method allows one to better account for this operator. This method is based on the computation of the Newton descent direction by solving the corresponding linear system through an iterative procedure such as the conjugate gradient method. The large-scale nature of FWI problems requires us, however, to carefully implement this method to avoid prohibitive computational costs. First, this requires working in a matrix-free formalism and the capability of computing efficiently Hessian-vector products. To this purpose, we propose general second-order adjoint state formulas. Second, special attention must be paid to define the stopping criterion for the inner linear iterations associated with the computation of the Newton descent direction. We propose several possibilities and establish a theoretical link between the Steihaug--Toint method, based on trust regions, and the Eisenstat and Walker stopping criterion, designed for a method globalized by linesearch. We investigate the application of the truncated Newton method to two test cases: The first is a standard test case in seismic imaging based on the Marmousi II model. The second one is inspired by a near-surface imaging problem for the reconstruction of high-velocity structures. In the latter case, we demonstrate that the presence of large amplitude multiscattered waves prevents standard methods from converging while the truncated Newton method provides more reliable results.

Inspired by the large number of applications for symmetric nonlinear equations, an improved full waveform inversion algorithm is proposed in this paper in order to quantitatively measure the bone density and realize the early diagnosis of osteoporosis. The isotropic elastic wave equation is used to simulate ultrasonic propagation between bone and soft tissue, and the Gauss–Newton algorithm based on symmetric nonlinear equations is applied to solve the optimal solution in the inversion. In addition, the authors use several strategies including the frequency-grid multiscale method, the envelope inversion and the new joint velocity–density inversion to improve the result of conventional full-waveform inversion method. The effects of various inversion settings are also tested to find a balanced way of keeping good accuracy and high computational efficiency. Numerical inversion experiments showed that the improved full waveform inversion (FWI) method proposed in this paper shows superior inversion results as it can detect small velocity–density changes in bones, and the relative error of the numerical model is within 10%. This method can also avoid interference from small amounts of noise and satisfy the high precision requirements for quantitative ultrasound measurements of bone.

Full Waveform Inversion (FWI) is a seismic imaging technique that utilizes the entire content of seismic trace. This method aims to minimizes differences between real and synthetic seismograms. FWI consists of three main steps: forward modelling to simulate synthetic seismograms, adjoint simulation to calculate the gradient misfit, and optimization to obtain an appropriate model perturbation. FWI is an extremely non-linear inversion technique and computationally intensive since it involves many model parameters. In the context of geophysics, finding parameter models that describe the structure of the earth’s subsurface is the main goal. Geophysical measurements in the field only obtain data that is influenced by the parameter model, in this case seismic recording data, therefore mathematical techniques are studied and applied to determine the correct parameter model from the data obtained, also known as the inversion process. In this study, main research area is on optimization step which include mathematical approach to find perturbation model effectively. The Newton method can be used in the optimization step of FWI. However, its implementation is not promising due to high computational cost in calculating Hessian matrix. To reduce computation cost, an identity matrix is chosen to replace the Hessian matrix, as it usually done in the steepest descent method. Since FWI has a high level of non-linearity, steepest descent method requires many iterations to minimize the objective function. Therefore, this study uses a conjugate gradient method to make the data misfit minimized more quickly. Apart from that, the Line search technique is used to find an appropriate step-length at each iteration on both methods. The FWI workflow is applied to the synthetic acoustic velocity model. We conduct FWI using steepest descent and conjugate gradient methods. The results show that the conjugate gradient method requires fewer iterations than the steepest descent method to minimize the objective function. FWI model result using conjugate gradient method is closer with the true model compared to steepest descent method, showed on misfit result and model image. By comparing these methods we can see that conjugate gradient method can be chosen for application on FWI optimization step for better result on seismic imaging. On the industry scale, better results provide less uncertainty on the model parameters that useful for energy exploration or engineering.