Assimilating SAR and Optical Remote Sensing Data into WOFOST Model for Improving Winter Wheat Yield Estimation

Crop yield estimation at a regional scale over a long period of time is of great significance to food security. In past decades, the integration of remote sensing observations and crop growth models has been recognized as a promising approach for crop growth monitoring and yield estimation. Optical remote sensing data are susceptible to cloud and rain, while synthetic aperture radar (SAR) can penetrate through clouds and has all-weather capabilities. This allows for more reliable and consistent crop monitoring and yield estimation in terms of radar sensor data. The aim of this study is to improve the accuracy for winter wheat yield estimation by assimilating time series soil moisture images, which are retrieved by a water cloud model using SAR and optical data as input, into the crop model. In this study, SAR images were acquired by C-band SAR sensors boarded on Sentinel-1 satellites and optical images were obtained from a Sentinel-2 multi-spectral instrument (MSI) for Hengshui city of Hebei province in China. Remote sensing data and ground data were all collected during the main growing season of winter wheat. Both the normalized difference vegetation index (NDVI), derived from Sentinel-2, and backscattering coefficients and polarimetric indicators, computed from Sentinel-1, were used in the water cloud model to derive time series soil moisture (SM) images. To improve the prediction of crop yields at the field scale, we incorporated remotely sensed soil moisture into the World Food Studies (WOFOST) model using the Ensemble Kalman Filter (EnKF) algorithm. In general, the trend of soil moisture inversion was consistent with the ground measurements, with the coefficient of determination (R2) equal to 0.45, 0.53, and 0.49, respectively, and RMSE was 9.16%, 7.43%, and 8.53%, respectively, for three observation dates. The winter wheat yield estimation results showed that the assimilation of remotely sensed soil moisture improved the correlation of observed and simulated yields (R2 = 0.35; RMSE =934 kg/ha) compared to the situation without data assimilation (R2 = 0.21; RMSE = 1330 kg/ha). Consequently, the results of this study demonstrated the potential and usefulness of assimilating SM retrieved from both Sentinel-1 C-band SAR and Sentinel-2 MSI optical remote sensing data into WOFOST model for winter wheat yield estimation and could also provide a reference for crop yield estimation with data assimilation for other crop types.

Today, the most popular approaches in agricultural forecasting leverage process-based crop models, crop monitoring data, and/or remote sensing imagery. Individually, each of these tools has its own unique advantages but is, nonetheless, limited in prediction accuracy, precision, or both. In this study we integrate in situ and remote sensing (RS) soil moisture observations with APSIM model through sequential data assimilation to evaluate the improvement in model predictions of downstream state variables across 5 experimental sites in the U.S Midwest. Four RS data products and in-situ observations spanning 19 site-years were used through two data assimilation approaches namely Ensemble Kalman Filter (EnKF) and Generalized Ensemble Filter (GEF) to constrain model states at observed time steps and estimate joint background and observation error matrices. Then, the assimilation’s impact on estimates of soil moisture, yield, NDVI, tile drainage, and nitrate leaching was assessed across all site-years. When assimilating in situ observations, the accuracy of soil moisture forecasts in the assimilation layers was improved by reducing RMSE by an average of 17 % for 10 cm and ~28 % for 20 cm depth soil layer across all site-years. These changes also led to improved simulation of soil moisture in deeper soil layers by an average of 12 %. Although crop yield was improved by an average of 23 %, the greatest improvement in yield accuracy was demonstrated in site-years with higher water stress, where assimilation served to increase available soil water for crop uptake. Alternatively, estimates of annual tile drainage and nitrate leaching were not well constrained across the study sites. Trends in drainage constraint suggest the importance of including additional data constraint such as evapotranspiration. The assimilation of RS soil moisture showed weaker constraint of downstream model state variables when compared to the assimilation of in situ soil moisture. The median reduction in soil moisture RMSE for observed soil layers was lower, on average, by a factor of 5. However, crop yield estimates were still improved overall with a median RMSE reduction of 17.2 %. Crop yield prediction was improved when assimilating both in-situ and remote sensing soil moisture observations and there is strong evidence that yield improvement was higher when under water-stressed conditions. Comparisons of system performance across different combinations of remote sensing data products indicated the importance of high temporal resolution and accurate observation uncertainty estimates when assimilating surface soil moisture observations.

Assimilation of wheat and soil states for improved yield prediction: The APSIM-EnKF framework

The usage of a hypersonic platform for remote sensing application has promising prospects, especially for hypersonic platform-borne synthetic aperture radar (SAR) imaging. However, the high-speed of hypersonic platform will lead to extreme friction between the platform and air, which will cause the ionization of air. The ionized gas forms the plasma sheath wrapped around the hypersonic platform. The plasma sheath will severely affect the propagation of SAR signal and further affect the SAR imaging. Therefore, hypersonic platform-borne SAR imaging should be studied from a physical perspective. In this paper, hypersonic platform-borne SAR imaging under plasma sheath is analyzed. The SAR signal propagation in plasma sheath is computed using scatter matrix method. The proposed SAR signal model is verified by using a ground experiment system. Moreover, the effect of attenuation caused by plasma sheath on SAR imaging is studied under different SAR parameters and plasma sheath. The result shows that attenuation caused by plasma sheath will degrade the SAR imaging quality and even cause the point and area targets to be submerged into the noise. The real SAR images under plasma sheath also illustrate this phenomenon. Furthermore, by studying imaging results under different SAR and plasma parameters, it can be concluded that the severe degradation of SAR imaging quality appears at condition of high plasma sheath electron density and low SAR carrier frequency. The work in this paper will be beneficial for the study of hypersonic platform-borne SAR imaging and design of hypersonic SAR imaging systems in the future.

Monitoring crop growth and estimating crop yield are essential for managing agricultural production, ensuring food security, and maintaining sustainable agricultural development. Combining the mechanistic framework of a crop growth model with remote sensing observations can provide a means of generating realistic and spatially detailed crop growth information that can facilitate accurate crop yield estimates at different scales. The main objective of this study was to develop a robust estimation methodology of within-field winter wheat yield at a high spatial resolution (20 m × 20 m) by combining a light use efficiency-based model and Sentinel-2 data. For this purpose, Sentinel-2 derived leaf area index (LAI) time series were assimilated into the Simple Algorithm for Yield Estimation (SAFY) model using an ensemble Kalman filter (EnKF). The study was conducted on rainfed winter wheat fields in southern Sweden. LAI was estimated using vegetation indices (VIs) derived from Sentinel-2 data with semi-empirical models. The enhanced two-band vegetation index (EVI2) was found to be a useful VI for LAI estimation, with a coefficient of determination (R2) and a root mean square error (RMSE) of 0.80 and 0.65 m2/m2, respectively. Our findings demonstrate that the assimilation of LAI derived from Sentinel-2 into the SAFY model using EnKF enhances the estimation of within-field spatial variability of winter wheat yield by 70% compared to the baseline simulation without the assimilation of remotely sensed data. Additionally, the assimilation of LAI improves the accuracy of winter wheat yield estimation by decreasing the RMSE by 53%. This study demonstrates an approach towards practical applications of freely accessible Sentinel-2 data and a crop growth model through data assimilation for fine-scale mapping of crop yield. Such information is critical for quantifying the yield gap at the field scale, and to aid the optimization of management practices to increase crop production.

Traditional crop cutting experiment-based yield estimation method captures the regional yield variability but lacks field-level information. Satellite images hold enormous crop information at finer spatial resolution. Crop yield mapping with optical images is particularly challenging if cloud-free images are unavailable during the crucial crop developmental stages. All-weather availability and sensitivity to crop structure, dielectric properties make synthetic aperture radar (SAR) images an excellent resource for yield estimation. Both types of data provide complementary information about crop conditions. A random forest regression model with genetic algorithm-based feature selection is developed to exploit the Sentinel-2 optical and Sentinel-1 SAR images for yield estimation. We utilized the crop harvest and quality survey (BEE) yield data set collected by the Hessisches Statistisches Landesamt (HSL), Wiesbaden, Germany, over 490 fields. We prepared 20 m resolution yield maps for winter wheat, winter barley, winter rye and winter rapeseed. Input features for the yield estimation model are selected based on the prior knowledge of remote sensing of vegetation. Baseline random forest regression models are developed for all the four crop types with optical and SAR input features. An optimized random forest regression model with genetic algorithm-based feature selection results in performance improvement. Dissimilarity in genetic algorithm selected image features highlights the significance of crop-specific feature selection for yield estimation. The optimized models reliably estimate yield by achieving correlation coefficient (r) of 0.65–0.86, mean absolute error 0.93–1.16 t ha–1 and root mean square error 1.12–1.56 t ha–1 with BEE yield on testing data set. The proposed models could estimate the intra-field yield variation when winter wheat, winter barley, winter rye were in the shooting phase to the beginning of ear-shifting, and winter rapeseed began to flower or was already flowering. These results demonstrate the merits of our model for early-stage crop yield estimation at the field level with mono-temporal image and adaptability for the cropping season with high cloud cover.

In general, synthetic aperture radar (SAR) imaging and image processing are two sequential steps in SAR image processing. Due to the large size of SAR images, most image processing algorithms require image segmentation before processing. However, the existence of speckle noise in SAR images, as well as poor contrast and the uneven distribution of gray values in the same target, make SAR images difficult to segment. In order to facilitate the subsequent processing of SAR images, this paper proposes a new method that combines the back-projection algorithm (BPA) and a first-order gradient operator to enhance the edges of SAR images to overcome image segmentation problems. For complex-valued signals, the gradient operator was applied directly to the imaging process. The experimental results of simulated images and real images validate our proposed method. For the simulated scene, the supervised image segmentation evaluation indexes of our method have more than 1.18%, 11.2% and 11.72% improvement on probabilistic Rand index (PRI), variability index (VI), and global consistency error (GCE). The proposed imaging method will make SAR image segmentation and related applications easier.

This paper proposes a novel method on Synthetic Aperture Radar (SAR) Image denoising, which is based on context modeling combined with multiscale orthogonal bandlet coefficients. For the main influence of SAR image is multiplicative speckle noise, the logarithm uniform transform is used to convert it to additive noise. In this paper, the multiscale orthogonal bandlet transform is applied to noisy SAR Image. The contextual model is used to compute contextual values of bandlet coefficients on each scale. Therefore, bandlet coefficients are reconstructed into some parts by contextual values. The spatially adaptive soft-threshold (T) is to denoise SAR image in each part. Experimental results demonstrate that this method outperforms the methods of Ehance-Lee (E-lee), contextual model based on wavelet domain (Wavelet-context), and Hidden Markov Tree model bases on wavelet domain (Wavelet-hmt) on there indexes: Floating index (FI), Standard deviation and Edge saving index of vertical direction, by using a real SAR image. However, the method can not only reduce the speckle noise but also preserve edges and high frequency information, and gets considerable visual effect on SAR Image denoising.

A novel three-step method to reduce speckle in Synthetic Aperture Radar (SAR) images is presented. First, an edge detector is used to detect the edge orientations in SAR images. Second, using a data processing method named empirical mode decomposition, the SAR image is smoothed along four directions: horizontal, vertical, left diagonal and right diagonal, respectively. Third, the SAR image is reconstructed such that if the edge direction is horizontal, the pixel smoothed along the horizontal direction is used to reconstruct the image, and so on; if an edge is not detected, the mean of the four directionally smoothed images is used to reconstruct the image. Application of this method to SAR images has shown that it is well balanced in the quality of visual appearance, mean preservation, edge preservation, and reduction of the standard deviation.

ABSTRACTThe speckle noise of synthetic aperture radar (SAR) images limits its application in change detection. Compared with improved ratio (IR) and log-ratio (LR) operators, the neighborhood-based ratio (NR) technique can restrain the influence of speckle noise and is more suitable for change detection in SAR images. However, we find three drawbacks of NR by analyzing this method carefully. To overcome these defects, we propose an improved neighborhood-based ratio (INR) approach for change detection in SAR images. INR restructures the NR operator to exploit the neighborhood information more reasonably and is expected to reduce the impact of speckle noise better. IR, LR, mean ratio operator, NR, and INR are tested on two data sets to compare their performances in change detection of SAR images. Experimental results show that the proposed method can obtain better difference image than other state-of-art methods and improve the accuracy of change detection in SAR images effectively.

We address the application of model-supported exploitation techniques to synthetic aperture radar (SAR) imagery. The emphasis is on monitoring SAR imagery using wide area 2D and/or 3D site models along with contextual information. We consider here the following tasks useful in monitoring: (a) site model construction using segmentation and labeling techniques, (b) target detection, (c) target classification and indexing, and (d) SAR image-site model registration. The 2-D wide area site models used here for SAR image exploitation differ from typical site models developed for RADIUS applications, in that they do not model specific facilities, but constitute wide area site models of cultural features such as urban clutter areas, roads, clearings, fields, etc. These models may be derived directly from existing site models, possibly constructed from electro-optical (EO) observations. When such models are not available, a set of segmentation and labeling techniques described here can be used for the construction of 2D site models. The use of models can potentially yield critical information which can disambiguate target signatures in SAR images. We address registration of SAR and EO images to a common site model. Specific derivations are given for the case of registration within the RCDE platform. We suggest a constant false alarm rate (CFAR) detection scheme and a topographic primal sketch (TPS) based classification scheme for monitoring target occurrences in SAR images. The TPS of an observed target is matched against candidate targets TPSs synthesized for the preferred target orientation, inferred from context (e.g. road or parking lot targets). Experimental results on real and synthetic SAR images are provided.

In single band and single polarized synthetic aperture radar (SAR) images, the information is limited to intensity and texture only and it is very difficult to interpret such SAR images without any a priori information. For unsupervised classification of SAR images, M-band wavelet decomposition is performed on the SAR image and sub-band selection on the basis of energy levels is applied to improve the classification results since sparse representation of sub-bands degrades the performance of classification. Then, textural features are obtained from selected sub-bands and integrated with intensity features. An adaptive neuro-fuzzy algorithm is used to improve computational efficiency by extracting significant features. K-means classification is performed on the extracted features and land features are labeled. This classification algorithm involves user defined parameters. To remove the user dependency and to obtain maximum achievable classification accuracy, an algorithm is developed in this paper for classification accuracy in terms of the parameters involved in the segmentation process. This is very helpful to develop the automated land-cover monitoring system with SAR, where optimized parameters are to be identified only once and these parameters can be applied to SAR imagery of the same scene obtained year after year. A single band, single polarized SAR image is classified into water, urban and vegetation areas using this method and overall classification accuracy is obtained in the range of 85.92%–93.70% by comparing with ground truth data.

Assessing crop growth during the growing period and the prediction of crop productivity is gaining importance for the estimation of seasonal production prior to crop harvest. Reliable and timely estimates of crop production in the face of different types of abiotic or biotic stresses or climatic aberrations, namely heat stress, drought or pest infestation, etc., are particularly important for those countries where agriculture contributes substantially to the economy. Advance warnings of adverse effects of such disastrous events can be of great help for strategic planning and the use of measures to avoid any consequent food shortages in the future. Satellite remote-sensing platforms can be applied quite effectively for real-time crop condition assessment and yield predictions, as satellite systems can provide continuous data on variable spatio-temporal scales, with timely availability and global coverage. These data are also inexpensive and readily available at various online portals and archives. Several studies conducted so far have either derived vegetation indices from remote-sensing data or have coupled remote-sensing data with crop simulation models for crop yield prediction. The coupling of remote-sensing data with crop simulation models has shown a significant improvement in yield prediction. Among spectral indices, Normalized Difference Vegetation Index (NDVI) has been shown to be quite effective for predicting crop yield, but detection of the anomalies from historical values of NDVI needs the availability of NDVI at the temporal scale for predicting the crop yield of the current season. Obtaining biophysical parameters (leaf area index, soil moisture, evapotranspiration, etc.), derived from satellite imagery at the appropriate stage of crop growth, is required for robust prediction of crop yield at the regional level. Yield estimates at regional level can provide important information for agricultural planning and can enable policy makers to frame import or export plans, determining prices on one hand, and can enable farmers to plan their marketing strategies on the other hand, while ensuring food security.

Ship detection from synthetic aperture radar (SAR) images is a hot topic, but the difficulty in collecting labeled SAR images may hinder the development of deep-learning-based detection methods. Inspired by the idea of domain adaptation, in this article, we propose a hierarchical similarity alignment neural network (HSANet) for ship detection in SAR images, which is a domain adaptive (DA) approach with optical remote sensing images as training samples. The kernel target of HSANet is to mine and align both the global structure and the local instance information between SAR and optical images, where two modules, structural alignment module (SAM) and prototype alignment module (PAM), are designed to, respectively, conduct two hierarchies of alignment process. In general, SAM attempts to extract the global structure similarity which exists in image-level feature representation, while PAM tends to extract the local shape similarity which is instance-level representation. To be specific, SAM is developed by Fourier-based feature alignment, which tries to describe the similar structural relationship between optical and SAR images. Meanwhile, PAM is proposed based on the conjoint confidence analysis where the instance-level ship representations of the source and target domains is aligned. SAM and PAM work together to construct a hierarchical domain adaptation network for SAR ship detection. Experiments on several public datasets may indicate the effectiveness of the proposed method.

Synthetic aperture radar (SAR) image segmentation is the key to SAR image automatic interpretation. However, speckle noise, intensity inhomogeneity, and irregular shaped objects with changing edge often make the SAR image segmentation very difficult, and existing algorithms have high computational complexity. We propose a region-based level set method using the local image intensity information. To represent the statistical characteristics of speckle noise, we first use a gamma statistical distribution to model every segmented SAR image. We then apply a modified region mean estimation formula to efficiently segment SAR images with inhomogeneity. Finally, Gaussian filtering is employed to regularize the level set function, which can avoid reinitialization. The experimental results on synthetic and real-world SAR images demonstrate that the proposed method has less computation cost, faster convergence rate, and more accurate segmentation results.