EF-TSR:edge feature transformer-based DEM super-resolution network

Urban flood models that use Digital Elevation Models (DEMs) to simulate extent and depth of flood inundation rely on the accuracy of DEMs for predicting flood events. Despite recent advances in developing vegetation corrected DEMs, the effect of building height and density errors in global DEMs in urban areas are still poorly understood, and their correction remains a challenge. In this research we developed a methodology for building error correction that can be applied to any other case study, where building density data and a local reference DEM data are available. This methodology was applied to Nairobi, Kenya using six global DEMs (SRTM, MERIT, ALOS, NASADEM, TanDEM-X 12 m, and TanDEM-X 90 m DEM). Our results show building error at highest building density varying between 1.25 m and 5.07 m for the DEMs used, with the MERIT DEM showing the smallest vertical height error from the reference DEM. The six DEMs were corrected by deriving a linear relationship between building density and DEM error. Our findings show that the removal of building density error resulted in the improvement of the vertical height accuracy of the global DEMs of up to 45% for MERIT and 40% for ALOS. This methodology was also applied to the Central Business District (CBD) area of Nairobi, characterized by taller buildings and high building density. The error parameters in the CBD area resulted to be between 15 to 45% higher than those of the Nairobi city wide area for the six global DEMs, thus providing further insights into the contribution of building heights to errors in global DEMs. Building height data is still unavailable on a global scale and our results show that global DEMs can be usefully corrected for building density errors in urban areas, even where specific building height data are not available.

<p>With growing urbanisation and climate change, flooding is likely to become even more frequent and severe.  Therefore, it is essential to constantly monitor water level changes at a large scale. Synthetic Aperture Radar (SAR) images are often used for flood mapping as they allow a rather straightforward detection of water bodies, at almost all weather and illumination conditions. As the number of satellite observations and global digital elevation models (DEMs) are becoming more available, this mapping approach is gaining in popularity.</p><p>In this study, we propose three different approaches to retrieve water level maps based on the combination of satellite and topographic data, hereby referred to as the global Height Above Nearest Drainage (HAND), the local HAND and the local DEM methods.</p><p>The three approaches are based on the optimization of a threshold applied on the topography (HAND or DEM) data enabling a best fit with the SAR-extracted flood map. The optimized threshold values provide at the same time the normalized water levels (with respect to the drainage network). The water depth map is thus computed from the difference between the water level and the DEM. The global HAND method applies a single optimized threshold to the HAND map, over the entire area of interest. The local HAND method is based on the same concept but optimizes and applies the HAND threshold value locally, using a sliding window. The local DEM thresholding method employs the same principle as the second method but directly on the DEM.</p><p>We evaluate these methods using hydraulic model simulation results and ground truth data, and we carry out several experiments using various SAR images (Envisat, TerraSAR-X and Sentinel-1) and topographic datasets (SRTM, CopDEM and LiDAR).</p><p>The best results are obtained while combining a high-resolution image (e.g:TerraSAR-X) with: 1) a high-resolution dataset (e.g: LiDAR DEM), using the local DEM approach, or 2) a coarse-resolution dataset (e.g: Srtm DEM), using the global HAND approach. RMSDs on the derived water depth maps reach respectively 0.52m and 0.93m.</p>

In this paper, we propose a method for estimating the position of an airborne platform using a digital elevation model (DEM) through data fusion. Given information of a terrain, the localization of the platform is possible through a template matching process if a local DEM under the platform can be measured. For better position estimation, we calculate the gradients of DEM and use it in the matching process. The position of the platform is determined as a point that has a minimum matching error in DEM and its gradients. To combine the error costs, we employed information theory to adaptively determine the weight between data. Based on the suggested method, the matching error can be improved by 55%.

Snow depth from ICESat laser altimetry — A test study in southern Norway

This paper presents an algorithm which can generate live digtial surface model (DSM) during the flight based on simultaneous localization and mapping (SLAM). We process the keyframe which is output by a monocular SLAM system to generate a local DSM, and fuse the local DSM to the global tiled DSM incrementally. During the local DSM generation, a local digital elevation model (DEM) is estimated by projecting the filtered 2D Delaunay mesh to a 3D mesh, and a local orthomosaic is obtained by projecting triangle image patches onto a 2D mesh. During the DSM fusion, both the local DEM and orthomosaic are split into tiles and fused to the global tiled DEM and orthomosaic respectively with multiband algorithm. Both the efficient DSM generation and fusion algorithms contribute to achieving a real-time reconstruction. Qualitative and quantitative experiments on a public aerial image dataset with different scenarios are performed to validate the effectiveness of the proposed method. Compared with traditional structure from motion (SfM) based approaches, the presented system is able to output both large-scale high-quality DEM and orthomosaic in real-time with low computational cost.

Countrywide winter and summer Sentinel-1 (S1) backscatter data, cloud-free summer Sentinel-2 (S2) images, an Airborne Laser Scanning (ALS)-based Digital Terrain Model (DTM) and a forest mask were used to model and subsequently map Dominant Leaf Type (DLT) with the thematic classes broadleaved and coniferous trees for the whole of Switzerland. A novel workflow was developed that is robust, cost-efficient and highly automated using reference data from aerial image interpretation. Two machine learning approaches based on Random Forest (RF) and deep learning (UNET) for the whole country with three sets of predictor variables were applied. 24 subareas based on aspect and slope categories were applied to explore effects of the complex mountainous topography on model performances. The reference data split into training, validation and test data sets was spatially stratified using a 25 km regular grid. Model accuracies of both RF and UNET were generally highest with Kappa (K) around 0.95 when predictors were included from both S1/S2 and the topographic variables aspect, elevation and slope from the DTM. While only slightly lower accuracies were obtained when using S2 and DTM data, lowest accuracies were obtained when only predictors from S1 and DTM were included, with RF performing worse than UNET. While on countrywide level RF and UNET performed overall similarly, substantial differences in model performances, i.e. higher variances and lower accuracies, were found in subareas with northwest to northeast orientations. The combined use of S1/S2 and DTM predictors mitigated these problems related to topography and shadows and was therefore superior to the single use of S1 and DTM or S2 and DTM data. The comparison with independent National Forest Inventory (NFI) plot data demonstrated precisions of K around 0.6 in the predictions of DLT and indicated a trend of increasing deviations in mixed forests. A comparison with the Copernicus High Resolution Layer (HRL) DLT 2018 revealed overall higher map accuracies with the exception of pure broadleaved forest. Although, spatial patterns of DTL were overall similar, UNET performed better than RF in areas with a distinct DLT on forest stand level, with the largest differences occurring when only S1 and DTM data was used. In contrast, predictions obtained from RF were more accurate in mixed stands. This study goes beyond the case study level and meets the requirements of countrywide data sets, in particular regarding repeatability, updating, costs and characteristics of training data sets. The 10 m countrywide DLT maps add complementary and spatially explicit information to the existing NFI estimates and are thus highly relevant for forestry practice and other related fields.

Shading-based DEM refinement under a comprehensive imaging model

High-resolution digital elevation models (DEMs) are widely used in many fields such as mapping, hydrology, meteorology and geology, where they can improve the accuracy and reliability of many geographic analysis applications as an input. However, due to the high cost and difficulty of acquiring high-resolution DEMs, as well as the problems of edge smoothing, data distortion and fractures in reconstructed ground surfaces with traditional super-resolution DEM reconstruction techniques. Inspired by the excellence of generative adversarial neural networks in super-resolution image analysis, this paper investigates an approach for DEM super-resolution reconstruction with deep residual generative adversarial network. An advanced DEM Super-resolution Generative Adversarial Network (D-SRCAGAN) is proposed in this paper, which can reconstruct a quadruple higher resolution DEM by using low-resolution DEM. Compared with the bicubic and SRGAN methods, the D-SRCAGAN method reconstruction results can retain more topographic features and obtain higher RMSE values.

Topographic accuracy assessment of bare earth lidar-derived unstructured meshes

For semantic segmentation of high-resolution remote-sensing images, digital surface models (DSMs) information is useful for improving the accuracy and robustness of the segmentation models. However, since the feature distributions of spectral and DSM images vary significantly in different scenes, it is difficult to fuse them effectively in popular deep network models. To solve this issue, we propose an attention-based DSM fusion network (ADF-Net) for high-resolution remote-sensing image semantic segmentation. The proposed network makes two contributions. The first is that we design an attention-based feature fusion module, which can selectively gather features from spectral and DSM information by channel attention mechanism, and further combine them to get high-quality fusion features. The second is that we introduce a residual feature refinement module to reduce the redundant information from skip connection adaptively. We evaluate the proposed network on the ISPRS Vaihingen and Potsdam datasets, experimental results demonstrate that our model outperforms state-of-the-art methods.KeywordsHigh-resolution remote-sensing imagesAttention mechanismSemantic segmentationData fusion

Abstract. This paper deals with two aspects of photogrammetric processing of thermal images: image quality and 3D reconstruction quality. The first aspect of the paper relates to the influence of day light on Thermal InfraRed (TIR) images captured by an Unmanned Aerial Vehicle (UAV). Environmental factors such as ambient temperature and lack of sun light affect TIR image quality. We acquire image sequences of the same object during day and night and compare the generated orthophotos according to different metrics like contrast and signal-to-noise ratio (SNR). Our experiments show that performing TIR image acquisition during night time provides a better thermal contrast, regardless of whether we compute contrast over the whole image or over small patches. The second aspect investigated in this work is the potential of using TIR images for photogrammetric tasks such as the automatic generation of Digital Surface Models (DSM) and orthophotos. Due to the low geometrical resolution of a TIR camera and the low image quality in terms of contrast and noise compared to RGB images, the TIR DSM suffers from reconstruction errors and an orthophoto generated using the TIR DSM and TIR images is visibly influenced by those errors. We therefore include measurements of the UAVs positions during image capturing provided by a Global Navigation Satellite System (GNSS) receiver to retrieve position and orientation of TIR and RGB images in the same world coordinate system. To generate an orthophoto from TIR images, they are projected onto the DSM reconstructed from RGB images. This procedure leads to a TIR orthophoto of much higher quality in terms of geometrical correctness.

We analyzed a light-field super-resolution problem in which the 3-D scene is reconstructed with a higher resolution using super-resolution (SR) reconstruction with a given set of multi-view images with a low resolution. The arrangement of the multi-view cameras is important because it determines the quality of the reconstruction. To simplify the analysis, we considered a situation in which a plane is located at a certain depth and a texture on that plane is super-resolved. We formulated the SR reconstruction process in the frequency domain, where the camera arrangement can be independently expressed as a matrix in the image formation model. We then evaluated the condition number of the matrix to quantify the quality of the SR reconstruction. We clarified that when the cameras are arranged in a regular grid, there exist singular depths in which the SR reconstruction becomes ill-posed. We also determined that this singularity can be avoided if the arrangement is randomly perturbed.

Geomorphometry: Quantitative Land-Surface Analysis

One and a half centuries after the founding of the IAG, geodetic imaging (GI) represents a golden age in geodesy, and a bonanza of never-before-available quantitative information for research in related fields of science. Airborne LiDAR (light detection and ranging) observations, and such derived products as ‘bare earth’ digital elevation models, are being used to study: earthquake deformation fields, fault slip rates, folding mechanisms, landslide dynamics, channel network evolution, soil mantle development, bedrock surface cracking, landscape response to tectonics, lava flow fluxes, marsh evolution, salmon habitat, beach erosion, forestry, and archaeological sites. LiDAR technology is still developing rapidly, with high priority being given to multi-color systems, and miniaturization that will enable the deployment of LiDAR in remotely piloted aircraft, a.k.a., drones. As such technological improvements become operational new scientific problems will be brought within reach of an increasingly diverse community of researchers.

Super-resolution (SR) reconstruction is one of the effective ways to improve the spatial resolution of remote sensing images, but the blur kernel estimation without any additional prior information is the key to the quality of SR reconstruction. Facing the above problem, a blind super-resolution method via sparse representation and transformed self-similarity is proposed in this paper. In this method, the blur kernel as well as the reconstructed high-resolution image are estimated at the same time using the structural self-similarity from a single image, a down-sampled version of the observed image is used as the training samples for the dictionary learning, and the internal patch search space is expanded using the transformed self-similarity to improve the quality of estimation. Experiment results show that, our method performs well both in quality of kernel estimation and SR reconstruction.