Individual Tree Species Classification From Airborne Multisensor Imagery Using Robust PCA

Hyperspectral imagery (HSI) and light detection and ranging (LiDAR) remote sensing technologies are important ways to obtain surface information. Combining the characteristics and advantages of hyperspectral images and LiDAR DSM data, we propose a classification method for co-classification of hyperspectral images and LiDAR data in this paper. The model uses a dual-branch HSI image and LiDAR data classification method. First, the features of shallow convolution and deep convolution are merged in the spatial feature extraction process of HSI, which combines to focus on more global information. Then the space and spectrum are combined, considering the characteristics of different layers, the network has the characteristics of multiscale. Finally, the LiDAR branch introduces dilated convolution to obtain a larger receptive field and reduce information loss. The classification experimental results on Houston and Trento dataset show the superiority of our proposed method in the collaborative classification of hyperspectral images and LiDAR data.

High-value timber species play an important economic role in forest management. The individual tree information for such species is necessary for practical forest management and for conservation purposes. Digital aerial photogrammetry derived from an unmanned aerial vehicle (UAV-DAP) can provide fine spatial and spectral information, as well as information on the three-dimensional (3D) structure of a forest canopy. Light detection and ranging (LiDAR) data enable area-wide 3D tree mapping and provide accurate forest floor terrain information. In this study, we evaluated the potential use of UAV-DAP and LiDAR data for the estimation of individual tree location and diameter at breast height (DBH) values of large-size high-value timber species in northern Japanese mixed-wood forests. We performed multiresolution segmentation of UAV-DAP orthophotographs to derive individual tree crown. We used object-based image analysis and random forest algorithm to classify the forest canopy into five categories: three high-value timber species, other broadleaf species, and conifer species. The UAV-DAP technique produced overall accuracy values of 73% and 63% for classification of the forest canopy in two forest management sub-compartments. In addition, we estimated individual tree DBH Values of high-value timber species through field survey, LiDAR, and UAV-DAP data. The results indicated that UAV-DAP can predict individual tree DBH Values, with comparable accuracy to DBH prediction using field and LiDAR data. The results of this study are useful for forest managers when searching for high-value timber trees and estimating tree size in large mixed-wood forests and can be applied in single-tree management systems for high-value timber species.

Individual tree level inventory performed using high density multi-return airborne Light Detection and Ranging (LiDAR) systems provides both internal and external geometric details on individual tree crowns. Among them, the parameters such as, the stem location, and Diameter at Breast Height of the stem (DBH) are very relevant for accurate biomass, and forest growth estimation. However, methods that can accurately estimate these parameters along the vertical canopy are lacking in the state of the art. Thus, we propose a method to locate and model the stem by analyzing the empty volume that appears within the 3D high density LiDAR point cloud of a conifer, due to the stem. In a high LiDAR density data, the points most proximal to the stem location in the upper half of the crown are very likely due to laser reflections from the stem and/or the branch-stem junctions. By locating accurately these points, we can define the lattice of points representing branch-stem junctions and use it to model the empty volume associated to the stem location. We identify these points by using a state-of-the-art internal crown structure modelling technique that models individual conifer branches in a high density LiDAR data. Under the assumption that conifer stem can be closely modelled using a cone shape, we regression fit a geometric shape onto the lattice of branch-stem junction points. The parameters of the geometric shape are used to accurately estimate the diameter at breast height, and height of the tree. The experiments were performed on a set of hundred conifers consisting of trees from six dominant European conifer species, for which the height and the DBH were known. The results prove the method to be accurate.

Current research into the fusion of Hyperspectral Imagery (HI) and full waveform LiDAR (Light detection and ranging) has relied on first processing the full waveform LiDAR (FWL) data to a set of discrete returns before combining. However, more information about target properties can potentially be recovered if the raw waveform is preserved in the fusion with HI. This paper proposes a voxelization method to fuse raw FWL data with HI by dividing the waveform data into voxels, and then synthesizing all waveforms which intersect a voxel into one 3D superposition waveform. The efficacy of this method is evaluated by comparing the synthesized waveform with an actual nadir LiDAR waveform from the voxel of interest. Results show that this method of voxelizing and fusion of FWL data can preserve raw waveform characteristics while effectively representing the FWL data on a 3D raster basis that can be directly co-registered with the HI.

The fusion of hyperspectral imagery (HSI) and light detection and ranging (LiDAR) data is widely used for land cover classification. However, due to different imaging mechanisms, HSI and LiDAR data always present significant image differences, and the dimensions and feature distributions of HSI and LiDAR are highly dissimilar. This makes it challenging to represent and correlate semantic information from multimodal data. Current methods for classifying pixel-by-pixel features, which rely on cascaded or attention-based fusion, cannot effectively use multimodal features. To achieve accurate classification results, extracting and fusing similar high-order semantic information and complementary discriminative information contained in multimodal data is vital. In this paper, we propose a cross-modal semantic enhancement network (CMSE) for multimodal semantic information mining and fusion. Our proposed CMSE framework extracts features from the image on multiple scales, capturing more representative local sparse features with different sizes of convolution kernels. To represent high-level semantic features related to land cover, we establish a Gaussian-weighted matrix and semantically transform the spatial and spectral features of distinct branches. Finally, we build a multi-level residual fusion module to incrementally fuse spectral features from HSI and elevation features from LiDAR. Additionally, we introduce a cross-modal semantically constrained loss to guide multimodal semantic feature alignment. We evaluate our approach on three multimodal remote sensing datasets, namely the Houston2013, Trento, and MUUFL datasets. The experimental results demonstrate that our proposed CMSE model achieves superior performance in terms of accuracy and robustness compared to other related deep networks.

Recent growth in unmanned aerial vehicle (UAV) technology have promoted the detailed mapping of individual tree species. However, the in-depth mining and comprehending of the significance of features derived from high-resolution UAV data for tree species discrimination remains a difficult task. In this study, a state-of-the-art approach combining UAV-borne light detection and ranging (LiDAR) and hyperspectral was used to classify 11 common tree species in a typical natural secondary forest in Northeast China. First, comprehensive relevant structural and spectral features were extracted. Then, the most valuable feature sets were selected by using a hybrid approach combining correlation-based feature selection with the optimized recursive feature elimination algorithm. The random forest algorithm was used to assess feature importance and perform the classification. Finally, the robustness of features derived from point clouds with different structures and hyperspectral images with different spatial resolutions was tested. Our results showed that the best classification accuracy was obtained by combining LiDAR and hyperspectral data (75.7%) compared to that based on LiDAR (60.0%) and hyperspectral (64.8%) data alone. The mean intensity of single returns and the visible atmospherically resistant index for red-edge band were the most influential LiDAR and hyperspectral derived features, respectively. The selected features were robust in point clouds with a density not lower than 5% (~5 pts/m2) and a resolution not lower than 0.3 m in hyperspectral data. Although canopy surface features were slightly different from original LiDAR features, canopy surface information was also important for tree species classification. This study proved the capabilities of UAV-borne LiDAR and hyperspectral data in natural secondary forest tree species discrimination and the potential for this approach to be transferable to other study areas.

ABSTRACTPrevious studies demonstrate the effectiveness of the Euclidean distance shape descriptor for characterizing individual tree crowns derived from Light Detection and Ranging (LiDAR) data. This paper evaluates the effectiveness of the longitude–latitude shape descriptor for tree crown shape characterization in comparison with the Euclidean distance descriptor using LiDAR data for 43 individual tree crowns. The three-dimensional (3D) shape signatures obtained from longitude–latitude and Euclidean distance measures of the tree crowns are compared with 3D shape signatures of simulated ellipsoid and hemisphere tree crowns. Kolmogorov–Smirnov test (K–S test) and Mean Square Error (MSE) are used to measure the similarity of longitude–latitude and Euclidean distance signatures. The experimental results from all 43 examined trees suggest that the longitude–latitude shape descriptor can determine tree crown shapes with different leaf traits, while Euclidean distance is only able to characterize the shape of evergreen trees. Furthermore, the longitude–latitude shape descriptor, unlike the Euclidean distance shape descriptor, is not sensitive to the number of LiDAR points from the tree crown.

Civil engineering includes a wide range of applications that require three-dimensional (3D) information. With the advent of LiDAR (Light Detection And Ranging) technology, obtaining 3D terrain information accurately in a cost and time effective manner became more popular. In this paper, three case studies demonstrate the roles and applications of airborne LiDAR data including highway, transmission line and hydropower dam development projects. In first case study, the highway alignment was considerably changed after the initial design stage. LiDAR data was able to do the re-alignment survey quickly, allowing for prompt changes in design. In the next case study, a comparison is made between conventional transmission route alignment design and the design using PLS-CADD with LiDAR data. Utilizing the LiDAR data in PLSCADD allows transmission line engineers to model the construction costs of several alignments options effectively and efficiently compared to the conventional method. The last case study uses LiDAR for obtaining the necessary information for proposed dam. Using LiDAR data maximizes topological accuracy and volume measurements while minimizing survey time and costs. Furthermore, utilizing the multi-temporal LiDAR data can reveal valuable information such as topography changes. LiDAR survey technology has proven that it is the best method to capture accurate data from the earth surface which provides maximum density of topographical & digital imagery information for various applications.

Foresters are increasingly interested in remote sensing data because they provide an overview of landscape conditions, which is impractical with field sample data alone. Light Detection and Ranging (LiDAR) provides exceptional spatial detail of forest structure, but difficulties in processing LiDAR data have limited their application beyond the research community. Another obstacle to operational use of LiDAR data has been the high cost of data collection. Our objectives in this study were to summarize, at the stand level, both LiDAR- and Landsat (satellite)-based predictions of some common structural and volume attributes and to compare the cost of obtaining such summaries with those obtained through traditional stand exams. We found that the accuracy and cost of a LiDAR-based inventory summarized at the stand level was comparable to traditional stand exams for structural attributes. However, the LiDAR data were able to provide information across a much larger area than the stand exams alone.

With the increasing number of remote sensing (RS) data sources, the joint utilization of multimodal data in Earth observation tasks has become a crucial research topic. As a typical representative of RS data, hyperspectral images (HSIs) provide accurate spectral information, while rich elevation information can be obtained from light detection and ranging (LiDAR) data. However, due to the significant differences in multimodal heterogeneous features, how to efficiently fuse HSI and LiDAR data remains one of the challenges faced by existing research. In addition, the edge contour information of images is not fully considered by existing methods, which can easily lead to performance bottlenecks. Thus, a joint classification network of HSI and LiDAR data based on Mamba (HLMamba) is proposed. Specifically, a gradient joint algorithm (GJA) is first performed on LiDAR data to obtain the edge contour data of the land distribution. Subsequently, a multimodal feature extraction module (MFEM) was proposed to capture the semantic features of HSI, LiDAR, and edge contour data. Then, to efficiently fuse multimodal features, a novel deep learning (DL) framework called Mamba, was introduced, and a multimodal Mamba fusion module (MMFM) was constructed. By efficiently modeling the long-distance dependencies of multimodal sequences, the MMFM can better explore the internal features of multimodal data and the interrelationships between modalities, thereby enhancing fusion performance. Finally, to validate the effectiveness of HLMamba, a series of experiments were conducted on three common HSI and LiDAR datasets. The results indicate that HLMamba has superior classification performance compared to other state-of-the-art DL methods. The source code of the proposed method will be available publicly at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Dilingliao/HLMamba</uri>.

Airborne light detection and ranging (LIDAR) system uses in many field such as military, agriculture, geology and transportation. LIDAR data acquisition consumes several gigabytes from the storage capacity of the system. So, it's necessary to reduce the on board storage capacity as well as its transmission rate. Compression of LIDAR data means reducing the amount of data required to represent the digital data acquired by LIDAR system. This is done by removing data redundancies to achieve compression. In this paper we explain LIDAR system theory and component, compare between lossy and lossless compression techniques then we discuss LIDAR data compression techniques in order to choose a suitable one for LIDAR system that gives high compression ratio with suitable processing time. In most LIDAR data compression techniques classification of LIDAR data is an important issue as a preprocessing step to simplify the data. Using more than one compression algorithms increase the compression ratio but increase the processing time as well.

To increase understanding of forest carbon cycles and stocks, estimates of total and component (e.g. leaf, branch and trunk) biomass at a range of scales are desirable. Focusing on mixed species forests in central south‐east Queensland, two different approaches to the retrieval of biomass from small footprint Light Detection and Ranging (LiDAR) and Compact Airborne Spectrographic Imager (CASI) hyperspectral data were developed and compared. In the first, stems were located using a LiDAR crown openness index, and each was associated with crowns delineated and identified to species using CASI data. The component biomass for individual trees was then estimated using LiDAR‐derived height and stem diameter as input to species‐specific allometric equations. When summed to give total above‐ground biomass (AGB) and aggregated to the plot level, these estimates showed a reasonable correspondence with ground (plot‐based) estimates (r 2 = 0.56, RSE = 25.3 Mg ha−1, n = 21) given the complex forest being assessed. In the second approach, a Jackknife linear regression utilizing six LiDAR strata heights and crown cover at the plot‐scale produced more robust estimates of AGB that showed a closer correspondence with plot‐scale ground data (r 2 = 0.90, RSE = 11.8 Mg ha−1, n = 31). AGB aggregated from the tree‐level and Jackknife regression plot‐based AGB estimates (for 270 plots—each of 0.25 ha) compared well for more mature homogeneous and open forests. However, at the tree level, AGB was overestimated in taller forests dominated by trees with large spreading crowns, and underestimated AGB where an understorey with a high density of stems occurred. The study demonstrated options for quantifying component biomass and AGB through integration of LiDAR and CASI data but highlighted the requirement for methods that give improved estimation of tree density (by size class distributions) and species occurrence in complex forests.

Good forest management requires comprehensive and reliable inventory data spanning large areas. Forest management has increasingly relied on remote sensing, specifically light detection and ranging (LiDAR). However, due to the high costs associated with data collection and processing, wall-to-wall LiDAR data is rarely obtained for forests. In contrast, multispectral imagery from optical sensors often covers large extents but they fail to capture detail below the forest canopy and do not directly measure structural attributes. To take advantage of the complementary benefits of different sensors, active LiDAR and passive optical sensors have been combined and applied to problem-solving in a forestry context for over a decade. A review of the literature shows that fusion of different sensors has resulted in superior performance relative to individual sensors for classifying and delineating forest areas (up to 20 % accuracy improvement), identifying species (up to 21 % accuracy improvement), and estimating forest volume and biomass (up to 55 % accuracy improvement). In contrast, sensor fusion achieved only minor improvements for tree or forest height estimation (1–7 % accuracy improvement); this is likely because LiDAR alone is already so effective. This review was unable to draw conclusions on the performance of sensor fusion for forest age and productivity assessment due to the limited number of studies. The lack of results in these areas presents an opportunity for future research. The literature clearly demonstrates the utility of integrating LiDAR and optical data for many aspects of forest description. Perhaps the greatest challenge moving forward will be to operationalise the research such that forestry companies and governments can take advantage of the benefits of data fusion.

Currently, the worsening impacts of urbanizations have been impelled to the importance of monitoring and management of existing urban trees, securing sustainable use of the available green spaces. Urban tree species identification and evaluation of their roles in atmospheric Carbon Stock (CS) are still among the prime concerns for city planners regarding initiating a convenient and easily adaptive urban green planning and management system. A detailed methodology on the urban tree carbon stock calibration and mapping was conducted in the urban area of Brussels, Belgium. A comparative analysis of the mapping outcomes was assessed to define the convenience and efficiency of two different remote sensing data sources, Light Detection and Ranging (LiDAR) and WorldView-3 (WV-3), in a unique urban area. The mapping results were validated against field estimated carbon stocks. At the initial stage, dominant tree species were identified and classified using the high-resolution WorldView3 image, leading to the final carbon stock mapping based on the dominant species. An object-based image analysis approach was employed to attain an overall accuracy (OA) of 71% during the classification of the dominant species. The field estimations of carbon stock for each plot were done utilizing an allometric model based on the field tree dendrometric data. Later based on the correlation among the field data and the variables (i.e., Normalized Difference Vegetation Index, NDVI and Crown Height Model, CHM) extracted from the available remote sensing data, the carbon stock mapping and validation had been done in a GIS environment. The calibrated NDVI and CHM had been used to compute possible carbon stock in either case of the WV-3 image and LiDAR data, respectively. A comparative discussion has been introduced to bring out the issues, especially for the developing countries, where WV-3 data could be a better solution over the hardly available LiDAR data. This study could assist city planners in understanding and deciding the applicability of remote sensing data sources based on their availability and the level of expediency, ensuring a sustainable urban green management system.

We present a remote sensing pipeline that processes LiDAR (Light Detection And Ranging) data through machine & deep learning for the application of archeological feature detection on big geo-spatial data platforms such as e.g. IBM PAIRS Geoscope. Today, archeologists get overwhelmed by the task of visually surveying huge amounts of (raw) LiDAR data in order to identify areas of interest for inspection on the ground. We showcase a software system pipeline that results in significant savings in terms of expert productivity while missing only a small fraction of the artifacts. Our work employs artificial neural networks in conjunction with an efficient spatial segmentation procedure based on domain knowledge. Data processing is constraint by a limited amount of training labels and noisy LiDAR signals due to vegetation cover and decay of ancient structures. We aim at identifying geo-spatial areas with archeological artifacts in a supervised fashion allowing the domain expert to flexibly tune parameters based on her needs.