Individual Tree Segmentation Method Based on Mobile Backpack LiDAR Point Clouds

Simulating realistic three‐dimensional (3D) forest scenes is useful in understanding the links between forest structure and ecosystem functions (e.g. radiative transfer). Light detection and ranging (LiDAR) technology provides useful 3D data for forest reconstructions since it can characterise 3D structures of individual trees and canopies. High‐density terrestrial LiDAR (terrestrial laser scanning, TLS) is suitable for fine‐scale reconstructions but is limited to smaller forest plots; low‐density airborne LiDAR (airborne laser scanning, ALS) can cover larger areas but is only suitable for coarse‐scale reconstructions. How to take advantage of TLS and ALS to enable fine‐scale forest simulations in large areas needs to be studied. We propose a new voxel‐based method for forest simulations using the integration of TLS and ALS data. TLS data of representative reference trees are used to approximate the detailed architectures of the whole forest scene, with structural information on each individual tree extracted from ALS data. The high‐density point cloud data derived from TLS and ALS data are voxelised using high resolution solid voxels for scene representation. We tested the proposed method using two virtual forests (108 m × 108 m) and a real forest (300 m × 300 m) with conifer and broadleaf species. The physically based ray tracer (PBRT) was used to visualise the true virtual forest scenes, whereas voxel‐based radiative transfer (VBRT) was used to visualise the modelled forest scenes from LiDAR data. For the real forest scene, simulated and real ALS data were compared. Our results demonstrate that the images simulated by VBRT and PBRT are similar in the virtual forest scenes, with average radiance values of 1.02 and 1.72, respectively. In the real forest scene, the distributions of points and individual tree attributes (tree height, crown radius, and tree volume) derived from real and simulated ALS also match well, with Kullback–Leibler divergence ranging from 0.006 to 0.06. We conclude that the new method is capable of modelling fine‐scale 3D forests in large areas (over 1 ha) when TLS and ALS data are available, and it has good potential in studying the process of radiative transfer in conifer and broadleaf forests.

As one of the most important components of urban space, an outdated inventory of road-side trees may misguide managers in the assessment and upgrade of urban environments, potentially affecting urban road quality. Therefore, automatic and accurate instance segmentation of road-side trees from urban point clouds is an important task in urban ecology research. However, previous works show under- or over-segmentation effects for road-side trees due to overlapping, irregular shapes and incompleteness. In this paper, a deep learning framework that combines semantic and instance segmentation is proposed to extract single road-side trees from vehicle-mounted mobile laser scanning (MLS) point clouds. In the semantic segmentation stage, the ground points are filtered to reduce the processing time. Subsequently, a graph-based semantic segmentation network is developed to segment road-side tree points from the raw MLS point clouds. For the individual tree segmentation stage, a novel joint instance and semantic segmentation network is adopted to detect instance-level roadside trees. Two complex Chinese urban point cloud scenes are used to evaluate the individual urban tree segmentation performance of the proposed method. The proposed method accurately extract approximately 90% of the road-side trees and achieve better segmentation results than existing published methods in both two urban MLS point clouds. Living Vegetation Volume (LVV) calculation can benefit from individual tree segmentation. The proposed method provides a promising solution for ecological construction based on the LVV calculation of urban roads.

Over an extended period, remote-sensing-based individual tree analysis has played a critical role in modern forest inventory and management research. The segmentation of individual trees from aerial point clouds usually depends on the characteristics of peak-like uplift on the crown surface; however, the performance inevitably decreases with increasing visibility of such features in point clouds, especially for high-density forests. Herein, we developed a novel hierarchical region-merging algorithm that first over-segmented the entire forest scene based on local density and then merged the over-segmented partitions into pairs through a stepwise optimal process to produce the final segmentation. In the region-merging method, a global merging cost was introduced to shift from local detection of crown features to use the overall compactness of forest point clouds. The experiments were conducted using unmanned aerial vehicle light detection and ranging (UAV-LiDAR) point clouds from three coniferous stands with different densities and a high-density coniferous and broad-leaved mixed stand. A total of 5510 field-measured trees in 36 plots were used to assess the accuracy of the proposed method. Our method achieved F-scores of 0.91, 0.88, 0.84, and 0.80 for low- (~700 stems/ha), medium- (~1000 stems/ha), and high-density (~2000 stems/ha) conifer stands and coniferous and broad-leaved mixed forests (~1800 stems/ha), respectively. Compared with the classical individual tree segmentation methods (marker-controlled watershed segmentation and point cloud region-growing algorithm), our method obtained comparable performance in low-density conifer stands and superior performance in the other stands. Furthermore, the region-merging algorithm could detect 10% more suppressed trees on average, which led to an apparent improvement in detection accuracy. The proposed algorithm provides a flexible segmentation framework that could be further improved by a different design that merges costs or applies multiscale segmentation with different stopping criteria.

Individual tree segmentation (ITS) from terrestrial laser scanning (TLS) point clouds is foundational for deriving detailed forest structural parameters, crucial for precision forestry, biomass calculation, and carbon accounting. Conventional ITS algorithms often struggle in complex forest stands due to reliance on heuristic rules and manual feature engineering. Deep learning methodologies proffer more efficacious and automated solutions, but their segmentation accuracy is restricted by imprecise center offset predictions, particularly in intricate forest environments. To address this issue, we proposed a deep learning method, SPA-Net, for achieving tree instance segmentation of forest point clouds. Unlike methods heavily reliant on potentially error-prone global offset vector predictions, SPA-Net employs a novel sampling-shifting-grouping paradigm within its sparse geometric proposal (SGP) module to directly generate initial proposal candidates from raw point data, aiming to reduce dependence on the offset branch. Subsequently, an affinity aggregation (AA) module robustly refines these proposals by assessing inter-proposal relationships and merging fragmented segments, effectively mitigating oversegmentation of large or complex trees; integrating with SGP eliminates the postprocessing step of scoring/NMS. SPA-Net was rigorously validated on two different forest datasets. On both BaiMa and Hong-Tes Lake datasets, the approach demonstrated superior performance compared to several contemporary segmentation approaches evaluated under the same conditions. It achieved 95.8% precision, 96.3% recall, and 92.9% coverage on BaiMa dataset, and achieved 92.6% precision, 94.8% recall, and 88.8% coverage on the Hong-Tes Lake dataset. This study provides a robust tool for individual tree analysis, advancing the accuracy of individual tree segmentation in challenging forest environments.

Segmentation of vegetation LiDAR point clouds is an important method for obtaining individual tree structure parameters. The current individual tree segmentation methods are mainly for airborne LiDAR point clouds, which use elevation information to form a grid map for segmentation, or use canopy vertices as seed points for clustering. Side-view LiDAR (vehicle LiDAR and hand-held LiDAR) can acquire more information about the lower layer of trees, but it is a challenge to perform the individual tree segmentation because the structure of side-view LiDAR point clouds is more complex. This paper proposes an individual tree segmentation method called Shadow-cut to extract the contours of the street tree point cloud. Firstly, we separated the region of the trees using the binary classifier (e.g., support vector machine) based on point cloud geometric features. Then, the optimal projection of the 3D point clouds to the 2D image is calculated and the optimal projection is the case where the pixels of the individual tree image overlap the least. Finally, after using the image segmentation algorithm to extract the tree edges in the 2D image, the corresponding 3D individual tree point cloud contours are matched with the pixels of individual tree edges in the 2D image. We conducted experiments with the proposed method on LiDAR data of urban street trees, and the correctness, completeness, and quality of the proposed individual tree segmentation method reached 91.67%, 85.33%, and 79.19%, which were superior to the CHM-based method by 2.70%, 6.19%, and 7.12%, respectively. The results show that this method is a practical and effective solution for individual tree segmentation in the LiDAR point clouds of street trees.

Forests are the main part of the terrestrial ecosystem. Airborne LiDAR is fast, comprehensive, penetrating, and contactless and can depict 3D canopy information with a high efficiency and accuracy. Therefore, it plays an important role in forest ecological protection, tree species recognition, carbon sink calculation, etc. Accurate recognition of individual trees in forests is a key step to various application. In real practice, however, the accuracy of individual tree segmentation (ITS) is often compromised by under-segmentation due to the diverse species, obstruction and understory trees typical of a high-density multistoried mixed forest area. Therefore, this paper proposes an ITS optimization method based on Gaussian mixture model for airborne LiDAR data. First, the mean shift (MS) algorithm is used for the initial ITS of the pre-processed airborne LiDAR data. Next, under-segmented samples are extracted by integrated learning, normally segmented samples are classified by morphological approximation, and the approximate distribution uncertainty of the normal samples is described with a covariance matrix. Finally, the class composition among the under-segmented samples is determined, and the under-segmented samples are re-segmented using Gaussian mixture model (GMM) clustering, in light of the optimal covariance matrix of the corresponding categories. Experiments with two datasets, Trento and Qingdao, resulted in ITS recall of 94% and 96%, accuracy of 82% and 91%, and F-scores of 0.87 and 0.93. Compared with the MS algorithm, our method is more accurate and less likely to under-segment individual trees in many cases. It can provide data support for the management and conservation of high-density multistoried mixed forest areas.

Structural changes in savanna trees vary spatially and temporally because of both biotic and abiotic drivers, as well as the complex interactions between them. Given this complexity, it is essential to monitor and quantify woody structural changes in savannas efficiently. We implemented a non-destructive approach based on Terrestrial Laser Scanning (TLS) and Quantitative Structure Models (QSMs) that offers the unique advantage of investigating changes in complex tree parameters, such as volume and branch length parameters that have not been previously reported for savanna trees. Leaf-off multi-scan TLS point clouds were acquired during the dry season, using a Riegl VZ1000 TLS, in September 2015 and October 2019 at the Skukuza flux tower in Kruger National Park, South Africa. These three-dimensional (3D) data covered an area of 15.2 ha with an average point density of 4270 points/m2 (0.015°) and 1600 points/m2 (0.025°) for the 2015 and 2019 clouds, respectively. Individual tree segmentation was applied on the two clouds using the comparative shortest-path algorithm in LiDAR 360(v5.4) software. We reconstructed optimized QSMs and assessed tree structural parameters such as Diameter at Breast Height (DBH), tree height, crown area, volume, and branch length at individual tree level. The DBH, tree height, crown area, and trunk volume showed significant positive correlations (R2 > 0.80) between scanning periods regardless of the difference in the number of points of the matched trees. The opposite was observed for total and branch volume, total number of branches, and 1st-order branch length. As the difference in the point densities increased, the difference in the computed parameters also increased (R2 < 0.63) for a high relative difference. A total of 45% of the trees present in 2015 were identified in 2019 as damaged/felled (75 trees), and the volume lost was estimated to be 83.4 m3. The results of our study showed that volume reconstruction algorithms such as TreeQSMs and high-resolution TLS datasets can be used successfully to quantify changes in the structure of savanna trees. The results of this study are key in understanding savanna ecology given its complex and dynamic nature and accurately quantifying the gains and losses that could arise from fire, drought, herbivory, and other abiotic and biotic disturbances.

Contextualising archaeological models with geological, airborne and terrestrial LiDAR data: The Ice Age landscape in Farndon Fields, Nottinghamshire, UK

Routine bridge inspections require labor intensive and highly subjective visual interpretation to determine bridge deck surface condition. Light Detection and Ranging (LiDAR) a relatively new class of survey instrument has become a popular and increasingly used technology for providing as-built and inventory data in civil applications. While an increasing number of private and governmental agencies possess terrestrial and mobile LiDAR systems, an understanding of the technology’s capabilities and potential applications continues to evolve. LiDAR is a line-of-sight instrument and as such, care must be taken when establishing scan locations and resolution to allow the capture of data at an adequate resolution for defining features that contribute to the analysis of bridge deck surface condition. Information such as the location, area, and volume of spalling on deck surfaces, undersides, and support columns can be derived from properly collected LiDAR point clouds. The LiDAR point clouds contain information that can provide quantitative surface condition information, resulting in more accurate structural health monitoring. LiDAR scans were collected at three study bridges, each of which displayed a varying degree of degradation. A variety of commercially available analysis tools and an independently developed algorithm written in ArcGIS Python (ArcPy) were used to locate and quantify surface defects such as location, volume, and area of spalls. The results were visual and numerically displayed in a user-friendly web-based decision support tool integrating prior bridge condition metrics for comparison. LiDAR data processing procedures along with strengths and limitations of point clouds for defining features useful for assessing bridge deck condition are discussed. Point cloud density and incidence angle are two attributes that must be managed carefully to ensure data collected are of high quality and useful for bridge condition evaluation. When collected properly to ensure effective evaluation of bridge surface condition, LiDAR data can be analyzed to provide a useful data set from which to derive bridge deck condition information.

Above‐ground biomass (AGB) is an important metric used to quantify the mass of carbon stored in terrestrial ecosystems. For forests, this is routinely estimated at the plot scale (typically 1 ha) using inventory measurements and allometry. In recent years, terrestrial laser scanning (TLS) has appeared as a disruptive technology that can generate a more accurate assessment of tree and plot scale AGB; however, operationalising TLS methods has had to overcome a number of challenges. One such challenge is the segmentation of individual trees from plot level point clouds that are required to estimate woody volume, this is often done manually (e.g. with interactive point cloud editing software) and can be very time consuming. Here we present TLS2trees , an automated processing pipeline and set of Python command line tools that aims to redress this processing bottleneck. TLS2trees consists of existing and new methods and is specifically designed to be horizontally scalable. The processing pipeline is demonstrated on 7.5 ha of TLS data captured across 10 plots of seven forest types; from open savanna to dense tropical rainforest. A total of 10,557 trees are segmented with TLS2trees : these are compared to 1281 manually segmented trees. Results indicate that TLS2trees performs well, particularly for larger trees (i.e. the cohort of largest trees that comprise 50% of total plot volume), where plot‐wise tree volume bias is ±0.4 m 3 and %RMSE is 60%. Segmentation performance decreases for smaller trees, for example where DBH ≤10 cm; a number of reasons are suggested including performance of semantic segmentation step. The volume and scale of TLS data captured in forest plots is increasing. It is suggested that to fully utilise this data for activities such as monitoring, reporting and verification or as reference data for satellite missions an automated processing pipeline, such as TLS2trees , is required. To facilitate improvements to TLS2trees , as well as modification for other laser scanning modes (e.g. mobile and UAV laser scanning), TLS2trees is a free and open‐source software.

As fundamental units of forest ecosystems, individual trees provide essential structural characteristics for forest resource assessment. However, existing LiDAR-based individual tree segmentation methods are often limited by a trade-off between information preservation and computational efficiency. This study proposes a novel framework for individual tree segmentation from LiDAR data based on canopy surface points (CSP), aiming to balance this trade-off. The framework introduces a Snow-Covered Filter (SCF) that simulates snow deposition to extract surface points from the point cloud. After removing ground points from these surface points, the resulting CSP retains the core 3D structure of the canopy while significantly reducing data volume. We validate the proposed framework on four multi-platform datasets using four algorithms that represent the evolution of individual tree segmentation methods: Dalponte2016, K-means, Li2012, and SegmentAnyTree. The results demonstrate that: (a) the SCF effectively extracts surface points, with an average F1-score of 0.703; (b) segmentation using CSP achieves accuracy comparable to that obtained using all points or raster data (mean ΔF = 0.027), with the primary gap observed for SegmentAnyTree (maximum F-score reduction of 0.259); (c) the framework offers substantial efficiency gains: >40% point reduction, ~38.4% average runtime reduction (maximum saving ~4660 s), and lower memory consumption. By providing a lightweight yet structurally rich data representation, this work presents an innovative and efficient approach to individual tree segmentation, with promising potential for large-scale forest resource management.

Accurate detection and segmentation of individual trees from unmanned aerial vehicle images is critical for forestry resource surveys and accurate forest management. Deep learning methods have been used for studies of individual tree crown segmentation, classification, and number of trees in mixed coniferous and broad-leaved forests, but the accuracy needs to be improved. Therefore, this study uses BlendMask, a simpler and more efficient algorithm that combines Mask R-CNN and Yolact algorithms to effectively combine instance-level information with semantic information at a finer granularity level, greatly improving crown segmentation accuracy and classification results. Three coniferous species and five broad-leaved species unmanned aerial vehicle images collected from the Jing Yue multispecies ecological forestry site in Changping District, Beijing, were used as the dataset, and the results were compared with Yolact and Mask R-CNN. The results show that the method described in this work has the highest Kappa coefficient (0.89) and overall accuracy (92.14%) in the test set. For segmentation accuracy, coniferous species’ producer’s accuracy was 0.91 to 0.95, whereas that of broad-leaved species was 0.89 to 0.92. For species classification, the F1-score and mean average precision for coniferous species were greater than 91%, whereas those for broad-leaved species were 77.64% to 85.63%. The accuracy of extracting stand density in low and medium canopy density stands was 0.9909 and 0.9422, respectively, whereas that in high canopy density stands was 0.8913. This study shows that the BlendMask model has a good effect in studying the classification of multiple tree species, the segmentation of individual tree crowns, and the statistics of the number of trees in complex forest areas. Compared with broad-leaved forests and high canopy density stands, this model is more suitable for coniferous forest and medium and low canopy density stand scenarios. This study provides an important tool for obtaining more accurate species classification, canopy segmentation, and resource inventory results in complex forest areas.

Quantitative structural analysis is a useful approach for studying geologic structures. It is particularly important in remote and complex fold-thrust belts where outcrop data and high-quality seismic reflection images are challenging to obtain. In this study, we integrated terrestrial light detection and ranging (LiDAR), unmanned aerial vehicle (UAV), and Landsat 8 (L8) data to extract high-resolution topographic and surface geologic information and constrain interpretations of three-dimensional (3-D) seismic reflection data in the Hero Range of the Qaidam Basin (QB) in northwestern China. UAV images were used to obtain a digital elevation model (DEM) and to measure the orientation of sedimentary bedding. Terrestrial LiDAR data were used to generate high-resolution digital outcrops and to evaluate the accuracy of the UAV-based DEM. L8 images were used to distinguish different stratigraphic units. The random sample consensus (RANSAC) algorithm was adopted to ascertain the best-fit plane of bedding. The results show that UAV images can be used to construct a DEM with <;1 m resolution and orthophotos with 0.15-m resolution. Collectively, these data improve the ability to identify and measure small exposures of bedding surfaces. The RANSAC algorithm improves the accuracy of measuring bedding orientations by removing erroneous selection points and facilitating the recognition of second-order variations in bedding orientation. The integrated analysis of remotely sensed and 3-D seismic data indicates that, of the three anticlines within the Hero Range, two are fault-propagation folds (the Shizigou and Youshashan anticlines) and one is associated with a pop-up structure (Ganchaigou anticline).

The spectral clustering method has notable advantages in segmentation. But the high computational complexity and time consuming limit its application in large-scale and dense airborne Light Detection and Ranging (LiDAR) point cloud data. We proposed the Nyström-based spectral clustering (NSC) algorithm to decrease the computational burden. This novel NSC method showed accurate and rapid in individual tree segmentation using point cloud data. The K-nearest neighbour-based sampling (KNNS) was proposed for the Nyström approximation of voxels to improve the efficiency. The NSC algorithm showed good performance for 32 plots in China and Europe. The overall matching rate and extraction rate of proposed algorithm reached 69% and 103%. For all trees located by Global Navigation Satellite System (GNSS) calibrated tape-measures, the tree height regression of the matching results showed an value of 0.88 and a relative root mean square error (RMSE) of 5.97%. For all trees located by GNSS calibrated total-station measures, the values were 0.89 and 4.49%. The method also showed good performance in a benchmark dataset with an improvement of 7% for the average matching rate. The results demonstrate that the proposed NSC algorithm provides an accurate individual tree segmentation and parameter estimation using airborne LiDAR point cloud data.

ABSTRACTThis letter aims to propose an automatic method for the segmentation of street trees from LiDAR point clouds. The first step is to extract tree points to reduce the scale of data to be processed. The second step is to formulate supervoxels for grouping homogeneous points. The third step is to optimize the segmentation of individual trees based on the minimum distance rule. Each supervoxel will be assigned the same tree index as its spatially closest treetop supervoxel, therefore, points from the homogeneous region sharing the same tree index. Experiments show that we achieve the completeness of 78.5%, correctness of 94.5% and -score of 0.85 in the airborne LiDAR data. For mobile LiDAR data our accuracy is 100, 93.8% and 0.96 in terms of the recall, precision and -score, respectively.