Tightly Coupled LiDAR-Inertial Odometry and Mapping for Underground Environments.

Point cloud registration is a central theme in computer vision, with alignment algorithms continuously improving for greater robustness. Commonly used methods evaluate Euclidean distances between point clouds and minimize an objective function, such as Root Mean Square Error (RMSE). However, these approaches are most effective when the point clouds are well-prealigned and issues such as differences in density, noise, holes, and limited overlap can compromise the results. Traditional methods, such as Iterative Closest Point (ICP), require choosing one point cloud as fixed, since Euclidean distances lack commutativity. When only one point cloud has issues, adjustments can be made, but in real scenarios, both point clouds may be affected, often necessitating preprocessing. The authors introduce a novel differential entropy-based metric, designed to serve as the objective function within an optimization framework for fine rigid pairwise 3D point cloud registration, denoted as Iterative Differential Entropy Minimization (IDEM). This metric does not depend on the choice of a fixed point cloud and, during transformations, reveals a clear minimum corresponding to the best alignment. Multiple case studies are conducted, and the results are compared with those obtained using RMSE, Chamfer distance, and Hausdorff distance. The proposed metric proves effective even with density differences, noise, holes, and partial overlap, where RMSE does not always yield optimal alignment.

Scanning electron microscopy (SEM) has an important application in the petroleum field, which is often used to analyze the microstructure of reservoir rocks, etc. Most of these analyses are based on two-dimensional images. In fact, SEM can carry out micro-nano scale three-dimensional measurement, and three-dimensional models can provide more accurate information than two-dimensional images. Among the commonly used SEM 3D reconstruction methods, parallax depth mapping is the most commonly used method. Multiple SEM images can be obtained by continuously tilting the sample table at a certain Angle, and multiple point clouds can be generated according to the parallax depth mapping method, and a more complete point clouds recovery can be achieved by combining the point clouds registration. However, the root mean square error of the point clouds generated by this method is relatively large and unstable after participating in point clouds registration. Therefore, this paper proposes a new method for generating point clouds. Firstly, the sample stage is rotated by a certain angle to obtain two SEM images. This operation makes the rotation matrix a known quantity. Then, based on the imaging model, an equation system is constructed to estimate the unknown translation parameters, and finally, triangulation is used to obtain the point clouds. The method proposed in this paper was tested on a publicly available 3D SEM image set, and the results showed that compared to the disparity depth mapping method, the point clouds generated by our method showed a significant reduction in root mean square error and relative rotation error in point clouds registration.

Among emerging 3D scanning and imaging techniques that are commercially available, simultaneous localization and mapping (SLAM) is being substantially studied to generate 2D/3D maps of an unknown environment while reliably keeping track of the user’s pinpoint locations. Its ubiquitous mobility has demonstrated great mapping capabilities for infrastructures where vertical information may frequently be occluded using unmanned aircraft system (UAS) structure from-motion (SfM) photogrammetry. In addition, indoor mapping with terrestrial laser scanning can be a cumbersome task due to possible multiple scan locations. Intending to provide a cohesive 3D model by fusing point clouds collected via aerial SfM photogrammetry, terrestrial laser scanning (TLS), and SLAM, the purpose of this work is to assess the performance of SLAM point cloud generated by a proprietary mobile backpack laser scanner (BLS). Considering maximum scanning range and information integration strategy as variables, the point clouds generated by the BLS were evaluated against SfM and TLS datasets in terms of the internal consistency as well as external accuracy. TLS, SfM and SAM data collection efforts were made in a typical university campus environment. For the internal consistency, the SLAM-based point cloud with a maximum scanning range of 70 m presented a root mean square error (RMSE) of 2 mm. The SLAM+GNSS-based point cloud presented the lowest internal precision of RMSE = 0.861 m. The SLAM+GNSS 70 point cloud after a fine adjustment of misalignment presented the highest vertical accuracy with an RMSE = 0.069 m, while the point cloud generated from SfM photogrammetry presented RMSE = 0.297 m. The BLS was able to generate point cloud with an accuracy similar to GNSS-RTK surveying and it can be considered as a viable solution for indoor and outdoor mapping applications.

Unmanned mining is one of the most effective methods to solve mine safety and low efficiency. However, it is the key to accurate localization and mapping for underground mining environment. A novel graph simultaneous localization and mapping (SLAM) optimization method is proposed, which is based on Generalized Iterative Closest Point (GICP) three-dimensional (3D) point cloud registration between consecutive frames, between consecutive key frames and between loop frames, and is constrained by roadway plane and loop. GICP-based 3D point cloud registration between consecutive frames and consecutive key frames is first combined to optimize laser odometer constraints without other sensors such as inertial measurement unit (IMU). According to the characteristics of the roadway, the innovative extraction of the roadway plane as the node constraint of pose graph SLAM, in addition to automatic removing the noise point cloud to further improve the consistency of the underground roadway map. A lightweight and efficient loop detection and optimization based on rules and GICP is designed. Finally, the proposed method was evaluated in four scenes (such as the underground mine laboratory), and compared with the existing 3D laser SLAM method (such as Lidar Odometry and Mapping (LOAM)). The results show that the algorithm could realize low drift localization and point cloud map construction. This method provides technical support for localization and navigation of underground mining environment.

Framework for automated registration of UAV and UGV point clouds using local features in images

The dense high-rise buildings and multipath effects in urban areas significantly reduce the positioning signal accuracy of laser scanning systems, leading to layering and offset issues in the collected point cloud data on the same road. In order to acquire comprehensive and consistent three-dimensional information on the objects, thereby providing field inspection data for large-scale road traffic network scenarios, in this paper, an improved point cloud registration method is proposed to divide the registration process into two stages: elevation registration and plane registration. Elevation registration takes the ground point cloud as the registration primitive, reduces the number of point clouds through curvature down-sampling, and constrains the feature point sequence with a fixed range to provide a good initial pose for fine registration. The plane registration first inherits the elevation registration parameters, combining the dynamic distance parameters of spherical region step based on the median, using robust multi-scale loss functions to address residual points, effective adjacent point pairs are selected to obtain the spatial transformation matrix, and realizes accurate registration. Experimental results with multiple sets of urban point cloud data show that the root mean square error of point cloud registration can be controlled within 0.06 m, achieving a relatively superior registration accuracy, it can provide detailed prior data for measurement information analysis.

Above-ground biomass (AGB) plays a pivotal role in assessing a forest’s resource dynamics, ecological value, carbon storage, and climate change effects. The traditional methods of AGB measurement are destructive, time consuming and laborious, and an efficient, relatively accurate and non-destructive AGB measurement method will provide an effective supplement for biomass calculation. Based on the real biophysical and morphological structures of trees, this paper adopted a non-destructive method based on terrestrial laser scanning (TLS) point cloud data to estimate the AGBs of multiple common tree species in boreal forests of China, and the effects of differences in bark roughness and trunk curvature on the estimation of the diameter at breast height (DBH) from TLS data were quantitatively analyzed. We optimized the quantitative structure model (QSM) algorithm based on 100 trees of multiple tree species, and then used it to estimate the volume of trees directly from the tree model reconstructed from point cloud data, and to calculate the AGBs of trees by using specific basic wood density values. Our results showed that the total DBH and tree height from the TLS data showed a good consistency with the measured data, since the bias, root mean square error (RMSE) and determination coefficient (R2) of the total DBH were −0.8 cm, 1.2 cm and 0.97, respectively. At the same time, the bias, RMSE and determination coefficient of the tree height were −0.4 m, 1.3 m and 0.90, respectively. The differences of bark roughness and trunk curvature had a small effect on DBH estimation from point cloud data. The AGB estimates from the TLS data showed strong agreement with the reference values, with the RMSE, coefficient of variation of root mean square error (CV(RMSE)), and concordance correlation coefficient (CCC) values of 17.4 kg, 13.6% and 0.97, respectively, indicating that this non-destructive method can accurately estimate tree AGBs and effectively calibrate new allometric biomass models. We believe that the results of this study will benefit forest managers in formulating management measures and accurately calculating the economic and ecological benefits of forests, and should promote the use of non-destructive methods to measure AGB of trees in China.

In a point cloud registration task, the feature extraction ability of the network directly affects the final registration effect. Previous work has tended to ignore the local information of point clouds and the context information between two point clouds in the feature extraction. To overcome the poor feature extraction ability and lack of robustness of existing registration algorithms, this paper, inspired by the graph attention network, proposes a learning-based point cloud registration framework that uses the existing network to extract point cloud features. We call it CPCRNet. Furthermore, a Capture module based on graph attention (GAT) is proposed to re-integrate the point cloud context information. Experimental results indicate that Capture, the core feature extraction module in the network, has a significant impact on the registration effect, with a mean square error, root mean square error, and mean absolute error between the ground truth and predicted values lower than those of competing methods. Moreover, experimental results for ModelNet40 and ShapeNet Part datasets show that the errors are not significantly changed by noise, indicating that CPCRNet has higher registration accuracy and better robustness compared to existing algorithms.

With the advancement of sensor technologies such as LiDAR and depth cameras, the significance of three-dimensional point cloud data in autonomous driving and environment sensing continues to increase.Point cloud registration stands as a fundamental task in constructing high-precision environmental models, with particular significance in overlapping regions where the accuracy of feature extraction and matching directly impacts registration quality. Despite advancements in deep learning approaches, existing methods continue to demonstrate limitations in extracting comprehensive features within these overlapping areas. This study introduces an innovative point cloud registration framework that synergistically combines the K-nearest neighbor (KNN) algorithm with a channel attention mechanism (CAM) to significantly enhance feature extraction and matching capabilities in overlapping regions. Additionally, by designing an effectiveness scoring network, the proposed method improves registration accuracy and enhances system robustness in complex scenarios. Comprehensive evaluations on the ModelNet40 dataset reveal that our approach achieves markedly superior performance metrics, demonstrating significantly lower root mean square error (RMSE) and mean absolute error (MAE) compared to established methods including iterative closest point (ICP), Robust & Efficient Point Cloud Registration using PointNet (PointNetLK), Go-ICP, fast global registration (FGR), deep closest point (DCP), self-supervised learning for a partial-to-partial registration (PRNet), and Iterative Distance-Aware Similarity Matrix Convolution (IDAM). This performance advantage is consistently maintained across various challenging conditions, including unseen shapes, novel categories, and noisy environments. Furthermore, additional experiments on the Stanford dataset validate the applicability and robustness of the proposed method for high-precision 3D shape registration tasks.

Abstract. The registration of ground laser point cloud and close-range image is the key content of high-precision 3D reconstruction of cultural relic object. In view of the requirement of high texture resolution in the field of cultural relic at present, The registration of point cloud and image data in object reconstruction will result in the problem of point cloud to multiple images. In the current commercial software, the two pairs of registration of the two kinds of data are realized by manually dividing point cloud data, manual matching point cloud and image data, manually selecting a two – dimensional point of the same name of the image and the point cloud, and the process not only greatly reduces the working efficiency, but also affects the precision of the registration of the two, and causes the problem of the color point cloud texture joint. In order to solve the above problems, this paper takes the whole object image as the intermediate data, and uses the matching technology to realize the automatic one-to-one correspondence between the point cloud and multiple images. The matching of point cloud center projection reflection intensity image and optical image is applied to realize the automatic matching of the same name feature points, and the Rodrigo matrix spatial similarity transformation model and weight selection iteration are used to realize the automatic registration of the two kinds of data with high accuracy. This method is expected to serve for the high precision and high efficiency automatic 3D reconstruction of cultural relic objects, which has certain scientific research value and practical significance.

LiDAR plays a pivotal role in the field of unmanned driving, but in actual use, it is often accompanied by errors caused by point cloud distortion, which affects the accuracy of various downstream tasks. In this paper, we first describe the feature of point cloud and propose a new feature point selection method Soft-NMS-Select; this method can obtain uniform feature point distribution and effectively improve the result of subsequent point cloud registration. Then, the point cloud registration is completed through the screened feature points, and the odometry information is obtained. For the motion distortion generated in a sweep, the prior information of the LiDAR’s own motion is obtained by using two linear interpolations, thereby improving the effect of motion compensation. Finally, for the distortion caused by the motion of objects in the scene, Euclidean clustering is used to obtain the position and normal vector of the center point of the point cloud cluster, and the motion pose of the object is calculated according to the offset between adjacent sweeps and eliminated distortion. Essentially, our method is a general point cloud compensation method that is applicable to all uses of LiDAR. This paper inserts this method into three SLAM algorithms to illustrate the effectiveness of the method proposed in this paper. The experimental results show that this method can significantly reduce the APE of the original SLAM algorithm and improve the mapping result.

Accurate estimation of tree position, diameter at breast height (DBH), and tree height measurements is an important task in forest inventory. Mobile Laser Scanning (MLS) is an important solution. However, the poor global navigation satellite system (GNSS) coverage under the canopy makes the MLS system unable to provide globally-consistent point cloud data, and thus, it cannot accurately estimate the forest attributes. SLAM could be an alternative for solutions dependent on GNSS. In this paper, a mobile phone with RGB-D SLAM was used to estimate tree position, DBH, and tree height in real-time. The main aims of this paper include (1) designing an algorithm to estimate the DBH and position of the tree using the point cloud from the time-of-flight (TOF) camera and camera pose; (2) designing an algorithm to measure tree height using the perspective projection principle of a camera and the camera pose; and (3) showing the measurement results to the observer using augmented reality (AR) technology to allow the observer to intuitively judge the accuracy of the measurement results and re-estimate the measurement results if needed. The device was tested in nine square plots with 12 m sides. The tree position estimations were unbiased and had a root mean square error (RMSE) of 0.12 m in both the x-axis and y-axis directions; the DBH estimations had a 0.33 cm (1.78%) BIAS and a 1.26 cm (6.39%) root mean square error (RMSE); the tree height estimations had a 0.15 m (1.08%) BIAS and a 1.11 m (7.43%) RMSE. The results showed that the mobile phone with RGB-D SLAM is a potential tool for obtaining accurate measurements of tree position, DBH, and tree height.

Terrestrial laser scanners have achieved great popularity in the last decade. Their easy on-site application and the possibility of flexible and high quality post processing added to their success in several fields such as architectural, archaeological, and heritage documentation. We present a method for handling the automatic registration of point clouds which are characterized by significant noise level, generally imperfect geometry and occlusions. Hereby we combine and extend already existing and established methods to facilitate the registration of point clouds without prior pre-processing. Our approach consists—similar to other methods—of three steps which are scan analysis, pair-wise registration, and global registration. To handle the abovementioned datasets we propose to use imperfect and subdivided features, and to implement Genetic Algorithms (GAs). At the same time our approach can be seen as extension to already known Genetic Algorithms used for the registration of point clouds. By implementing an adapted version of a Genetic Algorithm in the classical registration process between rough alignment and fine registration, we are able to maintain robustness and computational performance also when registering point clouds of bigger objects characterized by a notably increased number of points, a significant noise level, and occlusions. We show and discuss the successful application of the algorithm on a scene which does not consist of classical geometric primitives such as planes.

Information on a crop’s three-dimensional (3D) structure is important for plant phenotyping and precision agriculture (PA). Currently, light detection and ranging (LiDAR) has been proven to be the most effective tool for crop 3D characterization in constrained, e.g., indoor environments, using terrestrial laser scanners (TLSs). In recent years, affordable laser scanners onboard unmanned aerial systems (UASs) have been available for commercial applications. UAS laser scanners (ULSs) have recently been introduced, and their operational procedures are not well investigated particularly in an agricultural context for multi-temporal point clouds. To acquire seamless quality point clouds, ULS operational parameter assessment, e.g., flight altitude, pulse repetition rate (PRR), and the number of return laser echoes, becomes a non-trivial concern. This article therefore aims to investigate DJI Zenmuse L1 operational practices in an agricultural context using traditional point density, and multi-temporal canopy height modeling (CHM) techniques, in comparison with more advanced simulated full waveform (WF) analysis. Several pre-designed ULS flights were conducted over an experimental research site in Fargo, North Dakota, USA, on three dates. The flight altitudes varied from 50 m to 60 m above ground level (AGL) along with scanning modes, e.g., repetitive/non-repetitive, frequency modes 160/250 kHz, return echo modes (1n), (2n), and (3n), were assessed over diverse crop environments, e.g., dry corn, green corn, sunflower, soybean, and sugar beet, near to harvest yet with changing phenological stages. Our results showed that the return echo mode (2n) captures the canopy height better than the (1n) and (3n) modes, whereas (1n) provides the highest canopy penetration at 250 kHz compared with 160 kHz. Overall, the multi-temporal CHM heights were well correlated with the in situ height measurements with an R2 (0.99–1.00) and root mean square error (RMSE) of (0.04–0.09) m. Among all the crops, the multi-temporal CHM of the soybeans showed the lowest height correlation with the R2 (0.59–0.75) and RMSE (0.05–0.07) m. We showed that the weaker height correlation for the soybeans occurred due to the selective height underestimation of short crops influenced by crop phonologies. The results explained that the return echo mode, PRR, flight altitude, and multi-temporal CHM analysis were unable to completely decipher the ULS operational practices and phenological impact on acquired point clouds. For the first time in an agricultural context, we investigated and showed that crop phenology has a meaningful impact on acquired multi-temporal ULS point clouds compared with ULS operational practices revealed by WF analyses. Nonetheless, the present study established a state-of-the-art benchmark framework for ULS operational parameter optimization and 3D crop characterization using ULS multi-temporal simulated WF datasets.

Point cloud registration is of great significance to the reconstruction of high‐precision 3D city models. There are some challenges when aligning aerial and close‐range photogrammetric point clouds, such as huge view differences caused by the different sights of the sensors, massive noisy points due to the error in dense matching, and scale uncertainty since there are no control points for absolute orientation. To achieve complementary advantages of aerial and close‐range point clouds, in this paper, a robust cross‐source point clouds registration method is proposed using image visual context features and scale consistency. First, a cross‐view image matching method based on image visual context features is proposed to obtain corresponding points. Second, to overcome the challenges of noisy points and scale differences, an outlier filtering method is designed based on scale consistency. Finally, the dual quaternions model considering the scale factor is introduced to solve the spatial transformation model. To analyze the feasibility of this method qualitatively and quantitatively, experiments are conducted using the public scene dataset of Dortmund, Germany, and the scene dataset of Zhengzhou City, China. Three kinds of cross‐source point clouds registration experiments are conducted in this paper, including aerial and close‐range point clouds registration in Dortmund, and aerial and ground point clouds registrations in both Dortmund and Zhengzhou. The chamfer distances of the three sets of experiments are 4.48 m, 5.97 m and 4.78 m, respectively. The ablation study shows that the outlier filtering method and the dual quaternions model improve the accuracy by at least 14% and 25%, respectively. The experiments demonstrate that the method accomplishes the cross‐source point clouds registration in large‐scale scenes accurately and efficiently, providing a solid foundation for subsequent fine 3D reconstruction.