An Improved ICP Algorithm Based on the Sensor Projection for Automatic 3D Registration

In this study, a new automatic point cloud registration algorithm based on point cloud registration is proposed to broaden registration ways. The proposed method extracts features of point cloud region for performing the coarse registration. Based on the coarse registration results, the Iterative Closest Point (ICP) algorithm is used for performing the fine registration to restore the measured model. The proposed registration approach is able to do automatic registration without any assumptions about initial positions, and avoid the problems of traditional ICP algorithm in the bad initial estimation. The proposed method along with ICP algorithm provides efficient 3D modeling for computer-aided engineering, computer-aided design and application with Kinect.

The iterative closest point (ICP) algorithm is widely used in three-dimensional (3D) point cloud registration, and it is very stable and robust. However, its biggest drawback is being easily trapped in a local optimal solution, which results in the incorrect registration result. Currently, there is neither a clear effective range to define whether the ICP algorithm will fall into a local optimum nor a study providing a comprehensive evaluation of the ICP algorithm. In this paper, we take the overlap ratio, angle, distance, and noise as the influencing factors of ICP and evaluate the validity, robustness, accuracy, and efficiency of point-to-point and point-to-plane ICP by using four datasets. We first analyze the effective ranges of the two ICP algorithms with respect to overlap ratio, angle, and distance and then propose a universal effective range for the three factors. Next, the effect of Gaussian noise on the validity and accuracy of two ICPs is evaluated. We also analyze the factors influencing ICP accuracy and explain their changing rules. We finally study the effect of different parameters on the efficiency. All results are compared by using point-to-point and point-to-plane ICP algorithms. The results show that the overlap ratio has no effect on validity, but it has a significant influence on accuracy. The angle has a great impact on the validity and efficiency of ICP but has no effect on accuracy. The distance only affects validity, has a limited effect on efficiency and no effect on accuracy. Meanwhile, Gaussian noise has a little effect on the validity. In addition, the general effective range of point-to-point ICP is larger than that of point-to-plane ICP, but the point-to-plane ICP algorithm presents a better efficiency. The point-to-point ICP is more robust to Gaussian noise with respect to validity, while the point-to-plane is more resistant in terms of accuracy.

I present an innovative registration algorithm using the particle flow filter. The particle flow filter is a Bayesian filter that uses particles to represent probability densities. The particle flow filter is not constrained to the highly restrictive unimodal, linear, and Gaussian assumptions of many Bayesian filters such as the Kalman filter. Additionally, the particle flow filter is computationally more efficient than other multimodal filters such as the better-known particle filter (PF). Unlike the PF, the particle flow filter does not require particle resampling or importance weight updates. Rather, the proposal density is formed by flowing the prior probability to the posterior using the Fokker–Planck equation. The particle flow filter algorithms were implemented using MATLAB. Both 2D and 3D rigid body point-set registration were conducted using the Gromov particle flow filter variant. Additionally, the PF method and iterative closest point (ICP) algorithms were implemented for comparison. For the same alignment accuracy, the new particle flow filter approach was 244% faster than the PF for certain challenging problems. For the same alignment time, the particle flow filter reduced misalignment by as much as 35% over that of the PF. The particle flow filter achieved 100% alignment with enough particles, and reduced misalignment by as much as 75% over that of ICP. These results demonstrate that image registration via the particle flow filter significantly outperforms the PF and ICP algorithms in the presence of noise and for a high degree of initial misalignment.

The accuracy of the iterative closest point (ICP) algorithm, which is widely employed in image registration, depends on the complexity of the shape of the object under registration. Objects with complex features yield higher reliability in estimating registration parameters. For objects with rotation symmetry, a cylinder for example, rotation along the center axis can not be distinguished. We derive the sensitivity of the rotation error of the ICP algorithm from the curvature of the error function near the minimum error position. We approximate the defined error function to a second order polynomial and show that the coefficient of the second-order term is related to the reliability of the estimated rotation angle. Also the coefficient is related to the shape of the object. In the known correspondence case, the reliability can be expressed by the second moment of the input image. Finally, we apply the sensitivity formula to a simple synthetic object and ellipses, and verify that the predicted orientation variance of the ICP algorithm is in good agreement with computer simulations.

Differential LiDAR (Light Detection and Ranging) from repeated surveys has recently emerged as an effective tool to measure three-dimensional (3D) change for applications, such as quantifying slip and spatially distributed warping associated with earthquake ruptures, and examining the spatial distribution of beach erosion after hurricane impact. Currently, the primary method for determining 3D change from LiDAR is through the use of the iterative closest point (ICP) algorithm and its variants. However, all current studies using ICP have assumed that all LiDAR points in the compared point clouds have uniform accuracy. This assumption is simplistic given that the error for each LiDAR point is variable, and dependent upon time varying factors such as target range, angle of incidence, and aircraft trajectory accuracy. Therefore, to rigorously determine spatial change, it would be ideal to model the random error for every LiDAR observation in the differential point cloud, and use these error estimates as apriori weights in the ICP algorithm. To test this approach, we implemented a rigorous LiDAR observation error propagation method to generate estimated random error for each point in a LiDAR point cloud, and then determine 3D displacements between two point clouds using an anisotropic weighted ICP (A-ICP) algorithm. The algorithm was evaluated by qualitatively and quantitatively comparing point clouds with synthetic fault ruptures between a uniform weight and anistropically weighted ICP algorithm. Then post-earthquake slip is estimated for the 2010 El Mayor-Cucapah Earthquake (EMC), using pre- and post-event LiDAR. Based on the analysis, Moving Window A-ICP is able to better estimate the synthetic surface ruptures, and provides a smoother estimate of actual displacement for the EMC earthquake.

Multisensor systems with optical 3D sensors are frequently employed to capture complete surface information by measuring workpieces from different views. During coarse and fine registration the resulting datasets are afterward transformed into one common coordinate system. Automatic fine registration methods are well established in dimensional metrology, whereas there is a deficit in automatic coarse registration methods. The advantage of a fully automatic registration procedure is twofold: it enables a fast and contact-free alignment and further a flexible application to datasets of any kind of optical 3D sensor. In this paper, an algorithm adapted for a robust automatic coarse registration is presented. The method was originally developed for the field of object reconstruction or localization. It is based on a segmentation of planes in the datasets to calculate the transformation parameters. The rotation is defined by the normals of three corresponding segmented planes of two overlapping datasets, while the translation is calculated via the intersection point of the segmented planes. First results have shown that the translation is strongly shape dependent: 3D data of objects with non-orthogonal planar flanks cannot be registered with the current method. In the novel supplement for the algorithm, the translation is additionally calculated via the distance between centroids of corresponding segmented planes, which results in more than one option for the transformation. A newly introduced measure considering the distance between the datasets after coarse registration evaluates the best possible transformation. Results of the robust automatic registration method are presented on the example of datasets taken from a cutting tool with a fringe-projection system and a focus-variation system. The successful application in dimensional metrology is proven with evaluations of shape parameters based on the registered datasets of a calibrated workpiece.

Image registration is an important problem and a fundamental task for understanding the internal organ or internal structure of human body, analyzing the temporal change from the image sets which is obtained different time series in computer vision and image processing field. Especially, CT and MR imaging of the head for diagnosis and surgical planning indicate that physicians and surgeons gain important information from these modalities. In radiotherapy planning, manual registration techniques are performed on MR and CT images of the brain. In general, physicians segment the volumes of interest (VOIs) from each set of slices on the MR and CT images manually. However, manual registration of the object area may require several hours for analysis based on anatomical knowledge. In this paper, to register two images which are obtained from different modalities we develop a new method for automatic registration of the head CT and MR images by using ICP (iterative closest point) algorithm in several extracted data and maximization of mutual information. One of the benefits of using the ICP algorithm is that computational costs can be reduced on the registration. The primary objective of this study is to increase the registration accuracy and reduce the computational processing time. The technique was applied to five real image sets which are obtained from the two different modalities and the satisfactory results are obtained. Some experimental results are shown with discussion.

Bin picking is an important task in smart manufacturing and intelligent robotics. For a robot to pick or grip an object with a human-like gripping action, it needs to know the accurate 3D pose of the object. In this paper, we propose a method for estimating the 3D pose of a small ring-shaped object using infrared and depth images generated by a depth camera. The proposed method consists of two algorithm modules, the first to recognize an object in a 2D infrared image and the second to estimate the 3D pose by applying the ICP (iterative closest point) algorithm to 3D depth data. In the first module, we propose a method to generate a three-channel integrated image with features from the depth and infrared images. Next, we introduce a method for training an object detector based on deep-learning. Because the bin-picking test object in this paper is small and ring-shaped, it is difficult to detect and find 3D poses of individual objects when many such objects are piled up. We solved this problem with a depth-based filtering method. Using the filtered image, each object region is separated by the deep learning approach. In the second module, the ICP algorithm is employed to estimate the 3D pose of the ring object. We match a 3D reference model of the object and the real object using the point-to-point ICP algorithm. Performance of the proposed method is evaluated by using two different types of depth camera in the experiments.

The problem of aligning of 3D point data is the known registration task. The most popular registration algorithm is the Iterative Closest Point (ICP) algorithm. The traditional ICP algorithm is a fast and accurate approach for rigid registration between two point clouds but it is unable to handle affine case. Recently, extension of the ICP algorithm for composition of scaling, rotation, and translation is proposed. A generalized ICP version for an arbitrary affine transformation is also suggested. In this paper, a new iterative algorithm for registration of point clouds based on the point-to-plane ICP algorithm with affine transformations is proposed. At each iteration, a closed-form solution to the affine transformation is derived. This approach allows us to get a precise solution for transformations such as rotation, translation, and scaling. With the help of computer simulation, the proposed algorithm is compared with common registration algorithms.

Airborne light detection and ranging (LiDAR) data are increasingly used in various fields such as topographic mapping, urban planning, and emergency management. A necessary processing step in the application of airborne LiDAR data is the elimination of mismatch errors. This paper proposes a new method for airborne LiDAR strip adjustment based on point clouds with planar neighborhoods; this method is intended to eliminate errors in airborne LiDAR point clouds. Initially, standard pre-processing tasks such as denoising, ground separation, and resampling are performed on the airborne LiDAR point clouds. Subsequently, this paper introduces a unique approach to extract point clouds with planar neighborhoods which is designed to enhance the registration accuracy of the iterative closest point (ICP) algorithm within the context of airborne LiDAR point clouds. Following the registration of the point clouds using the ICP algorithm, tie points are extracted via a point-to-plane projection method. Finally, a strip adjustment calculation is executed using the extracted tie points, in accordance with the strip adjustment equation for airborne LiDAR point clouds that was derived in this study. Three sets of airborne LiDAR point cloud data were utilized in the experiment outlined in this paper. The results indicate that the proposed strip adjustment method can effectively eliminate mismatch errors in airborne LiDAR point clouds, achieving a registration accuracy and absolute accuracy of 0.05 m. Furthermore, this method’s processing efficiency was more than five times higher than that of traditional methods such as ICP and LS3D.

Affine iterative closest point algorithm for point set registration

<title>Abstract</title> Wheels are critical components of railway vehicles, and the dynamic measurement of wheel parameters is of paramount importance for the safe operation of trains.To enhance the matching accuracy in the existing dynamic measurement processes for train wheel parameters, this paper proposes an improved point cloud registration algorithm based on key point fusion of the Super-4PCS(Super Four-Points Congruent Sets) and ICP (Iterative Closest Point) algorithm. Firstly, point cloud filtering and normal estimation are performed on the wheel point cloud data to obtain source and target point clouds with normal information. Subsequently, the ISS algorithm is employed to extract key points, and the FPFH(Fast Point Feature Histograms) point cloud feature descriptor is utilized to characterize the extracted key points. Then, a two-level registration strategy is used to improve registration accuracy, in which the Super-4PCS algorithm is applied for primary coarse registration and the ICP algorithm is used for the secondary fine registration, respectively. Finally, the experiment is conducted to validate the proposed algorithm and the performance of the algorithm is further comparative analyzed through the listed registration evaluation metrics. Experimental results demonstrate that the proposed algorithm exhibits significant improvements in registration accuracy and robustness for wheel point cloud data compared to the traditional algorithms.

The Iterative Closest Point (ICP) algorithm is one of the most popular methods for geometric alignment of 3-dimensional data points. We focus on how to make it faster for 3D range scanner in intelligent vehicle. The ICP algorithm mainly consists of two parts: nearest neighbor search and estimation of transformation between two data sets. The former is the most time consuming process. Many variants of the k-d trees have been introduced to accelerate the search. This paper presents a remarkably efficient search procedure, exploiting two concepts of approximate nearest neighbor and local search. Consequently, the proposed algorithm is about 24 times faster than the standard k-d tree.

The traditional affine iterative closest point (ICP) algorithm is fast and accurate for affine registration between two point sets, but it is easy to fall into local minimum. This paper proposes a robust Affine ICP algorithm based on corner points. First, an objective function is established under the guidance of corner points, where the corner points as the shape control point guides the affine registration of 2D point sets. Then, at each step of the algorithm, the affine transformation obtained by the last iterative step is used to establish the correspondence of these two point sets. Next, the new affine transformation is solved by using the objective function under the guidance of the corner points. Experimental results demonstrate that the robustness and convergence of our algorithm are greatly improved compared with the traditional affine registration algorithm.

A bounded iterative closest point method for minimally invasive registration of the femur