Automatic Vector-based Road Structure Mapping Using Multi-beam LiDAR

CAOM: Change-aware online 3D mapping with heterogeneous multi-beam and push-broom LiDAR point clouds

Navigation system for orchard spraying robot based on 3D LiDAR SLAM with NDT_ICP point cloud registration

Introduction Detecting road boundaries, the static physical edges of the available driving area, is important for safe navigation and effective path planning in autonomous driving and advanced driver-assistance systems. Traditionally, road boundary detection in autonomous driving relies on cameras and LiDAR. However, they are vulnerable to poor lighting conditions, such as nighttime and direct sunlight glare, or prohibitively expensive for low-end vehicles. Methods This paper introduces 4DRadarRBD, the first road boundary curve detection method based on 4D mmWave radar, which is cost-effective and robust in complex driving scenarios. The main idea is that road boundaries (e.g., fences, bushes, roadblocks) reflect millimeter waves, thus generating point cloud data for the radar. To overcome the challenge that the 4D mmWave radar point clouds contain many noisy points, we initially reduce noisy points via physical constraints for road boundaries and then segment the road boundary points from the noisy points by incorporating a distance-based loss which penalizes for falsely detecting the points far away from the actual road boundaries. In addition, we capture the temporal dynamics of point cloud sequences by utilizing each point’s deviation from the vehicle motion-compensated road boundary detection result obtained from the previous frame, along with the spatial distribution of the point cloud for point-wise road boundary segmentation. Results We evaluated 4DRadarRBD through real-world driving tests and achieved a road boundary point segmentation accuracy of 93%, with a median distance error of up to 0.023 m and an error reduction of 92.6% compared to the baseline model.

With the rapid development of mobile laser scanning (MLS) technology, high-precision three-dimensional (3D) point cloud data has shown great potential in different fields such as topographic mapping, road asset management and smart city construction. 3D point cloud data contains not only position information, but also the shape and attributes of the target, which is very convenient for obtaining road information. Accurate extraction of the road boundary is a basic task for obtaining road infrastructural data, which can support the generation of high-precision maps, vehicle navigation and autonomous driving. However, road boundary extraction in urban environments is easily occluded such as vehicles and pedestrians on the road, which leads to problems such as difficulty and incomplete extraction of MLS point cloud road boundaries. To address this problem, this study proposes a road boundary extraction method that integrates pavement edge information, accurately considers the position of the road boundary from two dimensions, eliminates false boundaries, and completes the missing boundary through the extracted boundary spatial relationship. First, grid elevation filtering is used to remove high-level non-ground points. Then the pavement edges and curb stone points are extracted from the preprocessed point cloud, and they are superimposed to remove false boundary points to obtain accurate road boundaries. Finally, based on the spatial relationship of road boundaries, missing parts are detected and repaired to obtain complete road boundaries. Experimental results show that the accuracy on real road scenes exceeds 98%, the completeness rate is above 91%, and the extraction quality is above 90%, which verifies the effectiveness and accuracy of this method.

Accurate localization and reliable mapping is essential for autonomous navigation of robots. As one of the core technologies for autonomous navigation, Simultaneous Localization and Mapping (SLAM) has attracted widespread attention in recent decades. Based on vision or LiDAR sensors, great efforts have been devoted to achieving real-time SLAM that can support a robot’s state estimation. However, most of the mature SLAM methods generally work under the assumption that the environment is static, while in dynamic environments they will yield degenerate performance or even fail. In this paper, first we quantitatively evaluate the performance of the state-of-the-art LiDAR-based SLAMs taking into account different pattens of moving objects in the environment. Through semi-physical simulation, we observed that the shape, size, and distribution of moving objects all can impact the performance of SLAM significantly, and obtained instructive investigation results by quantitative comparison between LOAM and LeGO-LOAM. Secondly, based on the above investigation, a novel approach named EMO to eliminating the moving objects for SLAM fusing LiDAR and mmW-radar is proposed, towards improving the accuracy and robustness of state estimation. The method fully uses the advantages of different characteristics of two sensors to realize the fusion of sensor information with two different resolutions. The moving objects can be efficiently detected based on Doppler effect by radar, accurately segmented and localized by LiDAR, then filtered out from the point clouds through data association and accurate synchronized in time and space. Finally, the point clouds representing the static environment are used as the input of SLAM. The proposed approach is evaluated through experiments using both semi-physical simulation and real-world datasets. The results demonstrate the effectiveness of the method at improving SLAM performance in accuracy (decrease by 30% at least in absolute position error) and robustness in dynamic environments.

Road detection is a crucial problem for intelligent vehicles and mobile robots. Most of the methods proposed nowadays only achieve reliable results in relatively well-arranged environments. In this paper, we proposed a stereovision-based road boundary detection method by combining homography estimation and MRF-based belief propagation to cope with challenging scenarios such as unstructured roads with unhomogeneous surfaces. In the method, each pixel in the reference image is firstly labeled as ¿road¿ or ¿non-road¿ by minimizing a well defined energy function that accounts for the planar road region. Subsequently, both of the road boundaries are generated using Catmull-Rom splines based on RANdom SAmple Consensus (RANSAC) algorithm with varying road structure models to help the intelligent vehicle understand the structure as well as safe range of current road. In the suggested framework, both intensity and geometry information of road scenarios are used to contain all the regions belonging to the planar road plane, and the left and right road boundaries are generated separately using a robust fitting algorithm to handle different road structures. Therefore, more accurate as well as robust detection of the road can be expected. Experimental results on a wide variety of typical but challenging scenarios have demonstrated the effectiveness of the proposed method.

Among emerging 3D scanning and imaging techniques that are commercially available, simultaneous localization and mapping (SLAM) is being substantially studied to generate 2D/3D maps of an unknown environment while reliably keeping track of the user’s pinpoint locations. Its ubiquitous mobility has demonstrated great mapping capabilities for infrastructures where vertical information may frequently be occluded using unmanned aircraft system (UAS) structure from-motion (SfM) photogrammetry. In addition, indoor mapping with terrestrial laser scanning can be a cumbersome task due to possible multiple scan locations. Intending to provide a cohesive 3D model by fusing point clouds collected via aerial SfM photogrammetry, terrestrial laser scanning (TLS), and SLAM, the purpose of this work is to assess the performance of SLAM point cloud generated by a proprietary mobile backpack laser scanner (BLS). Considering maximum scanning range and information integration strategy as variables, the point clouds generated by the BLS were evaluated against SfM and TLS datasets in terms of the internal consistency as well as external accuracy. TLS, SfM and SAM data collection efforts were made in a typical university campus environment. For the internal consistency, the SLAM-based point cloud with a maximum scanning range of 70 m presented a root mean square error (RMSE) of 2 mm. The SLAM+GNSS-based point cloud presented the lowest internal precision of RMSE = 0.861 m. The SLAM+GNSS 70 point cloud after a fine adjustment of misalignment presented the highest vertical accuracy with an RMSE = 0.069 m, while the point cloud generated from SfM photogrammetry presented RMSE = 0.297 m. The BLS was able to generate point cloud with an accuracy similar to GNSS-RTK surveying and it can be considered as a viable solution for indoor and outdoor mapping applications.

A high-definition (HD) map is becoming an integral component of future mobility systems such as autonomous and connected vehicles. Advances in computing systems, LiDAR technologies, and vehicle communication technologies have enabled the HD map to directly treat a point cloud map (PCM), modeling road environments as LiDAR signal-level data. However, if actual road environments are changed, the PCM, modeling the environments before changes, can not be used for vehicle applications. Accordingly, the PCM has to stay up-to-date states by reflecting the environment changes continuously. This paper presents a crowd-sourcing framework to update the PCM from environment changes continuously using LiDAR and vehicle communication. Multiple intelligent vehicles installed with the LiDAR sensors download the PCM from a map server via wireless vehicle communication. To minimize the effects of environment changes, a robust localization based on a hierarchical Simultaneous Localization and Mapping (SLAM) estimates the pose (position and direction). The estimated pose is used to detect the differences between the PCM and environments, which are defined as map changes. The map changes are detected by the probabilistic and evidential theory considering the LiDAR characteristics, such as beam divergence and multi-echo. The detected map changes are uploaded to the map cloud server and merged into the PCM. The proposed crowd-sourcing framework to keep the PCM up-to-date is verified and evaluated via simulations and experiments in sites with road environment changes.

Multi-beam Lidars have many good features, such as: high accuracy, wide range, strong anti-interference capacity, and the ability of obtain multiple information (depth, reflectivity) and so on, which excellent performance gain greatly attention by the unmanned system industry, and it is very applicable to the environment perception of autonomous cars. But the vast amount of data and the sparsity make its point cloud very difficult to process. In this paper, a 2.5D map based on Gaussian distribution is purposefully proposed, and a composite distance is used to cluster the point cloud. Experiments show that this clustering method can effectively solve the problem that the same obstacle cannot gather together caused by shadow or the sparsity of point cloud. Compared to previous methods, it achieves excellent performance with high accuracy and stable robustness and meet the requirements of real-time system with less than 100ms average running time.

Abstract. Monitoring of engineering structures is important for ensuring safety of operation. Traditional surveying methods have proven to be reliable; however, the advent of new point cloud technologies such as terrestrial laser scanning (TLS) and small unmanned aerial systems (sUAS) have provided an unprecedented wealth of data. Furthermore, simultaneous localization and mapping (SLAM) is now able to facilitate the collection of registered point clouds on the fly. SLAM is most successful when applied to indoor environments where the algorithm can identify primitives (points, planes, lines) for registration, but it can be problematic in outdoor settings where there is absence of constructed features. This work includes the collection of SLAM-based LiDAR data along a levee for the purpose of inspection and monitoring. Due to the outdoor setting and absence of man-made features, the resulting point cloud was considerably distorted due to erroneous drift in sensor orientation. A correction algorithm is proposed that relies on reference TLS point cloud data to remove drift distortions identified in the SLAM LiDAR. Results indicate an alignment between the corrected SLAM LiDAR and TLS data of around ±10cm, which is sufficient for general inspection and multi-epoch monitoring of levees. The algorithm is based on common points identified in the TLS and SLAM data and necessitates that the SLAM LiDAR is collected in individual, one-way lines to allow correction of distortions as a function of distance from the starting point. This approach increases the efficiency of LiDAR-based levee monitoring by reducing the time required to survey the levees.

This paper introduces a medium-scale point cloud dataset for semantic SLAM (Simultaneous Localization and Mapping) acquired using a SwissRanger time-of-flight camera. An indoor environment with relatively unfluctuating lighting conditions is considered for mapping and localization. The camera is positioned on a mobile tripod and ready to capture images at prearranged locations in the environment. The prearranged locations are in fact used as ground truth for estimating the variance with poses calculated from SLAM, and also as initial pose estimates for the ICP algorithm (Iterative Closest Point). An interesting point is that, in this work, no type of Inertial Measurement Units or visual odometry techniques has been utilized, given the fact that, data from time-of-flight cameras is noisy and sensitive to external conditions (such as lighting, transparent surfaces, parallel overlapping surfaces etc.). Furthermore, a large collection of household objects is made in order to label the scene with semantic information. The whole SLAM dataset with pose files along with the point clouds of household objects is a major contribution in this paper apart from mapping and plane detection using a publicly available toolkit. Also, a novel metric, a context-based similarity score, for evaluating SLAM algorithms is presented.

A Simultaneous Localization and Mapping (SLAM) system must be robust to support long-term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather conditions which degrade the utility of imagery and point cloud data. Radar, whose operating electromagnetic spectrum is less affected by environmental changes, is promising although its distinct sensor model and noise characteristics bring open challenges when being exploited for SLAM. This paper studies the use of a Frequency Modulated Continuous Wave radar for SLAM in large-scale outdoor environments. We propose a full radar SLAM system, including a novel radar motion estimation algorithm that leverages radar geometry for reliable feature tracking. It also optimally compensates motion distortion and estimates pose by joint optimization. Its loop closure component is designed to be simple yet efficient for radar imagery by capturing and exploiting structural information of the surrounding environment. Extensive experiments on three public radar datasets, ranging from city streets and residential areas to countryside and highways, show competitive accuracy and reliability performance of the proposed radar SLAM system compared to the state-of-the-art LiDAR, vision and radar methods. The results show that our system is technically viable in achieving reliable SLAM in extreme weather conditions on the RADIATE Dataset, for example, heavy snow and dense fog, demonstrating the promising potential of using radar for all-weather localization and mapping.

Unmanned mining is one of the most effective methods to solve mine safety and low efficiency. However, it is the key to accurate localization and mapping for underground mining environment. A novel graph simultaneous localization and mapping (SLAM) optimization method is proposed, which is based on Generalized Iterative Closest Point (GICP) three-dimensional (3D) point cloud registration between consecutive frames, between consecutive key frames and between loop frames, and is constrained by roadway plane and loop. GICP-based 3D point cloud registration between consecutive frames and consecutive key frames is first combined to optimize laser odometer constraints without other sensors such as inertial measurement unit (IMU). According to the characteristics of the roadway, the innovative extraction of the roadway plane as the node constraint of pose graph SLAM, in addition to automatic removing the noise point cloud to further improve the consistency of the underground roadway map. A lightweight and efficient loop detection and optimization based on rules and GICP is designed. Finally, the proposed method was evaluated in four scenes (such as the underground mine laboratory), and compared with the existing 3D laser SLAM method (such as Lidar Odometry and Mapping (LOAM)). The results show that the algorithm could realize low drift localization and point cloud map construction. This method provides technical support for localization and navigation of underground mining environment.

Facing the realistic demands of the application environment of robots, the application of simultaneous localisation and mapping (SLAM) has gradually moved from static environments to complex dynamic environments, while traditional SLAM methods usually result in pose estimation deviations caused by errors in data association due to the interference of dynamic elements in the environment. This problem is effectively solved in the present study by proposing a SLAM approach based on light detection and ranging (LiDAR) under semantic constraints in dynamic environments. Four main modules are used for the projection of point cloud data, semantic segmentation, dynamic element screening, and semantic map construction. A LiDAR point cloud semantic segmentation network SANet based on a spatial attention mechanism is proposed, which significantly improves the real-time performance and accuracy of point cloud semantic segmentation. A dynamic element selection algorithm is designed and used with prior knowledge to significantly reduce the pose estimation deviations caused by SLAM dynamic elements. The results of experiments conducted on the public datasets SemanticKITTI, KITTI, and SemanticPOSS show that the accuracy and robustness of the proposed approach are significantly improved.

Road boundary detection is an important part of the perception of the autonomous driving. It is difficult to detect road boundaries of unstructured roads because there are no curbs. There are no clear boundaries on mine roads to distinguish areas within the road boundary line and areas outside the road boundary line. This paper proposes a real-time road boundary detection and tracking method by a 3D-LIDAR sensor. The road boundary points are extracted from the detected elevated point clouds above the ground point cloud according to the spatial distance characteristics and the angular features. Road tracking is to predict and update the boundary point information in real-time, in order to prevent false and missed detection. The experimental verification of mine road data shows the accuracy and robustness of the proposed algorithm.