Lane detection based on classification of lane geometrical model

Lane departure warning system (LDWS) has been regarded as an efficient method to lessen the damages of road traffic accident resulting from driver fatigue or inattention. Lane detection is one of the key techniques for LDWS. To overcome the contradiction between complexity of algorithm and the real‐time requirement for vehicle onboard system, this paper introduces a new lane detection method based on intelligent CCD parameters regulation. In order to improve the real‐time capability of the system, a CCD parameters regulating method is proposed which enhances the contrast between lane line and road surfaces and reduces image noise, so it lays a good foundation for the following lane detection. Hough transform algorithm is improved by selection and classification of seed points. Finally the lane line is extracted through some restrictions. Experimental results verify the effectiveness of the proposed method, which improves not only real‐time capability but also the accuracy of the system.

The robustness and stability of lane detection is vital for advanced driver assistance vehicle technology and even autonomous driving technology. To meet the challenges of real-time lane detection in complex traffic scenes, a simple but robust multilane detection method is proposed in this paper. The proposed method breaks down the lane detection task into two stages, that is, lane line detection algorithm based on instance segmentation and lane modeling algorithm based on adaptive perspective transform. Firstly, the lane line detection algorithm based on instance segmentation is decomposed into two tasks, and a multitask network based on MobileNet is designed. This algorithm includes two parts: lane line semantic segmentation branch and lane line Id embedding branch. The lane line semantic segmentation branch is mainly used to obtain the segmentation results of lane pixels and reconstruct the lane line binary image. The lane line Id embedding branch mainly determines which pixels belong to the same lane line, thereby classifying different lane lines into different categories and then clustering these different categories. Secondly, the adaptive perspective transformation model is adopted. In this model, the motion information is used to accurately convert the original image into a bird’s-eye view image, and then the least-squares second-order polynomial fitting is performed on the lane line pixels. Finally, experiments on the CULane dataset show that the proposed method achieved similar or better performance compared with several state-of-the-art methods, the F1 score of the proposed method in the normal test set and most challenge test sets is better than other algorithms, which verifies the effectiveness of the proposed method, and then the field experiments results show that the proposed method has good practical application value in various complex traffic scenes.

<div class="section abstract"><div class="htmlview paragraph">Lane detection plays a critical role in autonomous vehicles for safe and reliable navigation. Lane detection is traditionally accomplished using a camera sensor and computer vision processing. The downside of this traditional technique is that it can be computationally intensive when high quality images at a fast frame rate are used and has reliability issues from occlusion such as, glare, shadows, active road construction, and more. This study addresses these issues by exploring alternative methods for lane detection in specific scenarios caused from road construction-induced lane shift and sun glare. Specifically, a U-Net, a convolutional network used for image segmentation, camera-based lane detection method is compared with a radar-based approach using a new type of sensor previously unused in the autonomous vehicle space: radar retro-reflectors. This evaluation is performed using ground truth data, obtained by measuring the lane positions and transforming them into pixel coordinates. The performance of each method is assessed using the statistical <i>R</i><sup>2</sup> score, indicating the correlation between the detected lane lines and the ground truth. The results show that the U-Net camera-based method exhibits limitations in accurately detecting and aligning the lane lines, particularly in challenging scenarios. However, the radar-based lane detection method demonstrates a strong correlation with the ground truth which implies that the use of this sensor may improve current reliability issues from conventional camera lane detection approach. Furthermore, the study highlights the limitations of the U-Net model for camera lane detection, especially in scenarios with sun glare. This study shows that infrastructure-based radar retro-reflectors can improve autonomous vehicle lane detection reliability. The integration of different sensor modalities and the development of advanced computer vision algorithms are crucial for improving the accuracy, reliability, and energy efficiency of lane detection systems. Addressing these challenges contributes to the advancement of autonomous vehicles and the realization of safer and more efficient transportation systems.</div></div>

As the high growth of the number of vehicles, the traffic accidents are becoming more and more serious in recent years. In order to avoid the drivers being in danger, an intelligent vision-based system should focus on the image contents of the front the camera setting under the rear-view mirror in the vehicle. In this paper, we present a functional-link-based neuro-fuzzy network (FLNFN) structure for lane detection and departure warning system application. The proposed FLNFN model uses a functional link neural network (FLNN) to the consequent part of the fuzzy rules. This study uses orthogonal polynomials and linearly independent functions in a functional expansion of the FLNN. Thus, the consequent part of the proposed FLNFN model is a nonlinear combination of input variables. An online learning algorithm, which consists of structure learning and parameter learning, is also presented. The structure learning depends on the entropy measure to determine the number of fuzzy rules. The parameter learning, based on the gradient descent method, can adjust the shape of the membership function and the corresponding weights of the FLNN. The lane detection method and the departure warning system proposed in this paper have been successfully evaluated on a PC platform of 3.2-GHz CPU, where the average frame-rate is up to 30fps.

Lane vehicle detection is fundamental to vehicle driving systems and self-driving. The proposed concept is to employ the pixel difference in the intended lane line backdrop to isolate the lane and the road surface, and then, the curve fitting model is used to identify the lane in the image. A histogram on gradient, histogram graph, and binary spatial features are extracted from the vehicle and non-vehicle images. For vehicle detection, support vector machine classifier is employed to separate the vehicle and non-vehicle images using the extracted features. But many methods are constrained by light conditions and road circumstances, such as weak light, fog, rain, etc., which may result in invisible lane lines. Feature extraction is the lane images being picked using various filters. Our work focuses on a lane detection technique founded on the Sobel filter and curve fitting model for lane line tracking in different conditions. Preprocessing encompasses the mitigation of noise as well as getting the image ready for the subsequent procedure. To achieve this, HLS color space was performed which identifies the lane by adding pixel values. The main aim is to increase the accuracy and reduce the computation time compared to other existing methods.KeywordsSobel filterCurve fitting modelLane detectionVehicle detectionSliding windowSupport vector machine

CFI-Former: Efficient lane detection by multi-granularity perceptual query attention transformer.

Lane detection is an essential visual capability for the autonomous vehicle navigation used in the intelligent transportation system (ITS). Several approaches for lane detection have been suggested in the past. However, there is still one issue about robustness. This paper presents a robust and real-time multi-lane detection method based on road marking feature points (RMFP) for autonomous vehicle navigation in an urban environment. The key idea in this paper is to apply methods from extracting RMFP and the target tracking domain to identify lane information. Then the RMFP is extracted from the gray-scale image and the IPM image. Additionally, the lane line color and structure features are used to sift through the RMFP that meet lane lines. Lastly, the clustering method is used to generate lane lines, and these lines are tracked by frame association and Kalman Filter. The experiment results based on image sequences taken under various visual conditions showed that the proposed system can identify the lane line markings with 98% accuracy. The method shows much robustness under various complicated scenarios and meets the real-time requirement.

To improve the driving safety of drivers, an effective lane detection algorithm was proposed upon the research on lane departure decision warning system based on machine vision. Firstly, the lane images were preprocessed to adapt to various lighting conditions and improve the efficiency of the lane detection. Then, by means of hough transform, actual lane line features were extracted according to the different image lane line features. Finally, after the study of different lane departure models based on lane line detection, this article put forward a lane departure decision algorithm. Experimental results demonstrate that the developed system exhibits good detection performances in recognition reliability and warning decision. It has proved that this system has high accuracy, large detection range and high practicability.Keywordsmachine visionlane detectionhough transformlane departure decisionwarning methods

Lane marking detection is part of most advanced driver assistance systems (ADAS) as an important component of computer vision. This paper presents a lane detection system based on a novel lane feature extraction approach. The robustness and real-time of algorithm enable different configurations of embedded solutions. The system is divided into three phases. Firstly, using the Prewitt operator we can get the rich useful details and using Shen Jun operator we can get step edge, on the other hand Shen Jun operator is the best filter to detect the symmetrical markings according to the maximum signal noise ratio (SNR) criterion. So we introduce the best compromise method between noise smoothing and edge locating that combining the Prewitt operator with Shen Jun operator to extract lane markings. Then a fast Hough transform based on image pyramid is applied to get the lane lines. The posterior algorithm of reasonably refining the Lane lines angle is introduced to correct to error caused by Hough transform. Finally, robust detection of vehicle’s departure warning is also discussed. Experiment results on real road will be presented to prove the robustness and effectiveness of the proposed lane detection algorithm.

In intelligent driving, lane line detection is a basic but challenging task, especially in complex road conditions. The current detection algorithms based on convolutional neural networks perform well for simple scenes with plenty of light, and the lane lines are clean and unobstructed. Still, they do not perform well for complex scenes such as damaged, blocked, and lack-of-light scenes. In this article, we have exceeded the above restrictions and propose an attractive network: LaneFormer; We use an end-to-end network for up and down sampling three times each, then fuse them in their respective channels to extract the slender lane line structure. At the same time, a correction module is designed to adjust the dimensions of the extracted features using MLP, judging whether the feature is completely extracted through the loss function. Finally, we send the feature into the transformer network, detect the lane line points through the attention mechanism, and design a road and camera model to fit the identified lane line feature points. Our proposed method has been validated in the TuSimple benchmark test, showing the most advanced accuracy with the lightest model and fastest speed.

Lane detection and tracking technique is the autonomous driving basis for Rubber-Tired Gantries (RTGs), vital to the automation and intelligence updating of man-driven container terminals. However, the existing lane detection methods developed for common road scenarios cannot meet the high-precision and robust all-weather requirements of RTG autonomous driving. In this article, we propose an Adaptive Edge-based Lane Detection and Tracking method considering RTG lanes’ characteristics in this paper. First, the candidate edges of lane lines are detected and paired based on the enhanced gradient features. Next, inverse perspective mapping is employed to search the right edges, followed by an adaptive sliding-window method. Ultimately, we develop an adaptive Kalman filter to track lane lines robustly, detecting confidence weighting by relaxing the constraint of lane line width. The proposed method is tested in an actual container yard, the lane centerline’s average position error is 2.051 pixels, and the detection success rate is close to 100%.

Lane detection plays an important role in the field of automatic driving. Conventional convolutional operations typically focus on local block-like region, while lane often span across multiple image regions as strip lines. How to make up for the limitations of ordinary convolution in extracting lane information and make the network focus on the strip lanes is a challenging problem. For this purpose, we propose an oblique convolution idea to effectively extract the information of the whole lane. Specifically, an Oblique Rotation Module (ORM) is proposed to rotate the lane feature map into a vertical orientation, enabling better lane positioning and recognition by using row anchors. Additionally, we introduce a Strip Spatial Attention Module (SSAM) to extract global features of the entire lane and employ deformable convolutions to adapt to curved lane lines. Finally, we restore the feature map using Anti-oblique Rotation Module (AORM) and obtain lane detection results through classification-based predictions. During training, we incorporate a multi-scale auxiliary classification loss to predict the presence of lane lines at different network levels, aiding the network in learning the structural information of lane lines. A large number of experiments on the lane detection benchmark dataset show that our method can achieve advanced performance, and we have achieved good results in public datasets. The accuracy on the Tusimple dataset is 96.50%, the F1 on the CULane dataset is 79.33%. Both results rank in the top 10 on the leaderboard, and the inference speed reaches 35 FPS. Code and data are available on <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/gongyan1/Oblique-Convolution</uri>

In order to adapt to various complex lane environments, a general fast lane extraction algorithm was proposed. Firstly, according to the mutability of the local gray value and the characteristics of image saliency, the collected road image was preprocessed, and the region of interest was obtained by the proposed double threshold algorithm. Only in the significant region of the road were the image gray value change and image smoothing carried out to solve the problems of consuming too much time and poor noise resistance in lane detection. The lane line edge was then extracted based on the improved Canny operator. When the Otsu threshold was selected, the Kalman filter algorithm was introduced to quickly predict the optimal threshold of the subsequent image sequence in accordance with the characteristics of optimized autoregressive data processing.. Finally, for the straight line fitted by the Hough transform, an effective multi-layer evaluation function was established to realize the online correction of lane lines. Compared with the traditional lane line extraction algorithm, the experimental results show that the proposed algorithm has better accuracy, real-time performance and robustness.

&lt;div class="section abstract"&gt;&lt;div class="htmlview paragraph"&gt;Accurately detecting lane lines remains a challenging task, especially with low-quality cameras due to the complex environment such as haze, uneven lighting, and shadows of actual roads. Despite numerous studies, lane line detection algorithms are still required to be improved for practical applications. In this work, we propose a new lane detection method that incorporates the brightness estimation concept of the single-scale retinex (SSR) algorithm into the dark channel prior (DCP) algorithm for image preprocessing. The improved DCP algorithm is used to estimate the atmospheric light intensity and remove haze noise, while simultaneously enhancing image contrast to reduce the difficulty of lane detection, especially under uneven lighting conditions, then followed by perspective transformation and HSV color space (hue, saturation, value) conversion, and finally, lane line recognition and tracking are performed using sliding windows and histogram statistics. Experimental results demonstrate that our method achieves high accuracy and robustness in lane line detection, especially under uneven lighting conditions, compared to existing methods. The proposed method can effectively handle complex situations such as haze, uneven lighting, and shadows, making it feasible for practical applications.&lt;/div&gt;&lt;/div&gt;

Lane detection is one of the most fundamental problems in the rapidly developing field of autonomous vehicles. With the dramatic growth of deep learning in recent years, many models have achieved a high accuracy for this task. However, most existing deep-learning methods for lane detection face two main problems. First, most early studies usually follow a segmentation approach, which requires much post-processing to extract the necessary geometric information about the lane lines. Second, many models fail to reach real-time speed due to the high complexity of model architecture. To offer a solution to these problems, this paper proposes a lightweight convolutional neural network that requires only two small arrays for minimum post-processing, instead of segmentation maps for the task of lane detection. This proposed network utilizes a simple lane representation format for its output. The proposed model can achieve 93.53% accuracy on the TuSimple dataset. A hardware accelerator is proposed and implemented on the Virtex-7 VC707 FPGA platform to optimize processing time and power consumption. Several techniques, including data quantization to reduce data width down to 8-bit, exploring various loop-unrolling strategies for different convolution layers, and pipelined computation across layers, are optimized in the proposed hardware accelerator architecture. This implementation can process at 640 FPS while consuming only 10.309 W, equating to a computation throughput of 345.6 GOPS and energy efficiency of 33.52 GOPS/W.