Vehicle Detection and Classification in Aerial Imagery

Vehicle detection and classification have become important tasks for traffic monitoring, transportation management and pavement evaluation. Nowadays there are sensors to detect and classify the vehicles on road. However, on one hand, most sensors rely on direct contact measurement to detect the vehicles, which have to interrupt the traffic. On the other hand, complex road scenes produce much noise to consider when to process the signals. In this paper, a data-driven methodology for the detection and classification of vehicles using strain data is proposed. The sensors are well arranged under the bridge deck without traffic interruption. Next, a cascade pre-processing method is applied for vehicle detection to eliminate in-situ noise. Then, a neural network model is trained to identify the close-range following vehicles and separate them by Non-Maximum Suppression. Finally, a deep convolutional neural network is designed and trained to identify the vehicle types based on the axle group. The methodology was applied in a long-span bridge. Three strain sensors were installed beneath the bridge deck for a week. High robustness and accuracy were obtained by these algorithms. The methodology proposed in this paper is an adaptive and promising method for vehicle detection and classification under complex noise. It would serve as a supplement to current transportation systems and provide reliable data for management and decision-making.

Vehicle detection and tracking plays a major role in military and civilian applications. The accurate detection of multiple vehicles in a complicated traffic environment is too difficult. This process is made more difficult, if there are occlusions between vehicles. The optimal feature selection of a vehicle is also a challenging task. These issues are focused in the existing work namely convolution neural network (CNN) based vehicle detection. However in this work, feature selection is not concentrated and with the lesser feature information classification accuracy is reduced considerably. This is focused and resolved in the proposed research by introducing the method namely Enhanced Convolution neural network with Support Vector Machine (ECNN-SVM) based vehicle detection. In this work initially feature extraction is done. Haar like features are used for this purpose. This has compact representation, capture information from multiple scales, encoded edge and structural information and can be efficient computation. Haar like feature pool is large scale in nature. Enhanced bat optimization is used to select features from this pool. This selection is done by combining sample’s class label and feature value. Confidence level between two thresholds of tracking rectangles is used for classification. Support vector machine (SVM) classifier is combined with local binary pattern to perform this classification. The interference areas between moving objects and vehicles are removed by Enhanced Convolutional Neural Network (ECNN) classifier. The efficiency of the proposed method is computed by using experimental and theoretical analysis.

Instead of using current deep-learning segmentation models (like the UNet and variants), we approach the segmentation problem using trained Convolutional Neural Network (CNN) classifiers, which automatically extract important features from images for classification. Those extracted features can be visualized and formed into heatmaps using Gradient-weighted Class Activation Mapping (Grad-CAM). This study tested whether the heatmaps could be used to segment the classified targets. We also proposed an evaluation method for the heatmaps; that is, to re-train the CNN classifier using images filtered by heatmaps and examine its performance. We used the mean-Dice coefficient to evaluate segmentation results. Results from our experiments show that heatmaps can locate and segment partial tumor areas. But use of only the heatmaps from CNN classifiers may not be an optimal approach for segmentation. We have verified that the predictions of CNN classifiers mainly depend on tumor areas, and dark regions in Grad-CAM's heatmaps also contribute to classification.

Deep learning-based classification and detection algorithms have emerged as a powerful tool for vehicle detection in intelligent transportation systems. The limitations of the number of high-quality labeled training samples makes the single vehicle detection methods incapable of accomplishing acceptable accuracy in road vehicle detection. This paper presents detection and classification of vehicles on publicly available datasets by utilizing the YOLO-v5 architecture. This paper’s findings utilize the concept of transfer learning through fine tuning the weights of the pre-trained YOLO-v5 architecture. To employ the concept of transfer learning, extensive data sets of images and videos of the congested traffic patterns were collected by the authors. These datasets were made more comprehensive by pointing various attributes, for instance high- and low-density traffic patterns, occlusions, and different weather circumstances. All of these gathered datasets were manually annotated. Ultimately, the improved YOLO-v5 structure becomes accustomed to any difficult traffic patterns. By fine-tuning the pre-trained network through our datasets, our proposed YOLO-v5 has exceeded several other traditional vehicle detection methods in terms of detection accuracy and execution time. Detailed simulations performed on the PKU, COCO, and DAWN datasets demonstrate the effectiveness of the proposed method in various challenging situations.

There are various means of monitoring traffic situations on roads. Due to the rise of artificial intelligence (AI) based image processing technology, there is a growing interest in developing traffic monitoring systems using camera vision data. This study provides a method for deriving traffic information using a camera installed at an intersection to improve the monitoring system for roads. The method uses a deep-learning-based approach (YOLOv4) for image processing for vehicle detection and vehicle type classification. Lane-by-lane vehicle trajectories are estimated by matching the detected vehicle locations with the high-definition map (HD map). Based on the estimated vehicle trajectories, the traffic volumes of each lane-by-lane traveling direction and queue lengths of each lane are estimated. The performance of the proposed method was tested with thousands of samples according to five different evaluation criteria: vehicle detection rate, vehicle type classification, trajectory prediction, traffic volume estimation, and queue length estimation. The results show a 99% vehicle detection performance with less than 20% errors in classifying vehicle types and estimating the lane-by-lane travel volume, which is reasonable. Hence, the method proposed in this study shows the feasibility of collecting detailed traffic information using a camera installed at an intersection. The approach of combining AI and HD map techniques is the main contribution of this study, which shows a high chance of improving current traffic monitoring systems.

Occlusion is an important problem of the moving target detection. This paper proposed a new method of vehicle detection according to the deficiencies of common vehicle detection methods. Firstly, the background is modeled through the improved histogram-mean model to extract more accurate background model and update in real-time; then we obtained the background through background subtraction and supplement edge information; at last get the complete foreground information of vehicle by the morphological to denoise and fill the empty positions of windows. Based on the occlusion of target in the foreground, this paper presents an effective method to obtain the accurate vehicles using adhesion point detection. The experimental results show that this method can accurately detect various types of vehicles, the computational complexity is low, be able to extract traffic information in real-time, and solved the problem of vehicle occlusion.

Research on Vehicle Detection and Recognition Technology Based on Artificial Intelligence

Vehicle detection from very-high-resolution satellite imagery has received increasing interest during the last few years. In this article, we propose an automatic system for operational traffic monitoring using very-high-resolution optical satellite imagery (0.5–0.6 m resolution) of small highways with low traffic density and a range of different illumination conditions, including cloud-shadowed, hazy, and partially cloudy conditions. The proposed system includes cloud and cloud shadow detection, road detection, and vehicle detection, classification, and counting. The main part of the system is vehicle detection, which is constructed using an elliptical blob detection strategy followed by region growing and feature extraction steps. Vehicular objects are separated from non-vehicular objects using a K-nearest-neighbour classifier, with various classical features used for pattern recognition, as well as some proposed application-specific features, and are also classified according to vehicle size. The fully automatic processing chain has been validated on a selection of satellite scenes from different parts of Norway, including imagery with large amounts of cloud, fog, cloud shadows, and similar conditions that complicate image interpretation. The overall vehicle detection rate was 85.4% and the false detection rate was 9.2%. Overall, this demonstrates the potential of operational traffic monitoring using very-high-resolution satellites.

In this study, a method of predicting the seismic responses of building structures based on a convolutional neural network (CNN) is proposed. In the method, the time histories of acceleration responses previously measured in a building during earthquakes are used in the CNN input layer, with the corresponding time histories of the displacement responses being used in the CNN output layer. The correlations between the features automatically extracted from the acceleration responses by the convolution and pooling operations in the various CNN layers and the displacement responses in the CNN output layer are established through CNN training. The trained CNN predicts the displacement responses for a future earthquake event using only the measured acceleration responses. To verify the validity of the proposed method, a numerical study on the ASCE benchmark model and an experimental study on a reinforced concrete frame structure are conducted. In the numerical study, the structural responses of the ASCE model subject to artificial earthquakes are utilized for CNN training, and the performance of the trained CNN is verified through seismic response prediction. In the experimental study, shaking table tests are performed for various earthquakes to measure the seismic responses of the reinforced concrete test structure. The seismic response prediction performance of the proposed method is examined using CNN trained with the measured seismic responses. Furthermore, the performances of CNNs trained with different numbers of datasets generated by the proposed data generation method based on data overlapping with the same data pool are discussed with related to the number of CNN training iteration number.

BackgroundIn recent months, multiple publications have demonstrated the use of convolutional neural networks (CNN) to classify images of skin cancer as precisely as dermatologists. However, these CNNs failed to outperform the International Symposium on Biomedical Imaging (ISBI) 2016 challenge which ranked the average precision for classification of dermoscopic melanoma images. Accordingly, the technical progress represented by these studies is limited. In addition, the available reports are impossible to reproduce, due to incomplete descriptions of training procedures and the use of proprietary image databases or non-disclosure of used images. These factors prevent the comparison of various CNN classifiers in equal terms.ObjectiveTo demonstrate the training of an image-classifier CNN that outperforms the winner of the ISBI 2016 CNNs challenge by using open source images exclusively.MethodsA detailed description of the training procedure is reported while the used images and test sets are disclosed fully, to insure the reproducibility of our work.ResultsOur CNN classifier outperforms all recent attempts to classify the original ISBI 2016 challenge test data (full set of 379 test images), with an average precision of 0.709 (vs. 0.637 of the ISBI winner) and with an area under the receiver operating curve of 0.85.ConclusionThis work illustrates the potential for improving skin cancer classification with enhanced training procedures for CNNs, while avoiding the use of costly equipment or proprietary image data.

Designing of VehiNet Using Convolutional Neural Networks and Deep Learning Techniques

Number of vehicles in use worldwide per person and depending on this traffic accidents increase day by day. Until today, various studies have been made on detection of the faulty vehicles in traffic. This study; in accordance with this purpose, is realized in order to recognize, classify vehicles on a photo or video that captured on a autoban or road which has two lanes and detect faulty ones between them by using ANN (Artificial Neural Network) and image processing techniques. In this system that developed by using Convolutional Neural Network, the vehicles can be recognized, classified according to their vehicle types and faulty vehicles can be detected with drawing a frame around them.

A screening system for early-stage oral cancer and precancerous lesions should be established because it is difficult to detect them even for specialists and they are often detected too late. In this paper, we propose a method for automatically classifying fluorescence images acquired by ALA-PDD (Photodynamic Diagnosis using 5-Aminolevulinic Acid) into three classes: Normal, Low-Risk, High-Risk. We augment a small image dataset by training GAN (Generative adversarial networks) with Differentiable Augmentation, and then train CNN (Convolutional Neural Network) for the classification by the augmented dataset. Experimental results show good classification results, which suggest that the combination of ALA-PDD and CNN classification is a promising method for oral cancer screening. Clinical Relevance- The method proposed in this paper has a potential to be used as a screening method for early-stage oral cancer and precancerous lesions, that is non-invasive, accurate, easy to use, and does not require specialization.

This paper presents a fast algorithmic method to train convolutional neural network (CNN) classifiers through extreme learning which has been verified on popular datasets on classification and pedestrian detection. CNN has been one of the best classifiers for images and object recognition. However, the Backpropagation (BP) algorithm, mostly used for training CNN, suffers from slow learning, local minimum, and poor generalization. To solve these problems, a novel architecture called CNN-ELM has been proposed here. Its core architecture is based on a local image (local receptive field) version of the ELM (Extreme Learning Machine) adopting random feature learning. Using MATLAB 2015a, classification experiments using the raw image data as input, show a comparable or mostly better classification performance compared to the BP trained CNN, with its training speed up to 200 times faster on MNIST, NORB, and CIFAR-10 datasets. Pedestrian detection experiments using INRIA datasets also exhibits much faster training than the BP trained CNN without sacrificing detection performance.

Vehicle Classification Method Based on Single-Point Magnetic Sensor