Radar target classification considering unknown classes using deep convolutional neural network ensemble

Crack morphology is a major indicator of pavement distress and can indicate the extent of pavement rehabilitation required. Researchers have investigated the detection of cracks using images captured at close proximity. This is often time-consuming, labor-intensive, and inefficient. This research implemented the weighted ensemble technique for detecting pavement cracks on a pixel level using UAV images obtained at high elevations. The images were trained using five deep convolutional neural network architectures: UNet, Vgg-UNet, Resnet-UNet, Inception-UNet, and PaveNet. The pixel-level crack detection results are combined using the ensemble technique to maximize performance. The performance of the ensemble methodology was evaluated and compared with some of the state-of-the-art networks. The predictions obtained were used to estimate the area, length, and mean width of the cracks in the pavement images. It is worth noting that the proposed system can be applied to a specific road segment. A quantitative index is then proposed for quantifying the level of deterioration present in a pavement section.

In the unsupervised open set domain adaptation (UOSDA), the target domain contains unknown classes that are not observed in the source domain. Researchers in this area aim to train a classifier to accurately: 1) recognize unknown target data (data with unknown classes) and 2) classify other target data. To achieve this aim, a previous study has proven an upper bound of the target-domain risk, and the open set difference, as an important term in the upper bound, is used to measure the risk on unknown target data. By minimizing the upper bound, a shallow classifier can be trained to achieve the aim. However, if the classifier is very flexible [e.g., deep neural networks (DNNs)], the open set difference will converge to a negative value when minimizing the upper bound, which causes an issue where most target data are recognized as unknown data. To address this issue, we propose a new upper bound of target-domain risk for UOSDA, which includes four terms: source-domain risk, ϵ -open set difference ( ∆ϵ ), distributional discrepancy between domains, and a constant. Compared with the open set difference, ∆ϵ is more robust against the issue when it is being minimized, and thus we are able to use very flexible classifiers (i.e., DNNs). Then, we propose a new principle-guided deep UOSDA method that trains DNNs via minimizing the new upper bound. Specifically, source-domain risk and ∆ϵ are minimized by gradient descent, and the distributional discrepancy is minimized via a novel open set conditional adversarial training strategy. Finally, compared with the existing shallow and deep UOSDA methods, our method shows the state-of-the-art performance on several benchmark datasets, including digit recognition [modified National Institute of Standards and Technology database (MNIST), the Street View House Number (SVHN), U.S. Postal Service (USPS)], object recognition (Office-31, Office-Home), and face recognition [pose, illumination, and expression (PIE)].

The typical approach to radar target classification is to image the target with waveforms that provide high resolution and low sidelobes, and then to compare the target images to a template library. In this chapter, we reconsider whether imaging-based metrics for waveform design are best for target classification, and develop alternative design strategies that result in waveforms with improved classification ability, but not necessarily a good ambiguity function by traditional notions. After presenting waveform design strategies based on optimizing signal-to-noise ratio or mutual information from a wide-sense stationary (WSS) ensemble of target impulse responses, we apply the design methods to the problem of radar target classification through a two-step process. The first step is to modify the design methodology that was based on WSS targets to account for the finite duration of practical target responses. The second step is to use the target class probabilities and impulse response library to calculate a weighted power spectral variance over target classes, which is then substituted into the design equations. The use of target class probabilities enables the waveform to be adapted in response to previous transmissions. Waveform behaviour and performance are studied over several different clutter and noise scenarios. The target impulse response library for these studies is based on finite-difference time-domain (FDTD) simulation of a publically available CAD model of an F-16 aircraft.

One-class classification (OCC) seeks to build a machine-learning model when the negative class is either absent, poorly sampled, or not well defined. In this paper, we present a deep adversarial learning based architecture for one-class classification. Our architecture is composed of two deep neural networks, a generator and a discriminator, that are competing while collaborating with each other since it is inspired by the success of Generative Adversarial Networks (GANs). The generator network contains a Deconvolutional Neural Networks (aka. decoder), which is trained using a zero-centered Gaussian noise as the feature representation of the pseudo-negative class to learn a good representation as well as the boundary for the classifiable distortion of the target (or positive) class with the assistance from the target class. The outputs produced by the generator network are aggregated with the real positive class data samples, which are then used to train the discriminator network, whose goal is to understand the underlying concept in the positive class, and then classify the negative testing samples. The proposed architecture applies to a variety of OCC problems such as novelty detection, anomaly detection, and mobile user authentication. The experiments on MNIST and Caltech-256 images demonstrate that our architecture achieves superior results over the recent state-of-the-art approaches.

To perform radar-based simultaneous localization and mapping, information on a robot’s ego-motion such as its rotation angle and velocity should be considered along with radar sensor data. In this paper, we propose a method to estimate the robot’s ego-motion using only a radar sensor without any other devices. To estimate the rotation angle of a robot, we use the distribution of detected points on a two-dimensional (2D) plane. The distributions of the detected points at successive time instants are correlated with each other, and the rotation angle can be estimated based on this correlation. In addition, the moving velocity of the robot is estimated from the trend line formed by the detected points on the 2D plane. To evaluate the performance of the proposed estimation method, the information about the robot’s ego-motion received from the robot motor is compared with the information estimated from the radar sensor data. The comparison of the yaw rate obtained through each method shows that our proposed method can estimate the rotation angle of the robot within an error of 3°. In addition, the ego-velocity of the radar-equipped robot can be estimated within an error of 0.073 m/s.

SAR automatic target recognition (SAR ATR) has been widely studied in recent years. Most ATR models are designed based on the traditional closed-set assumption. This type of ATR model can only identify target categories existing in the training set, and it will result in missed detection or misclassification of unseen target categories encountered in battlefield reconnaissance, posing a potential threat. Therefore, it is of great significance to design a model that can simultaneously achieve known class classification and unknown class judgment. In addition, researchers usually use the obtained unknown class data for model re-learning to enable it to recognize new categories. However, before this process, it is necessary to manually interpret and annotate the obtained unknown class data, which undoubtedly requires a large time cost and is difficult to meet the timeliness requirements. To solve these problems, we propose a framework that integrates the open-set recognition module and the novel class discovery module. By introducing the K-contrast loss, the open-set recognition module can accurately distinguish unknown class data, classify known class data, and then transfer the known class knowledge through deep clustering for clustering annotation of unknown class data. Extensive experimental results on the MSTAR benchmark dataset demonstrate the effectiveness of the proposed methods.

Common acoustic properties that different classes share degrades the performance of acoustic scene classification systems. This results in a phenomenon where a few confusing pairs of acoustic scenes dominate a significant proportion of all misclassified audio segments. In this article, we propose adopting a knowledge distillation framework that trains deep neural networks using soft labels. Soft labels, extracted from another pre-trained deep neural network, are used to reflect the similarity between different classes that share similar acoustic properties. We also propose utilizing specialist models to provide additional soft labels. Each specialist model in this study refers to a deep neural network that concentrates on discriminating a single pair of acoustic scenes that are frequently misclassified. Self multi-head attention is explored for training specialist deep neural networks to further concentrate on target pairs of classes. The goal of this article is to train a single deep neural network that demonstrates performance equivalent to, or higher than, an ensemble of multiple models, by distilling the knowledge from several models. Diverse experiments conducted using the detection and classification of acoustic scenes and events 2019 task 1-a dataset demonstrate that the knowledge distillation framework is effective in acoustic scene classification. Specialist models successfully decrease the number of misclassified audio segments in the target classes. The final single model with the proposed method that is trained by the proposed knowledge distillation from several models, including specialists trained using an attention mechanism, shows a classification accuracy of 77.63 %, higher than an ensemble of the baseline and multiple specialists.

PurposeChronic diseases are considered as one of the serious concerns and threats to public health across the globe. Diseases such as chronic diabetes mellitus (CDM), cardio vasculardisease (CVD) and chronic kidney disease (CKD) are major chronic diseases responsible for millions of death. Each of these diseases is considered as a risk factor for the other two diseases. Therefore, noteworthy attention is being paid to reduce the risk of these diseases. A gigantic amount of medical data is generated in digital form from smart healthcare appliances in the current era. Although numerous machine learning (ML) algorithms are proposed for the early prediction of chronic diseases, these algorithmic models are neither generalized nor adaptive when the model is imposed on new disease datasets. Hence, these algorithms have to process a huge amount of disease data iteratively until the model converges. This limitation may make it difficult for ML models to fit and produce imprecise results. A single algorithm may not yield accurate results. Nonetheless, an ensemble of classifiers built from multiple models, that works based on a voting principle has been successfully applied to solve many classification tasks. The purpose of this paper is to make early prediction of chronic diseases using hybrid generative regression based deep intelligence network (HGRDIN) model.Design/methodology/approachIn the proposed paper generative regression (GR) model is used in combination with deep neural network (DNN) for the early prediction of chronic disease. The GR model will obtain prior knowledge about the labelled data by analyzing the correlation between features and class labels. Hence, the weight assignment process of DNN is influenced by the relationship between attributes rather than random assignment. The knowledge obtained through these processes is passed as input to the DNN network for further prediction. Since the inference about the input data instances is drawn at the DNN through the GR model, the model is named as hybrid generative regression-based deep intelligence network (HGRDIN).FindingsThe credibility of the implemented approach is rigorously validated using various parameters such as accuracy, precision, recall, F score and area under the curve (AUC) score. During the training phase, the proposed algorithm is constantly regularized using the elastic net regularization technique and also hyper-tuned using the various parameters such as momentum and learning rate to minimize the misprediction rate. The experimental results illustrate that the proposed approach predicted the chronic disease with a minimal error by avoiding the possible overfitting and local minima problems. The result obtained with the proposed approach is also compared with the various traditional approaches.Research limitations/implicationsUsually, the diagnostic data are multi-dimension in nature where the performance of the ML algorithm will degrade due to the data overfitting, curse of dimensionality issues. The result obtained through the experiment has achieved an average accuracy of 95%. Hence, analysis can be made further to improve predictive accuracy by overcoming the curse of dimensionality issues.Practical implicationsThe proposed ML model can mimic the behavior of the doctor's brain. These algorithms have the capability to replace clinical tasks. The accurate result obtained through the innovative algorithms can free the physician from the mundane care and practices so that the physician can focus more on the complex issues.Social implicationsUtilizing the proposed predictive model at the decision-making level for the early prediction of the disease is considered as a promising change towards the healthcare sector. The global burden of chronic disease can be reduced at an exceptional level through these approaches.Originality/valueIn the proposed HGRDIN model, the concept of transfer learning approach is used where the knowledge acquired through the GR process is applied on DNN that identified the possible relationship between the dependent and independent feature variables by mapping the chronic data instances to its corresponding target class before it is being passed as input to the DNN network. Hence, the result of the experiments illustrated that the proposed approach obtained superior performance in terms of various validation parameters than the existing conventional techniques.

Deep neural networks (DNNs) provide excellent services in machine learning tasks such as image recognition, speech recognition, pattern recognition, and intrusion detection. However, an adversarial example created by adding a little noise to the original data can result in misclassification by the DNN and the human eye cannot tell the difference from the original data. For example, if an attacker creates a modified right-turn traffic sign that is incorrectly categorized by a DNN, an autonomous vehicle with the DNN will incorrectly classify the modified right-turn traffic sign as a U-Turn sign, while a human will correctly classify that changed sign as right turn sign. Such an adversarial example is a serious threat to a DNN. Recently, an adversarial example with multiple targets was introduced that causes misclassification by multiple models within each target class using a single modified image. However, it has the weakness that as the number of target models increases, the overall attack success rate decreases. Therefore, if there are multiple models that the attacker wishes to attack, the attacker must control the attack success rate for each model by considering the attack priority for each model. In this paper, we propose a priority adversarial example that considers the attack priority for each model in cases targeting multiple models. The proposed method controls the attack success rate for each model by adjusting the weight of the attack function in the generation process while maintaining minimal distortion. We used MNIST and CIFAR10 as data sets and Tensorflow as machine learning library. Experimental results show that the proposed method can control the attack success rate for each model by considering each model's attack priority while maintaining minimal distortion (average 3.95 and 2.45 with MNIST for targeted and untargeted attacks, respectively, and average 51.95 and 44.45 with CIFAR10 for targeted and untargeted attacks, respectively).

In this paper a decomposition scheme for analysis and classification of statistical radar targets is presented. For this purpose eigenvector target decomposition (ETD) analysis method is used for calculating coherency eigenvalues. Also a simulation scheme is developed for calculating entropy, scattering mechanism for discrimination of several surface scattering objects within distributed targets. As results, radar image data set have been used for compare.

There has been a recent emergence of sampling-based techniques for estimating epistemic uncertainty in deep neural networks. While these methods can be applied to classification or semantic segmentation tasks by simply averaging samples, this is not the case for object detection, where detection sample bounding boxes must be accurately associated and merged. A weak merging strategy can significantly degrade the performance of the detector and yield an unreliable uncertainty measure. This paper provides the first in-depth investigation of the effect of different association and merging strategies. We compare different combinations of three spatial and two semantic affinity measures with four clustering methods for MC Dropout with a Single Shot Multi-Box Detector. Our results show that the correct choice of affinity-clustering combination can greatly improve the effectiveness of the classification and spatial uncertainty estimation and the resulting object detection performance. We base our evaluation on a new mix of datasets that emulate near open-set conditions (semantically similar unknown classes), distant open-set conditions (semantically dissimilar unknown classes) and the common closed-set conditions (only known classes).

Radar emitter signal intra-pulse modulation recognition is important for modern electronic reconnaissance systems to analyze target radar systems. In the actual environment, the intra-pulse modulations of the sampled radar emitter signals contain not only the known types in the library but also the unknown types. Therefore, the existing recognition methods, which are based on a closed set, cannot recognize the unknown samples. In order to solve this problem, in this paper, we proposed a method for radar emitter signal intra-pulse modulation open set recognition. The proposed method could classify the known modulations and identify the unknown modulation by using an original deep neural network-based recognition model trained on a closed set, estimating the signal-to-noise ratio, and calculating the reconstruction loss by an encoder–decoder model. For a given sample, the original deep neural network-based recognition model will label it as a certain known class temporarily. By estimating the SNR of the sample and calculating the reconstruction loss by inputting the sample to the corresponding encoder–decoder model related to the temporary predicted known class, whether the sample belongs to the predicted temporary known class or the unknown class will be confirmed. Experiments were conducted with five different openness conditions. The experimental results indicate that the proposed method has good performance on radar emitter signal intra-pulse modulation open set recognition.

Image classification methods are usually trained to perform predictions taking into account a predefined group of known classes. Real-world problems, however, may not allow for a full knowledge of the input and label spaces, making failures in recognition a hazard to deep visual learning. Open set recognition methods are characterized by the ability to correctly identify inputs of known and unknown classes. In this context, we propose GeMOS: simple and plug-and-play open set recognition modules that can be attached to pretrained Deep Neural Networks for visual recognition. The GeMOS framework pairs pre-trained Convolutional Neural Networks with generative models for open set recognition to extract open set scores for each sample, allowing for failure recognition in object recognition tasks. We conduct a thorough evaluation of the proposed method in comparison with state-of-the-art open set algorithms, finding that GeMOS either outperforms or is statistically indistinguishable from more complex and costly models.

This paper proposes a method to use deep neural networks as end-to-end open-set classifiers. It is based on intra-class data splitting. In open-set recognition, only samples from a limited number of known classes are available for training. During inference, an open-set classifier must reject samples from unknown classes while correctly classifying samples from known classes. The proposed method splits given data into typical and atypical normal subsets by using a closed-set classifier. This enables to model the abnormal classes by atypical normal samples. Accordingly, the open-set recognition problem is reformulated into a traditional classification problem. In addition, a closed-set regularization is proposed to guarantee a high closed-set classification performance. Intensive experiments on five well-known image datasets showed the effectiveness of the proposed method which outperformed the baselines and achieved a distinct improvement over the state-of-the-art methods.

The paper proposes a data-driven pre-processing optimization for radar data using a parametric convolutional neural network. The proposed method is applied on human activity classification as a use case. Present radar-based activity recognition system exploit micro-Doppler signature by generating Doppler spectrograms or a temporal series of range-Doppler maps, followed by deep neural networks or machine learning approaches for classification. Those radar data representations are typically generated on the basis of short-time Fourier transformations. A Fourier transformation equally resolves the frequency space, which may be sub-optimal in some applications. Although deep convolutional neural networks (DCNN) have been shown to implicitly learn features from raw sensor data in other fields, such as speech recognition, yet, for the case of radar-based DCNNs, pre-processing is required to develop a scalable and robust classification or regression application. In this paper, we propose a parametric convolutional neural network that mimics the radar pre-processing across fast-time and slow-time radar data through 2D sinc filter or 2D wavelet filter kernels to extract features for classification of various human activities. During training only the filter parameters of the 2D sinc filters or 2D wavelets are learned, leading to optimized feature representation for the classification task. It is demonstrated that our proposed solution shows improved results compared to equivalent DCNN architectures that rely on Doppler spectrograms or radar data cubes as input data.