Multiple Kernel Discriminant Analysis and Decision Fusion for Robust Sub-Pixel Hyperspectral Target Recognition

Hyperspectral-based automatic target recognition (ATR) and classification systems often project the high-dimensional hyperspectral reflectance signatures onto a lower dimensional subspace using techniques such as principal component analysis, Fisher's linear discriminant analysis (LDA), and stepwise LDA. In a general classification framework, these projections are suboptimal and, in the absence of sufficient training data, are likely to be ill conditioned. In recent work, the authors proposed a divide-and-conquer approach that partitions the hyperspectral space into contiguous subspaces followed by a multiclassifier and decision-fusion (MCDF) framework. Although this technique alleviated the small-sample-size problem and provided a good recognition performance in light and moderate pixel mixing, the performance significantly decreased under severe mixing conditions, as it does with conventional ATR techniques. In this letter, the authors propose a kernel discriminant analysis-based projection in each subspace of the partition, followed by the MCDF framework to ensure robust recognition even in severe pixel-mixing conditions. The performance of the proposed system (as measured by overall recognition accuracies) is greatly superior to conventional dimensionality-reduction techniques as well as the more recently proposed LDA-based MCDF technique.

Principal components analysis (PCA) is commonly used as a tool for feature space dimensionality reduction for various automatic target recognition (ATR) systems. Recently, PCA has also been employed in conjunction with linear discriminant analysis (LDA) to recondition ill posed LDA formulations. The key idea behind this approach is to use a PCA transformation to discard the null space of rank deficient scatter matrices so that LDA can be applied on this reconditioned space. This approach, called subspace LDA, has been employed with some level of success for face recognition algorithms. In this paper, we present a theoretical analysis of the effects of PCA on discrimination power of the projected subspace. We also provide experimental evidence of the ineffectiveness of a PCA projection for hyperspectral ATR applications using three different hyperspectral invasive species datasets.

Automatic target recognition (ATR) is a challenging task for several computer vision applications. It requires efficient, accurate, and robust methods for target detection and target identification. Deep learning has shown great success in many computer vision applications involving color RGB images. However, the performance of these networks in ATR with infrared sensor data needs further investigation. In this paper, we propose a multistage automatic target detection and recognition (ATDR) system that performs both target detection and target classification on infrared (IR) imagery using deep learning. Our system processes large IR image frames where targets take <1 % of the total number of pixels. First, we train a state-of-the-art object detector you only look once (YOLO) to localize all potential targets in the input image frame. Then, we train a convolutional neural network (CNN) to identify these detections as targets or false alarms. In this second phase, we adapt and analyze the performance of three CNN architectures: a compact and fully connected CNN, VGG16 with batch normalization, and a wide residual neural network (WRN). We also explore the use of a loss function that optimizes directly the area under the receiver operating characteristic (ROC) curve (AUC), and adapt it to our ATR application. To enhance the robustness of the proposed ATR to perturbation and variations introduced during the detection stage, we train our CNN classifiers on automatically detected targets using YOLO, in addition to ground truth bounding boxes and apply selected data augmentation techniques. To simulate real testing environments, where the spatial location of the targets within the image frame is unknown, only YOLO-detected boxes are used during validation. We evaluate our ATDR on a real benchmark dataset that includes different vehicles captured at different resolutions. Our experiments have shown that YOLO can detect most of the targets at the expense of generating a high number of false alarms. We show that the VGG-16 network with batch normalization, which is the best performing model, can correctly identify the classes of the targets, as well as classify the majority of YOLO’s false detections into an additional nontarget class. We also show that the proposed training modification to optimize an AUC-based loss function for ATR proved to be advantageous mainly in identifying difficult targets.

Combining the capability of an automated target recognition (ATR) system with the expertise of human operators has the potential to improve combined human-machine target-recognition performance. The objective of this work was to develop empirically validated guidelines for the display of information provided by an ATR system. Motivated by the premise that operators will have higher trust in an ATR system that justifies its decisions, this work explored alternative ATR displays that provided different types and amounts of information in support of the system's target decisions. Operators' usage of and preference for the displays were contrasted for low- and high-accuracy simulated ATR systems representative, respectively, of current and future technologies. Performance results suggested that the amount of supporting information that is displayed must be congruent with the ATR system's accuracy. Operators expressed a clear preference for an ATR system that provides a confidence rating for its target decisions. Based on the results design guidelines are suggested for displaying ATR information to help operators balance confidence in their own judgments with trust in the ATR's decisions.

Automatic target recognition (ATR) of synthetic aperture radar (SAR) images is performed on either global or local features. The global features can be extracted and classified with high efficiency. However, they lack the reasoning capability thus can hardly work well under the extended operation conditions (EOCs). The local features are often more difficult to extract and classify but they provide reasoning capability for EOC target recognition. To combine the efficiency and robustness in an ATR system, a hierarchical fusion of the global and local features is proposed for SAR ATR in this paper. As the global features, the random projection features can be efficiently extracted and effectively classified by sparse representation-based classification (SRC). The physically relevant local descriptors, i.e., attributed scattering centers (ASCs), are employed for local reasoning to handle various EOCs like noise corruption, resolution variance, and partial occlusion. A one-to-one correspondence between the test and template ASC sets is built by the Hungarian algorithm. Then, the local reasoning is performed by evaluating individual matched pairs as well as the false alarms and missing alarms. For the test image to be recognized, it is first classified by the global classifier, i.e., SRC. Once a reliable decision is made, the whole recognition process terminates. When the decision is not reliable enough, it is passed to the local classifier, where a further classification by ASC matching is carried out. Therefore, by the hierarchical fusion strategy, the efficiency of global features and the robustness of local descriptors to various EOCs can be maintained jointly in the ATR system. Extensive experiments on the moving and stationary target acquisition and recognition data set demonstrate that the proposed method achieves superior effectiveness and robustness under both SOC and typical EOCs, i.e., noise corruption, resolution variance, and partial occlusion, compared with some other SAR ATR methods.

Performance of automatic target recognition (ATR) systems depends on numerous factors including the mission description, operating conditions, sensor modality, and ATR algorithm itself. Performance prediction models sensitive to these factors could be applied to ATR algorithm design, mission planning, sensor resource management, and data collection design for algorithm verification. Ideally, such a model would return measures of performance (MOPs) such as probability of detection (Pd), correct classification (Pc), and false alarm (Pfa), all as a function of the relevant predictor variables. Here we discuss the challenges of model-based and data-based approaches to performance prediction, concentrating especially on the synthetic aperture radar (SAR) modality. Our principal conclusion for model-based performance models (predictive models derived from fundamental physics- and statistics-based considerations) is that analytical progress can be made for performance of ATR system components, but that performance prediction for an entire ATR system under realistic conditions will likely require the combined use of Monte Carlo simulations, analytical development, and careful comparison to MOPs from real experiments. The latter are valuable for their high-fidelity, but have a limited range of applicability. Our principal conclusion for data-based performance models (that fit empirically derived MOPs) offer a potentially important means for extending the utility of empirical results. However, great care must be taken in their construction due to the necessarily sparse sampling of operating conditions, the high-dimensionality of the input space, and the diverse character of the predictor variables. Also the applicability of such models for extrapolation is an open question.

We present a performance analysis of an indexing module contained in an automatic target recognition (ATR) system developed at Worcester Polytechnic Institute (WPI). The linear signal decomposition/direction of arrival (LSD/DOA) technique provides a low computational-cost indexing function for pose in ATR applications. The LSD/DOA technique forms a reduced-size, essential-information object data set which implicitly incorporates target and sensor variation specific data. To control the computational costs, the system consists of two independent components: a computationally expensive off-line component which forms the object representation and a computationally inexpensive on-line object recognition component. The size of the stored data set may also be adjusted providing a means to trade off complexity versus performance. Synthetic aperture radar (SAR) data collected as part of the Moving and Stationary Target Acquisition and Recognition (MSTAR) program has been released to the public, providing an opportunity for ATR performance assessment against a standard high quality data set. We present the results of a number of simulated tests against the MSTAR public database to demonstrate the performance of the LSD/DOA index module on a given target along with the performance of the WPI ATR itself as a function of the depression angle and target configuration.

Forward Looking Infrared (FLIR) automatic target recognition (ATR) systems depend upon the capacity of the atmosphere to propagate thermal radiation over long distances. To date, not much research has been conducted on analyzing and mitigating the effects of the atmosphere on FLIR ATR performance, even though the atmosphere is often the limiting factor in long-range target detection and recognition. The atmosphere can also cause frame-to-frame inconsistencies in the scene, affecting the ability to detect and track moving targets. When image quality is limited by turbulence, increasing the aperture size or improving the focal plane array cannot improve ATR performance. Traditional single frame image enhancement does not solve the problem. A new approach is described for reducing the effects of turbulence. It is implemented under a lucky-region-imaging framework using short integration time and spatial domain processing. It is designed to preserve important target and scene structure. Unlike previous Fourier-based approaches originating from the astronomical community, this new approach is intended for real-time processing from a moving platform, with ground as the background. The system produces a video stream with minimal delay. A new video quality measure (VQM_turb) is presented for quantifying the success of turbulence mitigation on real data where no reference imagery is available. The VQM_turb is the core of the innovation because it allows a wide range of algorithms to be quantitatively compared. An algorithm can be chosen, and then tuned, to best-fit available processing power, latency requirements, scenarios and sensor characteristics.

Proper evaluation of a pattern recognition system in the lab is paramount to its success in the field. In most commercial pattern recognition applications, such as breast cancer detection, optical character recognition, and industrial quality assurance, the boundaries and expectation of the system are well defined. This is due, at least in part, to an excellent understanding of the problem and data space for these applications. For these functions, a method for rigorous evaluation is well understood. However, the size and complexity of the data and problem spaces for automatic target recognition (ATR) systems is enormous. The consequences are that a complete understanding of how an ATR system will perform in practice is extraordinarily difficult to estimate. Thus the act of evaluating an ATR system becomes as important as its design. This paper compiles and reports the techniques used to evaluate ATR system performance. It surveys the specific difficulties associated with ATR performance estimation as well as approaches used to mitigate these obstacles.

This paper deals with several original contributions to an automatic target recognition (ATR) system, which is applied to underwater mine classification. The contributions concentrate on feature selection and object classification. First, a sophisticated filter method is designed for the feature selection. This filter method utilizes a novel feature relevance measure, the composite relevance measure (CRM). Feature relevance measures in the literature (e.g., mutual information and relief weight) evaluate the features only with respect to certain aspects. The CRM is a combination of several measures so that it is able to provide a more comprehensive assessment of the features. Both linear and nonlinear combinations of these measures are taken into account. A wide range of classifiers is able to provide satisfactory classification results by using the features selected according to the CRM. Second, in the step of object classification, an ensemble learning scheme in the framework of the Dempster-Shafer theory is introduced to fuse the results obtained by different classifiers. This fusion can improve the classification performance. We propose a reasonable construction of the basic belief assignment (BBA). The BBA considers both the reliability of the classifiers and the support of individual classifiers provided to the hypotheses about the types of test objects. Finally, this ATR system is applied to real synthetic aperture sonar imagery to evaluate its performance.

Fisher linear discriminant analysis (LDA) involves within-class and between-class covariance matrices. For 2-D data such as images, regularized LDA (RLDA) can improve LDA due to the regularized eigenvalues of the estimated within-class matrix. However, it fails to consider the eigenvectors and the estimated between-class matrix. To improve these two matrices simultaneously, we propose in this paper a new two-stage method for 2-D data, namely a bidirectional LDA (BLDA) in the first stage and the RLDA in the second stage, where both BLDA and RLDA are based on the Fisher criterion that tackles correlation. BLDA performs the LDA under special separable covariance constraints that incorporate the row and column correlations inherent in 2-D data. The main novelty is that we propose a simple but effective statistical test to determine the subspace dimensionality in the first stage. As a result, the first stage reduces the dimensionality substantially while keeping the significant discriminant information in the data. This enables the second stage to perform RLDA in a much lower dimensional subspace, and thus improves the two estimated matrices simultaneously. Experiments on a number of 2-D synthetic and real-world data sets show that BLDA+RLDA outperforms several closely related competitors.

Research was conducted to investigate the use of optical, air-born acoustic and plasma charge signals for detecting defects in laser welds. Full penetration, partial penetration and gapped-full penetration butt-joint welds were made in 1.4mm cold-rolled steel sheet. A 3 kW CO2 laser was used to produce these three classes of welds while laser power, travel speed and joint fitup were varied to produce the various conditions. Visible light, audible sound and electrical charge near the plume were measured simultaneously in real-time using a silicon photodiode, a condensor microphone and a plasma charge sensing gas nozzle, respectively. The spectra of the sensor signals were analyzed by a statistical technique known as Linear Discriminant Analysis (LDA). Stepwise LDA was used to identify the most important frequency bands and canonical discriminant analysis was employed to develop discriminant functions. Reliability analysis of the training samples revealed that this LDA method classified laser welds with reliability ranging from 85% to 96%, depending on the welds selected for inclusion in the training set. When the linear discriminant function was validated using new (untrained) samples, it distinguished the three different classes of laser welds with approximately 87% accuracy. Among the three signals, sound produced better separation between the classes of welds, although a discriminator based on all three signals combined and one that used only plasma charge and acoustic signals were of almost equal reliability.Research was conducted to investigate the use of optical, air-born acoustic and plasma charge signals for detecting defects in laser welds. Full penetration, partial penetration and gapped-full penetration butt-joint welds were made in 1.4mm cold-rolled steel sheet. A 3 kW CO2 laser was used to produce these three classes of welds while laser power, travel speed and joint fitup were varied to produce the various conditions. Visible light, audible sound and electrical charge near the plume were measured simultaneously in real-time using a silicon photodiode, a condensor microphone and a plasma charge sensing gas nozzle, respectively. The spectra of the sensor signals were analyzed by a statistical technique known as Linear Discriminant Analysis (LDA). Stepwise LDA was used to identify the most important frequency bands and canonical discriminant analysis was employed to develop discriminant functions. Reliability analysis of the training samples revealed that this LDA method classified laser welds with rel...

A fundamental question in neuroscience is how sensory signals are decoded from noisy cortical activity. We address this question in the olfactory system, decoding the route by which odorants arrive into the nasal cavity: through the nostrils (orthonasal), or through the back of the throat (retronasal). We recently showed with modeling and novel experiments on anesthetized rats that orthonasal versus retronasal modality information is encoded in the olfactory bulb (OB, a pre-cortical region). However, key questions remain: is modality information transmitted from OB to anterior piriform cortex (aPC)? How can this information be extracted from a much noisier cortical population with overall less firing? With simultaneous spike recordings of populations of neurons in OB and aPC, we show that an unsupervised and biologically plausible algorithm, Shared Covariance Decoding (SCD), can indeed linearly encode modality in low dimensional subspaces. Specifically, SCD improves encoding of ortho/retro in aPC compared to Fisher's linear discriminant analysis (LDA). Consistent with our theoretical analysis, when noise correlations between OB and aPC are low and OB well-encodes modality, modality in aPC tends to be encoded optimally with SCD. We observe that with several algorithms (LDA, SCD, optimal) the decoding accuracy distributions are invariant when GABA[Formula: see text] (ant-)agonists (bicuculline and muscimol) are applied to OB, which is consistent with invariance in population firing in aPC. Overall, we show modality information can be encoded efficiently in piriform cortex.

: This report focuses on the development of an automatic target recognition (ATR) system using high resolution synthetic aperture radar (SAR) imagery. The system achieves 95 to 100 percent recognition rates when applied to a set of MSTAR images. Typically, the system takes less than one minute to match an input image to a candidate vehicle class with Matlab programs running on a Pentium II 300 MHz machine. Experiments based on conventional recognition techniques were conducted for comparisons. Study of persistent scattering confirms the feasibility of implementing a SAR ATR system using physical image features. A new generic vehicle model, parameterized by the length, width, and orientation of a target is used in a two-phase recognition process with hypothesis generation and verification aimed at addressing the combinatorial target recognition problem. In the hypothesis generation stage, a few likely candidate target classes are identified from a target database with positive evidence. The candidates are assessed using both positive and negative evidence in the hypothesis verification stage. Leading surface estimation, image alignment, Delaunay walk, and recognition metrics are introduced to improve performance of the SAR ATR system.

The Deputy Under Secretary of Defense for Science and Technology (DUSD/S&T), as part of their ongoing ATR Program, has sponsored an effort to develop and demonstrate methods for evaluating ATR algorithms that utilize multiple data sources, i.e., fusion-based ATR. The AFRL COMPASE Center has formed a strong ATR evaluation team and this paper presents results from this program, focusing on the human-in-the-loop, i.e. assisted image exploitation. Reliance on Automated Target Recognition (ATR) technology is essential to the future success of Intelligence, Surveillance, and Reconnaissance (ISR) missions. Often, ATR technology is designed to aid the analyst, but the final decision rests with the human. Traditionally, evaluation of ATR systems has focused mainly on the performance of the algorithm. Assessing the benefits of ATR assistance for the user raises interesting methodological challenges. We will review the critical issues associated with evaluations of human-in-the-loop ATR systems and present a methodology for conducting these evaluations. Experimental design issues addressed in this discussion include training, learning effects, and human factors issues. The evaluation process becomes increasingly complex when data fusion is introduced. Even in the absence of ATR assistance, the simultaneous exploitation of multiple frames of co-registered imagery is not well understood. We will explore how the methodology developed for exploitation of a single source of data can be extended to the fusion setting.