- Research Article
- 10.1109/tetci.2025.3623291
Interaction Feedback Network With Salient-Region-Aware Augmentation for Fine-Grained Visual Categorization
- Apr 01, 2026
- IEEE Transactions on Emerging Topics in Computational Intelligence
- Wei Song + 6 more +6
Recognizing distinct categories from the same super-category is a highly challenging task due to small inter-class and large intra-class variances. Despite the significant progress of deep convolutional neural network-based methods over the past few years, they are incapable of locating complete salient regions with respect to the object and parts (OPs) of an input image. Locating complete salient regions of OPs is very crucial to fine-grained visual categorization (FGVC), as it contributes to adequately capturing the salient features of OPs. Besides, most existing methods focus on extracting OPs’ features in a unidirectional way, neglecting potentially valuable information between OPs and that within themselves of different feature levels. Consequently, the quality of fine-grained features that are discriminative for FGVC is affected. To address these issues, herein an interaction feedback network with salient-region-aware augmentation (IFN-SA) is proposed. Specifically, a preliminary feature learning (PFL) module is first designed through the use of attention-based object and part streams, which preserve the contextual details semantically associated with OPs, facilitating the location of the complete salient regions and acquisition of the salient features of OPs. Following this, a progressive representation learning (PRL) module is built through the specially-designed vertical interaction mechanism (VIM) and horizontal feedback mechanism (HFM). VIM captures the high-level features via the interactions between OPs, while HFM calibrates the salient features with the feedbacks from the high-level ones and progressively excavates the latter ones. The experimental results especially the performance comparisons on four benchmark datasets validate the excellent performance of IFN-SA for FGVC.
Read more