• Home
  • Search
  • Neural architecture search based on dual attention mechanism for image classification.
  • Cite Icon5
  • https://doi.org/10.3934/mbe.2023126Copy DOI Icon

Neural architecture search based on dual attention mechanism for image classification.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep learning neural networks based on the manual design for image classification tasks usually require a large amount of a priori knowledge and experience from experts; thus, research on designing neural network architectures automatically has been widely performed. The neural architecture search (NAS) method based on the differentiable architecture search (DARTS) ignores the interrelationships within the searched network architecture cells. The optional operations in the architecture search space lack diversity, and the large parametric and non-parametric operations in the search space make the search process inefficient. We propose a NAS method based on a dual attention mechanism (DAM-DARTS). An improved attention mechanism module is introduced to the cell of the network architecture to deepen the interrelationships between the important layers within the architecture by enhancing the attention between them, which improves the accuracy of the architecture and reduces the architecture search time. We also propose a more efficient architecture search space by adding attention operations to increase the complex diversity of the searched network architectures and reduce the computational cost consumed in the search process by reducing non-parametric operations. Based on this, we further analyze the impact of changing some operations in the architecture search space on the accuracy of the architectures. Through extensive experiments on several open datasets, we demonstrate the effectiveness of the proposed search strategy, which is highly competitive with other existing neural network architecture search methods.

Similar Papers
  • Book Chapter
  • Citations1

Comparative Analysis of Neural Architecture Search Methods for Classification of Cultural Heritage Sites

  • Jan 01, 2022
  • Sunil V Gurlahosur +8
  • Research Article
  • Citations15

Efficient and lightweight convolutional neural network architecture search methods for object classification

  • Jul 06, 2024
  • Pattern Recognition
  • Chuen-Horng Lin +3
  • Research Article
  • Citations12

Enhanced Gradient for Differentiable Architecture Search.

  • Jul 01, 2024
  • IEEE transactions on neural networks and learning systems
  • Haichao Zhang +4
  • Conference Article
  • Citations19

Efficient Neural Architecture Search for End-to-End Speech Recognition Via Straight-Through Gradients

  • Jan 19, 2021
  • Huahuan Zheng +2
  • PDF
  • Research Article
  • Citations5

Multi-Objective Evolutionary Neural Architecture Search with Weight-Sharing Supernet

  • Jul 15, 2024
  • Applied Sciences
  • Junchao Liang +4
  • Research Article
  • Citations5

ETNAS: An energy consumption task-driven neural architecture search

  • Nov 10, 2023
  • Sustainable Computing: Informatics and Systems
  • Dong Dong +5
  • Conference Article
  • Citations48

Evolutionary Neural Architecture Search for Image Restoration

  • Jul 01, 2019
  • Gerard Jacques Van Wyk +1
  • Research Article
  • Citations6

BossNAS Family: Block-Wisely Self-Supervised Neural Architecture Search.

  • May 01, 2025
  • IEEE transactions on pattern analysis and machine intelligence
  • Changlin Li +6
  • Research Article
  • Citations22

EAT-NAS: elastic architecture transfer for accelerating large-scale neural architecture search

  • Aug 06, 2021
  • Science China Information Sciences
  • Jiemin Fang +7
  • Research Article
  • Citations17

Remote Sensing Scene Classification Based on Attention-Enabled Progressively Searching

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Junge Shen +4
  • Research Article
  • Citations7

Noise-Disruption-Inspired Neural Architecture Search with Spatial–Spectral Attention for Hyperspectral Image Classification

  • Aug 24, 2024
  • Remote Sensing
  • Aili Wang +5
  • PDF
  • Research Article
  • Citations5

Ancient mural dynasty recognition algorithm based on a neural network architecture search

  • May 15, 2024
  • Heritage Science
  • Jianfang Cao +4
  • Book Chapter
  • Citations1

Efficient Evolutionary Neural Architecture Search (NAS) by Modular Inheritable Crossover

  • Jan 01, 2020
  • Hao Tan +3
  • Book Chapter
  • Citations15

Evolutionary Neural Architecture Search Supporting Approximate Multipliers

  • Jan 01, 2021
  • Michal Pinos +2
  • Research Article
  • Citations12

DE-DARTS: Neural architecture search with dynamic exploration

  • Jun 01, 2023
  • ICT Express
  • Jiwoo Mun +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.